2024-09-17T18:00:15.057 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T18:00:15.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T18:00:15.162 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228 branch: wip-bharath10-testing-2024-09-17-1348 description: rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-stupid} rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} email: skanta@redhat.com first_in_suite: false job_id: '7909228' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-bharath10-testing-2024-09-17-1348 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 2500 ms tcp read timeout: 5 osd_recovery_max_active: 10 osd_recovery_max_single_start: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true bluestore write v2: false bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd max backfills: 3 osd max markdown count: 1000 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - slow request - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath10-testing-2024-09-17-1348 sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 owner: scheduled_skanta@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 3421 sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath10-testing-2024-09-17-1348 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_1889a165b5128787ec693450a3d1c5df5d6dc203/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 targets: smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMT5zFu1EqHqCz5Ft1I2ixE4TSfpvrU9j21Qpg2vub0oVKT8NXtPucTMgwuPXewBLN2F4tjhi1NsNZWJZkflA+s= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUwYvyJLbm8yWhdJ1dOYAC96Q7ifhXlgLAGEWfV/ETSCJmMyNXYcAZYVZ5r0yayliPbbr6jiozg8Sar8A3HE64= smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL72oPKhr/CAn16r3OdoD4aAiSdPpcPK1gIjl81iKZMZHbpy7Ao+cpLCKAHFjjWq8q+VJOe4fBesC6infFbyZQA= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdAVshsWTl60G2ikF2CYBTWgBRvjdXzCFGC8/vnmL1rIuZJSz9+W1b7A6lTukR15I0QcG10G/GJfz8Yl/LCCYU= tasks: - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: aggressive_pg_num_changes: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 min_in: 8 timeout: 1200 - rados: clients: - client.0 ec_pool: true erasure_code_profile: c: 2 crush-failure-domain: osd k: 4 m: 3 name: shecprofile plugin: shec objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 400 write_append_excl: false teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_15:01:33 tube: smithi user: skanta verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T18:00:15.162 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_1889a165b5128787ec693450a3d1c5df5d6dc203/qa; will attempt to use it 2024-09-17T18:00:15.163 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_1889a165b5128787ec693450a3d1c5df5d6dc203/qa/tasks 2024-09-17T18:00:15.163 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T18:00:15.164 INFO:teuthology.task.internal:Checking packages... 2024-09-17T18:00:15.186 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '1889a165b5128787ec693450a3d1c5df5d6dc203' 2024-09-17T18:00:15.186 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T18:00:15.186 INFO:teuthology.packaging:ref: None 2024-09-17T18:00:15.186 INFO:teuthology.packaging:tag: None 2024-09-17T18:00:15.186 INFO:teuthology.packaging:branch: wip-bharath10-testing-2024-09-17-1348 2024-09-17T18:00:15.186 INFO:teuthology.packaging:sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T18:00:15.186 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-bharath10-testing-2024-09-17-1348 2024-09-17T18:00:15.343 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4975-g1889a165-1jammy 2024-09-17T18:00:15.345 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T18:00:15.351 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T18:00:15.351 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T18:00:15.402 INFO:teuthology.task.internal:Saving configuration 2024-09-17T18:00:15.418 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T18:00:15.436 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T18:00:15.461 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 17:54:28.186543', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMfbjvytfpDl2W1I8pb7Vd+CdSfBuy4I/cJ1frE3O5zG'} 2024-09-17T18:00:15.483 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 17:54:28.182258', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIqKw5jyBZws+xHwuT6z35n9hbteR1c35B+GV5zFh4HM'} 2024-09-17T18:00:15.504 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 17:54:28.185219', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG239vcVgwzgz52MUryWqZPeqWlknoKcd8XRDD6P1+wk'} 2024-09-17T18:00:15.525 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 17:54:28.183839', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEA2yBM3ND8V/v8TMJcE28BazE7Sc5QNpCJwQNa8aGaz'} 2024-09-17T18:00:15.525 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T18:00:15.531 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2024-09-17T18:00:15.531 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2024-09-17T18:00:15.531 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2024-09-17T18:00:15.531 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2024-09-17T18:00:15.531 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T18:00:15.653 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8c0f3ebbe0>, signals=[15]) 2024-09-17T18:00:15.653 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T18:00:15.659 INFO:teuthology.task.internal:Opening connections... 2024-09-17T18:00:15.659 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T18:00:15.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:00:15.750 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-09-17T18:00:15.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:00:15.832 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T18:00:15.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:00:15.922 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T18:00:15.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:00:16.007 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T18:00:16.017 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-09-17T18:00:16.024 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-09-17T18:00:16.024 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-09-17T18:00:16.073 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T18:00:16.073 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu" 2024-09-17T18:00:16.073 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="22.04" 2024-09-17T18:00:16.073 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T18:00:16.073 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=jammy 2024-09-17T18:00:16.073 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu 2024-09-17T18:00:16.073 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian 2024-09-17T18:00:16.073 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T18:00:16.073 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T18:00:16.073 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T18:00:16.074 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T18:00:16.074 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=jammy 2024-09-17T18:00:16.074 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-09-17T18:00:16.100 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-09-17T18:00:16.106 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-09-17T18:00:16.107 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-09-17T18:00:16.155 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T18:00:16.155 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Ubuntu" 2024-09-17T18:00:16.156 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="22.04" 2024-09-17T18:00:16.156 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T18:00:16.156 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_CODENAME=jammy 2024-09-17T18:00:16.156 INFO:teuthology.orchestra.run.smithi134.stdout:ID=ubuntu 2024-09-17T18:00:16.156 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE=debian 2024-09-17T18:00:16.156 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T18:00:16.156 INFO:teuthology.orchestra.run.smithi134.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T18:00:16.156 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T18:00:16.156 INFO:teuthology.orchestra.run.smithi134.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T18:00:16.156 INFO:teuthology.orchestra.run.smithi134.stdout:UBUNTU_CODENAME=jammy 2024-09-17T18:00:16.157 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-09-17T18:00:16.176 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2024-09-17T18:00:16.182 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2024-09-17T18:00:16.183 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2024-09-17T18:00:16.227 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T18:00:16.227 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Ubuntu" 2024-09-17T18:00:16.228 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="22.04" 2024-09-17T18:00:16.228 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T18:00:16.228 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_CODENAME=jammy 2024-09-17T18:00:16.228 INFO:teuthology.orchestra.run.smithi146.stdout:ID=ubuntu 2024-09-17T18:00:16.228 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE=debian 2024-09-17T18:00:16.228 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T18:00:16.228 INFO:teuthology.orchestra.run.smithi146.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T18:00:16.228 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T18:00:16.228 INFO:teuthology.orchestra.run.smithi146.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T18:00:16.228 INFO:teuthology.orchestra.run.smithi146.stdout:UBUNTU_CODENAME=jammy 2024-09-17T18:00:16.229 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2024-09-17T18:00:16.251 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-09-17T18:00:16.257 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-09-17T18:00:16.257 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-09-17T18:00:16.304 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T18:00:16.305 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu" 2024-09-17T18:00:16.305 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="22.04" 2024-09-17T18:00:16.305 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T18:00:16.305 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=jammy 2024-09-17T18:00:16.305 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu 2024-09-17T18:00:16.305 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian 2024-09-17T18:00:16.305 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T18:00:16.305 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T18:00:16.305 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T18:00:16.305 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T18:00:16.305 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=jammy 2024-09-17T18:00:16.306 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-09-17T18:00:16.325 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T18:00:16.335 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T18:00:16.377 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T18:00:16.377 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-09-17T18:00:16.379 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-09-17T18:00:16.382 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2024-09-17T18:00:16.384 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-09-17T18:00:16.389 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T18:00:16.401 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T18:00:16.402 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-09-17T18:00:16.426 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-09-17T18:00:16.428 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2024-09-17T18:00:16.433 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-09-17T18:00:16.524 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T18:00:16.612 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T18:00:16.626 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T18:00:16.626 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T18:00:16.627 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T18:00:16.627 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T18:00:16.627 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T18:00:16.628 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T18:00:16.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:00:16.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:00:16.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:00:16.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:00:16.636 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-09-17T18:00:16.636 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-17T18:00:16.636 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-17T18:00:16.637 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-09-17T18:00:16.681 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-56-generic 2024-09-17T18:00:16.681 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.15.0-56-generic 2024-09-17T18:00:16.681 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-09-17T18:00:16.683 INFO:teuthology.orchestra.run.smithi087.stdout:5.15.0-56-generic 2024-09-17T18:00:16.683 INFO:teuthology.task.kernel:Running kernel on smithi087: 5.15.0-56-generic 2024-09-17T18:00:16.683 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get clean 2024-09-17T18:00:16.685 INFO:teuthology.orchestra.run.smithi134.stdout:5.15.0-56-generic 2024-09-17T18:00:16.685 INFO:teuthology.orchestra.run.smithi146.stdout:5.15.0-56-generic 2024-09-17T18:00:16.685 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.15.0-56-generic 2024-09-17T18:00:16.685 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2024-09-17T18:00:16.686 INFO:teuthology.task.kernel:Running kernel on smithi146: 5.15.0-56-generic 2024-09-17T18:00:16.686 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get clean 2024-09-17T18:00:16.811 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2024-09-17T18:00:16.814 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get update 2024-09-17T18:00:16.820 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-09-17T18:00:16.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-09-17T18:00:17.085 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T18:00:17.093 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T18:00:17.145 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T18:00:17.249 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T18:00:17.332 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T18:00:17.498 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T18:00:17.542 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-17T18:00:17.635 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T18:00:17.723 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T18:00:17.723 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T18:00:17.731 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-17T18:00:17.764 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T18:00:17.777 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T18:00:17.781 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T18:00:17.830 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T18:00:17.837 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-17T18:00:17.853 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-17T18:00:17.856 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T18:00:17.937 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T18:00:17.979 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T18:00:17.989 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T18:00:18.003 INFO:teuthology.orchestra.run.smithi146.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T18:00:18.004 INFO:teuthology.orchestra.run.smithi146.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T18:00:18.005 INFO:teuthology.orchestra.run.smithi146.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T18:00:18.007 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T18:00:18.011 INFO:teuthology.orchestra.run.smithi146.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-17T18:00:18.024 INFO:teuthology.orchestra.run.smithi146.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T18:00:18.024 INFO:teuthology.orchestra.run.smithi146.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T18:00:18.025 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-17T18:00:18.026 INFO:teuthology.orchestra.run.smithi146.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-17T18:00:18.035 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T18:00:18.043 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T18:00:18.045 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T18:00:18.046 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T18:00:18.052 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T18:00:18.064 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T18:00:18.065 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T18:00:18.068 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T18:00:18.068 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T18:00:18.076 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T18:00:18.078 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T18:00:18.081 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T18:00:18.082 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T18:00:18.083 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-17T18:00:18.085 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T18:00:18.085 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T18:00:18.087 INFO:teuthology.orchestra.run.smithi146.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T18:00:18.095 INFO:teuthology.orchestra.run.smithi146.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T18:00:18.095 INFO:teuthology.orchestra.run.smithi146.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T18:00:18.103 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T18:00:18.104 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T18:00:18.105 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T18:00:18.106 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T18:00:18.106 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T18:00:18.106 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T18:00:18.106 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T18:00:18.107 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T18:00:18.110 INFO:teuthology.orchestra.run.smithi146.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-17T18:00:18.111 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T18:00:18.111 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T18:00:18.112 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T18:00:18.112 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T18:00:18.117 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T18:00:18.119 INFO:teuthology.orchestra.run.smithi146.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T18:00:18.119 INFO:teuthology.orchestra.run.smithi146.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [903 kB] 2024-09-17T18:00:18.124 INFO:teuthology.orchestra.run.smithi146.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T18:00:18.124 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T18:00:18.125 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-17T18:00:18.126 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T18:00:18.126 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T18:00:18.127 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T18:00:18.128 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T18:00:18.128 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T18:00:18.129 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T18:00:18.129 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T18:00:18.136 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T18:00:18.136 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T18:00:18.138 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-17T18:00:18.143 INFO:teuthology.orchestra.run.smithi146.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T18:00:18.148 INFO:teuthology.orchestra.run.smithi146.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-17T18:00:18.152 INFO:teuthology.orchestra.run.smithi146.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [628 kB] 2024-09-17T18:00:18.153 INFO:teuthology.orchestra.run.smithi146.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T18:00:18.154 INFO:teuthology.orchestra.run.smithi146.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T18:00:18.154 INFO:teuthology.orchestra.run.smithi146.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T18:00:18.156 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T18:00:18.157 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T18:00:18.158 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T18:00:18.158 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T18:00:18.158 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T18:00:18.158 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T18:00:18.159 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T18:00:18.159 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T18:00:18.171 INFO:teuthology.orchestra.run.smithi146.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-17T18:00:18.177 INFO:teuthology.orchestra.run.smithi146.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T18:00:18.177 INFO:teuthology.orchestra.run.smithi146.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T18:00:18.178 INFO:teuthology.orchestra.run.smithi146.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T18:00:18.178 INFO:teuthology.orchestra.run.smithi146.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T18:00:18.198 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-17T18:00:18.203 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T18:00:18.211 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T18:00:18.211 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T18:00:18.213 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-17T18:00:18.231 INFO:teuthology.orchestra.run.smithi146.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T18:00:18.231 INFO:teuthology.orchestra.run.smithi146.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T18:00:18.232 INFO:teuthology.orchestra.run.smithi146.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T18:00:18.234 INFO:teuthology.orchestra.run.smithi146.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T18:00:18.235 INFO:teuthology.orchestra.run.smithi146.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T18:00:18.235 INFO:teuthology.orchestra.run.smithi146.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T18:00:18.235 INFO:teuthology.orchestra.run.smithi146.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T18:00:18.258 INFO:teuthology.orchestra.run.smithi146.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T18:00:18.292 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T18:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T18:00:18.298 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-17T18:00:18.300 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T18:00:18.302 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T18:00:18.302 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T18:00:18.303 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T18:00:18.306 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T18:00:18.306 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [903 kB] 2024-09-17T18:00:18.313 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-17T18:00:18.315 INFO:teuthology.orchestra.run.smithi146.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T18:00:18.317 INFO:teuthology.orchestra.run.smithi146.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T18:00:18.321 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T18:00:18.325 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T18:00:18.325 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T18:00:18.326 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T18:00:18.327 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-17T18:00:18.333 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T18:00:18.337 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [628 kB] 2024-09-17T18:00:18.340 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T18:00:18.341 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-17T18:00:18.341 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T18:00:18.341 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T18:00:18.341 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T18:00:18.353 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T18:00:18.353 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T18:00:18.353 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T18:00:18.354 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T18:00:18.356 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-17T18:00:18.362 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T18:00:18.363 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T18:00:18.363 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T18:00:18.363 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T18:00:18.370 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T18:00:18.370 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T18:00:18.370 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T18:00:18.370 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T18:00:18.371 INFO:teuthology.orchestra.run.smithi087.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T18:00:18.414 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T18:00:18.415 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-17T18:00:18.424 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T18:00:18.424 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [628 kB] 2024-09-17T18:00:18.441 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [903 kB] 2024-09-17T18:00:18.442 INFO:teuthology.orchestra.run.smithi087.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T18:00:18.453 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-17T18:00:18.474 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-17T18:00:18.479 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T18:00:18.480 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T18:00:18.480 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T18:00:18.516 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-17T18:00:18.557 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-17T18:00:18.560 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T18:00:18.561 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T18:00:18.562 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T18:00:18.563 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-17T18:00:18.597 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T18:00:18.597 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-17T18:00:18.602 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T18:00:18.602 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [628 kB] 2024-09-17T18:00:18.607 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [903 kB] 2024-09-17T18:00:18.615 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-17T18:00:18.617 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T18:00:18.617 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T18:00:18.618 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T18:00:18.674 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T18:00:18.674 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T18:00:24.402 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 16.2 MB in 3s (5,672 kB/s) 2024-09-17T18:00:24.421 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 16.2 MB in 3s (5,917 kB/s) 2024-09-17T18:00:24.471 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 16.2 MB in 3s (5,365 kB/s) 2024-09-17T18:00:24.780 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 16.2 MB in 3s (5,490 kB/s) 2024-09-17T18:00:25.801 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-17T18:00:25.818 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T18:00:25.823 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2024-09-17T18:00:25.841 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T18:00:25.849 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-17T18:00:25.866 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T18:00:25.870 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-17T18:00:25.902 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2024-09-17T18:00:25.920 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-17T18:00:26.058 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-09-17T18:00:26.058 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-09-17T18:00:26.091 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2024-09-17T18:00:26.091 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2024-09-17T18:00:26.108 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-09-17T18:00:26.108 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-09-17T18:00:26.131 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-17T18:00:26.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T18:00:26.202 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-17T18:00:26.226 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T18:00:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T18:00:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T18:00:26.227 INFO:teuthology.orchestra.run.smithi087.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T18:00:26.227 INFO:teuthology.orchestra.run.smithi087.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T18:00:26.227 INFO:teuthology.orchestra.run.smithi087.stdout: python2.7-minimal 2024-09-17T18:00:26.227 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T18:00:26.228 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2024-09-17T18:00:26.228 INFO:teuthology.orchestra.run.smithi087.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T18:00:26.228 INFO:teuthology.orchestra.run.smithi087.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T18:00:26.229 INFO:teuthology.orchestra.run.smithi087.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T18:00:26.230 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2024-09-17T18:00:26.230 INFO:teuthology.orchestra.run.smithi087.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T18:00:26.230 INFO:teuthology.orchestra.run.smithi087.stdout:Recommended packages: 2024-09-17T18:00:26.230 INFO:teuthology.orchestra.run.smithi087.stdout: thermald 2024-09-17T18:00:26.260 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T18:00:26.260 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T18:00:26.260 INFO:teuthology.orchestra.run.smithi146.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T18:00:26.261 INFO:teuthology.orchestra.run.smithi146.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T18:00:26.261 INFO:teuthology.orchestra.run.smithi146.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T18:00:26.261 INFO:teuthology.orchestra.run.smithi146.stdout: python2.7-minimal 2024-09-17T18:00:26.261 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T18:00:26.262 INFO:teuthology.orchestra.run.smithi146.stdout:The following additional packages will be installed: 2024-09-17T18:00:26.262 INFO:teuthology.orchestra.run.smithi146.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T18:00:26.262 INFO:teuthology.orchestra.run.smithi146.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T18:00:26.263 INFO:teuthology.orchestra.run.smithi146.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T18:00:26.264 INFO:teuthology.orchestra.run.smithi146.stdout:Suggested packages: 2024-09-17T18:00:26.264 INFO:teuthology.orchestra.run.smithi146.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T18:00:26.264 INFO:teuthology.orchestra.run.smithi146.stdout:Recommended packages: 2024-09-17T18:00:26.264 INFO:teuthology.orchestra.run.smithi146.stdout: thermald 2024-09-17T18:00:26.278 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T18:00:26.278 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T18:00:26.278 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T18:00:26.279 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T18:00:26.279 INFO:teuthology.orchestra.run.smithi134.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T18:00:26.279 INFO:teuthology.orchestra.run.smithi134.stdout: python2.7-minimal 2024-09-17T18:00:26.279 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T18:00:26.280 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-09-17T18:00:26.280 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T18:00:26.280 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T18:00:26.281 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T18:00:26.281 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2024-09-17T18:00:26.281 INFO:teuthology.orchestra.run.smithi087.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T18:00:26.281 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T18:00:26.282 INFO:teuthology.orchestra.run.smithi087.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T18:00:26.282 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-09-17T18:00:26.282 INFO:teuthology.orchestra.run.smithi134.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T18:00:26.282 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-09-17T18:00:26.282 INFO:teuthology.orchestra.run.smithi134.stdout: thermald 2024-09-17T18:00:26.283 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2024-09-17T18:00:26.283 INFO:teuthology.orchestra.run.smithi087.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T18:00:26.317 INFO:teuthology.orchestra.run.smithi146.stdout:The following NEW packages will be installed: 2024-09-17T18:00:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T18:00:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T18:00:26.318 INFO:teuthology.orchestra.run.smithi146.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T18:00:26.319 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be upgraded: 2024-09-17T18:00:26.319 INFO:teuthology.orchestra.run.smithi146.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T18:00:26.333 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-09-17T18:00:26.334 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T18:00:26.334 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T18:00:26.334 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T18:00:26.334 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2024-09-17T18:00:26.335 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T18:00:26.369 INFO:teuthology.orchestra.run.smithi146.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T18:00:26.370 INFO:teuthology.orchestra.run.smithi146.stdout:Need to get 113 MB of archives. 2024-09-17T18:00:26.370 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T18:00:26.370 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T18:00:26.385 INFO:teuthology.orchestra.run.smithi134.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T18:00:26.385 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 113 MB of archives. 2024-09-17T18:00:26.385 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T18:00:26.385 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T18:00:26.389 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-17T18:00:26.390 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-17T18:00:26.463 INFO:teuthology.orchestra.run.smithi087.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T18:00:26.464 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 113 MB of archives. 2024-09-17T18:00:26.464 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T18:00:26.464 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T18:00:26.557 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T18:00:26.557 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T18:00:26.557 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T18:00:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T18:00:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T18:00:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: python2.7-minimal 2024-09-17T18:00:26.558 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T18:00:26.559 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-09-17T18:00:26.559 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T18:00:26.560 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T18:00:26.560 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T18:00:26.561 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-09-17T18:00:26.561 INFO:teuthology.orchestra.run.smithi154.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T18:00:26.561 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-09-17T18:00:26.561 INFO:teuthology.orchestra.run.smithi154.stdout: thermald 2024-09-17T18:00:26.617 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-09-17T18:00:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T18:00:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T18:00:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T18:00:26.619 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2024-09-17T18:00:26.620 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T18:00:26.800 INFO:teuthology.orchestra.run.smithi154.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T18:00:26.800 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 113 MB of archives. 2024-09-17T18:00:26.800 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T18:00:26.800 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T18:00:26.805 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T18:00:26.825 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T18:00:26.915 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T18:00:26.924 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T18:00:27.665 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T18:00:27.665 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T18:00:27.665 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T18:00:27.703 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T18:00:27.703 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T18:00:27.704 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T18:00:27.782 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T18:00:27.823 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T18:00:27.845 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T18:00:27.852 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T18:00:27.880 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T18:00:28.202 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T18:00:28.284 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 113 MB in 2s (72.9 MB/s) 2024-09-17T18:00:28.306 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 113 MB in 2s (72.3 MB/s) 2024-09-17T18:00:28.312 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T18:00:28.426 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T18:00:28.493 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T18:00:28.662 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T18:00:30.394 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T18:00:30.399 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:30.425 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T18:00:30.451 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T18:00:30.455 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:30.466 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T18:00:30.467 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T18:00:30.481 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:30.589 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:30.858 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T18:00:30.890 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T18:00:30.890 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T18:00:30.890 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T18:00:30.904 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T18:00:31.234 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T18:00:31.282 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 113 MB in 5s (24.6 MB/s) 2024-09-17T18:00:31.314 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T18:00:31.464 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T18:00:31.719 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 113 MB in 5s (24.2 MB/s) 2024-09-17T18:00:31.875 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T18:00:32.665 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T18:00:32.686 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:32.751 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T18:00:32.772 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:32.777 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:32.873 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:33.259 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T18:00:33.272 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:33.309 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:33.437 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T18:00:33.457 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:33.459 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T18:00:33.463 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:33.519 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:33.820 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:34.081 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T18:00:34.085 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:34.239 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:35.644 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T18:00:35.665 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:35.774 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:36.239 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T18:00:36.259 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:36.297 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:36.440 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T18:00:36.462 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:36.543 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:37.356 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T18:00:37.376 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:37.452 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:39.748 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T18:00:39.884 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T18:00:40.158 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T18:00:40.217 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T18:00:40.294 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T18:00:40.321 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T18:00:40.590 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T18:00:40.614 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T18:00:40.618 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T18:00:40.657 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T18:00:40.723 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T18:00:41.009 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T18:00:41.031 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T18:00:41.075 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T18:00:43.028 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T18:00:43.153 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T18:00:43.518 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T18:00:43.640 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T18:00:43.778 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T18:00:43.906 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T18:00:43.951 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T18:00:43.973 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T18:00:44.017 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T18:00:44.238 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T18:00:44.392 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T18:00:44.654 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T18:00:44.676 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T18:00:44.712 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T18:00:46.247 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T18:00:46.270 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:46.313 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:46.837 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T18:00:46.874 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:46.911 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:48.852 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T18:00:48.976 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T18:00:49.302 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T18:00:49.398 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T18:00:49.423 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:49.436 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T18:00:49.524 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:49.549 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T18:00:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T18:00:49.678 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:49.954 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T18:00:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T18:00:50.314 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:50.433 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T18:00:50.470 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T18:00:50.525 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:51.013 INFO:teuthology.orchestra.run.smithi134.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T18:00:51.013 INFO:teuthology.orchestra.run.smithi134.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T18:00:51.013 INFO:teuthology.orchestra.run.smithi134.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T18:00:51.013 INFO:teuthology.orchestra.run.smithi134.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T18:00:51.188 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T18:00:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T18:00:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T18:00:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T18:00:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:52.195 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T18:00:52.535 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T18:00:53.357 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T18:00:53.483 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T18:00:53.576 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T18:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:53.658 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T18:00:53.698 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:53.784 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T18:00:53.824 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T18:00:53.910 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:53.953 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:54.145 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T18:00:54.252 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T18:00:54.585 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T18:00:54.707 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T18:00:54.953 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:54.985 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:55.036 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T18:00:55.036 INFO:teuthology.orchestra.run.smithi134.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T18:00:55.288 INFO:teuthology.orchestra.run.smithi087.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T18:00:55.289 INFO:teuthology.orchestra.run.smithi087.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T18:00:55.289 INFO:teuthology.orchestra.run.smithi087.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T18:00:55.289 INFO:teuthology.orchestra.run.smithi087.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T18:00:55.337 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:55.396 INFO:teuthology.orchestra.run.smithi146.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T18:00:55.396 INFO:teuthology.orchestra.run.smithi146.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T18:00:55.429 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:56.282 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T18:00:56.283 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T18:00:56.283 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T18:00:56.283 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T18:00:56.446 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:56.797 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T18:00:56.915 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T18:00:57.041 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:57.840 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T18:00:57.974 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T18:00:58.100 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:58.685 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:59.278 INFO:teuthology.orchestra.run.smithi087.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T18:00:59.278 INFO:teuthology.orchestra.run.smithi087.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T18:00:59.718 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T18:00:59.780 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T18:00:59.780 INFO:teuthology.orchestra.run.smithi154.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T18:01:09.446 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T18:01:09.446 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub' 2024-09-17T18:01:09.456 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T18:01:09.483 INFO:teuthology.orchestra.run.smithi134.stdout:Generating grub configuration file ... 2024-09-17T18:01:09.539 INFO:teuthology.orchestra.run.smithi146.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T18:01:09.539 INFO:teuthology.orchestra.run.smithi146.stdout:Sourcing file `/etc/default/grub' 2024-09-17T18:01:09.554 INFO:teuthology.orchestra.run.smithi146.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T18:01:09.585 INFO:teuthology.orchestra.run.smithi146.stdout:Generating grub configuration file ... 2024-09-17T18:01:09.782 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T18:01:09.811 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T18:01:09.852 INFO:teuthology.orchestra.run.smithi146.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T18:01:09.865 INFO:teuthology.orchestra.run.smithi146.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T18:01:10.128 INFO:teuthology.orchestra.run.smithi146.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T18:01:10.133 INFO:teuthology.orchestra.run.smithi146.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T18:01:10.163 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T18:01:10.169 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T18:01:10.205 INFO:teuthology.orchestra.run.smithi146.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T18:01:10.210 INFO:teuthology.orchestra.run.smithi146.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T18:01:10.242 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T18:01:10.248 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T18:01:10.370 INFO:teuthology.orchestra.run.smithi146.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T18:01:10.370 INFO:teuthology.orchestra.run.smithi146.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T18:01:10.371 INFO:teuthology.orchestra.run.smithi146.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T18:01:10.393 INFO:teuthology.orchestra.run.smithi134.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T18:01:10.393 INFO:teuthology.orchestra.run.smithi134.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T18:01:10.393 INFO:teuthology.orchestra.run.smithi134.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T18:01:10.418 INFO:teuthology.orchestra.run.smithi146.stdout:done 2024-09-17T18:01:10.438 INFO:teuthology.orchestra.run.smithi134.stdout:done 2024-09-17T18:01:10.877 DEBUG:teuthology.orchestra.run.smithi146:> dpkg -s linux-image-generic 2024-09-17T18:01:10.900 INFO:teuthology.orchestra.run.smithi146.stdout:Package: linux-image-generic 2024-09-17T18:01:10.901 INFO:teuthology.orchestra.run.smithi146.stdout:Status: install ok installed 2024-09-17T18:01:10.901 INFO:teuthology.orchestra.run.smithi146.stdout:Priority: optional 2024-09-17T18:01:10.901 INFO:teuthology.orchestra.run.smithi146.stdout:Section: kernel 2024-09-17T18:01:10.901 INFO:teuthology.orchestra.run.smithi146.stdout:Installed-Size: 21 2024-09-17T18:01:10.901 INFO:teuthology.orchestra.run.smithi146.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T18:01:10.901 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: amd64 2024-09-17T18:01:10.901 INFO:teuthology.orchestra.run.smithi146.stdout:Source: linux-meta 2024-09-17T18:01:10.901 INFO:teuthology.orchestra.run.smithi146.stdout:Version: 5.15.0.122.122 2024-09-17T18:01:10.901 INFO:teuthology.orchestra.run.smithi146.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T18:01:10.901 INFO:teuthology.orchestra.run.smithi146.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T18:01:10.901 INFO:teuthology.orchestra.run.smithi146.stdout:Recommends: thermald 2024-09-17T18:01:10.901 INFO:teuthology.orchestra.run.smithi146.stdout:Description: Generic Linux kernel image 2024-09-17T18:01:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: This package will always depend on the latest generic kernel image 2024-09-17T18:01:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: available. 2024-09-17T18:01:10.902 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T18:01:10.902 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T18:01:10.902 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T18:01:10.902 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-17T18:01:10.902 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T18:01:10.903 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get clean 2024-09-17T18:01:10.923 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2024-09-17T18:01:10.947 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2024-09-17T18:01:10.947 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2024-09-17T18:01:10.947 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2024-09-17T18:01:10.947 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2024-09-17T18:01:10.947 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 21 2024-09-17T18:01:10.947 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T18:01:10.947 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2024-09-17T18:01:10.948 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2024-09-17T18:01:10.948 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.15.0.122.122 2024-09-17T18:01:10.948 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T18:01:10.948 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T18:01:10.948 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2024-09-17T18:01:10.948 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2024-09-17T18:01:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2024-09-17T18:01:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2024-09-17T18:01:10.948 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T18:01:10.948 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T18:01:10.949 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T18:01:10.949 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-17T18:01:10.949 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T18:01:10.949 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2024-09-17T18:01:11.054 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get update 2024-09-17T18:01:11.127 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-09-17T18:01:11.164 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T18:01:11.286 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T18:01:11.384 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T18:01:11.384 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T18:01:11.387 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T18:01:11.449 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T18:01:11.456 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T18:01:11.538 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T18:01:12.566 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2024-09-17T18:01:12.585 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T18:01:12.637 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2024-09-17T18:01:12.822 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-17T18:01:12.825 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2024-09-17T18:01:12.825 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2024-09-17T18:01:12.841 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T18:01:12.897 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-17T18:01:12.993 INFO:teuthology.orchestra.run.smithi146.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T18:01:12.994 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T18:01:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T18:01:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T18:01:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T18:01:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T18:01:12.994 INFO:teuthology.orchestra.run.smithi146.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T18:01:12.995 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T18:01:13.033 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T18:01:13.035 DEBUG:teuthology.orchestra.run.smithi146:> dpkg -s linux-image-generic 2024-09-17T18:01:13.084 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-09-17T18:01:13.085 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-09-17T18:01:13.093 INFO:teuthology.orchestra.run.smithi146.stdout:Package: linux-image-generic 2024-09-17T18:01:13.093 INFO:teuthology.orchestra.run.smithi146.stdout:Status: install ok installed 2024-09-17T18:01:13.093 INFO:teuthology.orchestra.run.smithi146.stdout:Priority: optional 2024-09-17T18:01:13.093 INFO:teuthology.orchestra.run.smithi146.stdout:Section: kernel 2024-09-17T18:01:13.094 INFO:teuthology.orchestra.run.smithi146.stdout:Installed-Size: 21 2024-09-17T18:01:13.094 INFO:teuthology.orchestra.run.smithi146.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T18:01:13.094 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: amd64 2024-09-17T18:01:13.094 INFO:teuthology.orchestra.run.smithi146.stdout:Source: linux-meta 2024-09-17T18:01:13.094 INFO:teuthology.orchestra.run.smithi146.stdout:Version: 5.15.0.122.122 2024-09-17T18:01:13.094 INFO:teuthology.orchestra.run.smithi146.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T18:01:13.094 INFO:teuthology.orchestra.run.smithi146.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T18:01:13.094 INFO:teuthology.orchestra.run.smithi146.stdout:Recommends: thermald 2024-09-17T18:01:13.094 INFO:teuthology.orchestra.run.smithi146.stdout:Description: Generic Linux kernel image 2024-09-17T18:01:13.094 INFO:teuthology.orchestra.run.smithi146.stdout: This package will always depend on the latest generic kernel image 2024-09-17T18:01:13.094 INFO:teuthology.orchestra.run.smithi146.stdout: available. 2024-09-17T18:01:13.095 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2024-09-17T18:01:13.142 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.sbnwkpHWtg 2024-09-17T18:01:13.143 DEBUG:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub/grub.cfg /tmp/tmp.sbnwkpHWtg 2024-09-17T18:01:13.217 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.sbnwkpHWtg 2024-09-17T18:01:13.251 INFO:teuthology.orchestra.run.smithi134.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T18:01:13.251 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T18:01:13.251 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T18:01:13.251 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T18:01:13.251 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T18:01:13.252 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T18:01:13.252 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T18:01:13.252 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T18:01:13.293 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T18:01:13.294 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2024-09-17T18:01:13.298 INFO:teuthology.orchestra.run.smithi087.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T18:01:13.298 INFO:teuthology.orchestra.run.smithi087.stdout:Sourcing file `/etc/default/grub' 2024-09-17T18:01:13.310 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2024-09-17T18:01:13.310 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2024-09-17T18:01:13.310 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2024-09-17T18:01:13.310 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2024-09-17T18:01:13.310 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 21 2024-09-17T18:01:13.310 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T18:01:13.310 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2024-09-17T18:01:13.311 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2024-09-17T18:01:13.311 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.15.0.122.122 2024-09-17T18:01:13.311 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T18:01:13.311 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T18:01:13.311 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2024-09-17T18:01:13.311 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2024-09-17T18:01:13.311 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2024-09-17T18:01:13.311 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2024-09-17T18:01:13.311 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-17T18:01:13.318 INFO:teuthology.orchestra.run.smithi087.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T18:01:13.333 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.sbnwkpHWtg is 10KB 2024-09-17T18:01:13.346 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.sbnwkpHWtg 2024-09-17T18:01:13.347 INFO:teuthology.orchestra.run.smithi087.stdout:Generating grub configuration file ... 2024-09-17T18:01:13.352 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T18:01:13.359 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.cCqN5zGZjF 2024-09-17T18:01:13.359 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub/grub.cfg /tmp/tmp.cCqN5zGZjF 2024-09-17T18:01:13.406 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:01:13.406 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T18:01:13.406 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T18:01:13.414 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.cCqN5zGZjF 2024-09-17T18:01:13.474 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T18:01:13.474 DEBUG:teuthology.orchestra.run.smithi146:> sudo update-grub 2024-09-17T18:01:13.537 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.cCqN5zGZjF is 10KB 2024-09-17T18:01:13.550 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.cCqN5zGZjF 2024-09-17T18:01:13.555 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T18:01:13.593 INFO:teuthology.orchestra.run.smithi087.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T18:01:13.609 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:01:13.609 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T18:01:13.610 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T18:01:13.612 INFO:teuthology.orchestra.run.smithi087.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T18:01:13.678 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T18:01:13.678 DEBUG:teuthology.orchestra.run.smithi134:> sudo update-grub 2024-09-17T18:01:13.907 INFO:teuthology.orchestra.run.smithi087.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T18:01:13.913 INFO:teuthology.orchestra.run.smithi087.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T18:01:13.934 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T18:01:13.934 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub' 2024-09-17T18:01:13.957 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T18:01:13.975 INFO:teuthology.orchestra.run.smithi154.stdout:Generating grub configuration file ... 2024-09-17T18:01:13.980 INFO:teuthology.orchestra.run.smithi087.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T18:01:13.986 INFO:teuthology.orchestra.run.smithi087.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T18:01:14.173 INFO:teuthology.orchestra.run.smithi087.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T18:01:14.173 INFO:teuthology.orchestra.run.smithi087.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T18:01:14.173 INFO:teuthology.orchestra.run.smithi087.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T18:01:14.226 INFO:teuthology.orchestra.run.smithi087.stdout:done 2024-09-17T18:01:14.229 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T18:01:14.244 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T18:01:14.537 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T18:01:14.543 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T18:01:14.608 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T18:01:14.613 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T18:01:14.646 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub' 2024-09-17T18:01:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T18:01:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2024-09-17T18:01:14.698 DEBUG:teuthology.orchestra.run.smithi087:> dpkg -s linux-image-generic 2024-09-17T18:01:14.724 INFO:teuthology.orchestra.run.smithi087.stdout:Package: linux-image-generic 2024-09-17T18:01:14.724 INFO:teuthology.orchestra.run.smithi087.stdout:Status: install ok installed 2024-09-17T18:01:14.724 INFO:teuthology.orchestra.run.smithi087.stdout:Priority: optional 2024-09-17T18:01:14.724 INFO:teuthology.orchestra.run.smithi087.stdout:Section: kernel 2024-09-17T18:01:14.724 INFO:teuthology.orchestra.run.smithi087.stdout:Installed-Size: 21 2024-09-17T18:01:14.724 INFO:teuthology.orchestra.run.smithi087.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T18:01:14.725 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: amd64 2024-09-17T18:01:14.725 INFO:teuthology.orchestra.run.smithi087.stdout:Source: linux-meta 2024-09-17T18:01:14.725 INFO:teuthology.orchestra.run.smithi087.stdout:Version: 5.15.0.122.122 2024-09-17T18:01:14.725 INFO:teuthology.orchestra.run.smithi087.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T18:01:14.725 INFO:teuthology.orchestra.run.smithi087.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T18:01:14.725 INFO:teuthology.orchestra.run.smithi087.stdout:Recommends: thermald 2024-09-17T18:01:14.725 INFO:teuthology.orchestra.run.smithi087.stdout:Description: Generic Linux kernel image 2024-09-17T18:01:14.725 INFO:teuthology.orchestra.run.smithi087.stdout: This package will always depend on the latest generic kernel image 2024-09-17T18:01:14.725 INFO:teuthology.orchestra.run.smithi087.stdout: available. 2024-09-17T18:01:14.725 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T18:01:14.725 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T18:01:14.726 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T18:01:14.726 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-17T18:01:14.726 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T18:01:14.726 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get clean 2024-09-17T18:01:14.760 INFO:teuthology.orchestra.run.smithi154.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T18:01:14.760 INFO:teuthology.orchestra.run.smithi154.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T18:01:14.760 INFO:teuthology.orchestra.run.smithi154.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T18:01:14.804 INFO:teuthology.orchestra.run.smithi154.stdout:done 2024-09-17T18:01:14.824 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T18:01:14.830 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T18:01:14.888 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub' 2024-09-17T18:01:14.889 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T18:01:14.890 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-09-17T18:01:14.919 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2024-09-17T18:01:15.032 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T18:01:15.067 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T18:01:15.072 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T18:01:15.107 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T18:01:15.113 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T18:01:15.116 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T18:01:15.121 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T18:01:15.156 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T18:01:15.237 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T18:01:15.248 INFO:teuthology.orchestra.run.smithi146.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T18:01:15.248 INFO:teuthology.orchestra.run.smithi146.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T18:01:15.248 INFO:teuthology.orchestra.run.smithi146.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T18:01:15.260 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-09-17T18:01:15.263 INFO:teuthology.orchestra.run.smithi146.stderr:done 2024-09-17T18:01:15.277 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-09-17T18:01:15.277 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-09-17T18:01:15.277 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-09-17T18:01:15.277 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-09-17T18:01:15.277 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 21 2024-09-17T18:01:15.277 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T18:01:15.277 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-09-17T18:01:15.277 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-09-17T18:01:15.277 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.122.122 2024-09-17T18:01:15.278 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T18:01:15.278 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T18:01:15.278 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-09-17T18:01:15.278 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-09-17T18:01:15.278 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-09-17T18:01:15.278 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-09-17T18:01:15.278 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T18:01:15.278 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T18:01:15.278 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T18:01:15.278 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-17T18:01:15.279 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T18:01:15.279 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-09-17T18:01:15.280 DEBUG:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2024-09-17T18:01:15.319 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T18:01:15.388 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T18:01:15.393 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T18:01:15.431 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T18:01:15.436 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T18:01:15.489 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-09-17T18:01:15.550 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T18:01:15.550 INFO:teuthology.orchestra.run.smithi134.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T18:01:15.550 INFO:teuthology.orchestra.run.smithi134.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T18:01:15.561 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-09-17T18:01:15.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-09-17T18:01:15.630 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T18:01:15.630 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T18:01:15.638 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T18:01:15.655 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T18:01:16.505 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-17T18:01:16.523 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T18:01:16.584 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-17T18:01:16.795 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-09-17T18:01:16.796 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-09-17T18:01:16.990 INFO:teuthology.orchestra.run.smithi087.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T18:01:16.990 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T18:01:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T18:01:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T18:01:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T18:01:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T18:01:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T18:01:16.991 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T18:01:17.023 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-17T18:01:17.033 INFO:teuthology.orchestra.run.smithi087.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T18:01:17.035 DEBUG:teuthology.orchestra.run.smithi087:> dpkg -s linux-image-generic 2024-09-17T18:01:17.041 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T18:01:17.046 INFO:teuthology.orchestra.run.smithi087.stdout:Package: linux-image-generic 2024-09-17T18:01:17.047 INFO:teuthology.orchestra.run.smithi087.stdout:Status: install ok installed 2024-09-17T18:01:17.047 INFO:teuthology.orchestra.run.smithi087.stdout:Priority: optional 2024-09-17T18:01:17.047 INFO:teuthology.orchestra.run.smithi087.stdout:Section: kernel 2024-09-17T18:01:17.047 INFO:teuthology.orchestra.run.smithi087.stdout:Installed-Size: 21 2024-09-17T18:01:17.047 INFO:teuthology.orchestra.run.smithi087.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T18:01:17.047 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: amd64 2024-09-17T18:01:17.047 INFO:teuthology.orchestra.run.smithi087.stdout:Source: linux-meta 2024-09-17T18:01:17.047 INFO:teuthology.orchestra.run.smithi087.stdout:Version: 5.15.0.122.122 2024-09-17T18:01:17.047 INFO:teuthology.orchestra.run.smithi087.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T18:01:17.047 INFO:teuthology.orchestra.run.smithi087.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T18:01:17.047 INFO:teuthology.orchestra.run.smithi087.stdout:Recommends: thermald 2024-09-17T18:01:17.047 INFO:teuthology.orchestra.run.smithi087.stdout:Description: Generic Linux kernel image 2024-09-17T18:01:17.048 INFO:teuthology.orchestra.run.smithi087.stdout: This package will always depend on the latest generic kernel image 2024-09-17T18:01:17.048 INFO:teuthology.orchestra.run.smithi087.stdout: available. 2024-09-17T18:01:17.048 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-09-17T18:01:17.090 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.55253nVlU8 2024-09-17T18:01:17.091 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub/grub.cfg /tmp/tmp.55253nVlU8 2024-09-17T18:01:17.096 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-17T18:01:17.153 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.55253nVlU8 2024-09-17T18:01:17.269 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.55253nVlU8 is 10KB 2024-09-17T18:01:17.281 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.55253nVlU8 2024-09-17T18:01:17.282 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-17T18:01:17.283 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-17T18:01:17.286 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T18:01:17.339 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:01:17.339 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T18:01:17.339 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T18:01:17.406 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T18:01:17.407 DEBUG:teuthology.orchestra.run.smithi087:> sudo update-grub 2024-09-17T18:01:17.451 INFO:teuthology.orchestra.run.smithi154.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T18:01:17.452 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T18:01:17.452 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T18:01:17.452 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T18:01:17.452 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T18:01:17.452 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T18:01:17.453 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T18:01:17.453 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T18:01:17.490 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T18:01:17.492 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-09-17T18:01:17.550 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-09-17T18:01:17.550 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-09-17T18:01:17.550 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-09-17T18:01:17.550 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-09-17T18:01:17.550 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 21 2024-09-17T18:01:17.550 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T18:01:17.550 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-09-17T18:01:17.550 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-09-17T18:01:17.550 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.122.122 2024-09-17T18:01:17.550 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T18:01:17.551 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T18:01:17.551 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-09-17T18:01:17.551 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-09-17T18:01:17.551 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-09-17T18:01:17.551 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-09-17T18:01:17.551 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-09-17T18:01:17.594 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.io2NmWm8f2 2024-09-17T18:01:17.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub/grub.cfg /tmp/tmp.io2NmWm8f2 2024-09-17T18:01:17.658 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.io2NmWm8f2 2024-09-17T18:01:17.772 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.io2NmWm8f2 is 10KB 2024-09-17T18:01:17.785 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.io2NmWm8f2 2024-09-17T18:01:17.793 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T18:01:17.846 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:01:17.847 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T18:01:17.847 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T18:01:17.915 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T18:01:17.916 DEBUG:teuthology.orchestra.run.smithi154:> sudo update-grub 2024-09-17T18:01:18.707 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub' 2024-09-17T18:01:18.708 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T18:01:18.710 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-09-17T18:01:18.892 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T18:01:18.899 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T18:01:19.135 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T18:01:19.140 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T18:01:19.155 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub' 2024-09-17T18:01:19.156 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T18:01:19.159 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2024-09-17T18:01:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T18:01:19.188 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T18:01:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T18:01:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T18:01:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T18:01:19.336 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-09-17T18:01:19.344 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T18:01:19.348 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2024-09-17T18:01:19.350 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T18:01:19.578 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T18:01:19.584 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T18:01:19.626 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T18:01:19.632 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T18:01:19.747 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T18:01:19.747 INFO:teuthology.orchestra.run.smithi154.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T18:01:19.747 INFO:teuthology.orchestra.run.smithi154.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T18:01:19.765 INFO:teuthology.orchestra.run.smithi154.stderr:done 2024-09-17T18:01:19.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2024-09-17T18:01:45.305 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-17T18:01:45.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-17T18:01:45.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:01:45.565 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-17T18:01:45.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-17T18:01:45.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:01:49.353 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-17T18:01:49.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-17T18:01:49.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:01:49.777 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-17T18:01:49.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T18:01:49.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:02:03.713 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-09-17T18:02:03.969 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-17T18:02:07.805 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-09-17T18:02:08.317 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-17T18:02:12.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-17T18:02:12.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:02:12.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-17T18:02:12.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:02:15.777 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-09-17T18:02:16.029 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-17T18:02:16.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-17T18:02:16.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:02:17.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T18:02:17.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:02:19.869 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-09-17T18:02:20.385 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-17T18:02:27.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-17T18:02:27.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:02:28.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-17T18:02:28.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:02:31.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-17T18:02:31.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:02:32.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T18:02:32.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:02:50.305 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-09-17T18:02:59.261 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-09-17T18:02:59.781 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-17T18:03:00.345 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-17T18:03:00.345 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-122-generic"... 2024-09-17T18:03:00.345 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-17T18:03:00.390 INFO:teuthology.orchestra.run.smithi134.stdout:5.15.0-122-generic 2024-09-17T18:03:00.391 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T18:03:00.391 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T18:03:00.391 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T18:03:01.392 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-17T18:03:01.392 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T18:03:01.458 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-09-17T18:03:01.496 DEBUG:teuthology.parallel:result is None 2024-09-17T18:03:05.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-17T18:03:05.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:03:05.544 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-09-17T18:03:06.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-17T18:03:06.157 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-17T18:03:06.158 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-09-17T18:03:06.202 INFO:teuthology.orchestra.run.smithi087.stdout:5.15.0-122-generic 2024-09-17T18:03:06.203 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T18:03:06.203 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T18:03:06.203 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T18:03:07.204 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-17T18:03:07.204 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T18:03:07.597 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2024-09-17T18:03:07.625 DEBUG:teuthology.parallel:result is None 2024-09-17T18:03:14.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-17T18:03:14.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:03:14.469 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-09-17T18:03:15.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-17T18:03:15.021 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.15.0-122-generic"... 2024-09-17T18:03:15.021 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-09-17T18:03:15.069 INFO:teuthology.orchestra.run.smithi146.stdout:5.15.0-122-generic 2024-09-17T18:03:15.069 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T18:03:15.069 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T18:03:15.069 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T18:03:16.070 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-17T18:03:16.070 DEBUG:teuthology.orchestra.run.smithi146:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T18:03:16.150 INFO:teuthology.orchestra.run.smithi146.stdout:ttyS1 2024-09-17T18:03:16.178 DEBUG:teuthology.parallel:result is None 2024-09-17T18:03:32.389 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T18:03:47.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T18:03:47.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:03:47.620 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-17T18:03:48.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T18:03:48.241 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-122-generic"... 2024-09-17T18:03:48.241 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-17T18:03:48.287 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-122-generic 2024-09-17T18:03:48.288 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T18:03:48.288 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T18:03:48.288 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T18:03:49.288 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-17T18:03:49.288 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T18:03:49.668 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2024-09-17T18:03:49.694 DEBUG:teuthology.parallel:result is None 2024-09-17T18:03:49.694 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T18:03:49.702 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T18:03:49.702 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T18:03:49.704 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T18:03:49.707 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T18:03:49.710 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T18:03:49.716 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T18:03:49.745 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T18:03:49.779 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T18:03:49.779 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T18:03:49.782 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T18:03:49.784 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T18:03:49.787 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T18:03:49.891 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T18:03:49.897 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T18:03:49.898 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T18:03:49.900 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T18:03:49.902 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T18:03:49.905 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T18:03:49.922 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T18:03:49.923 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T18:03:49.930 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T18:03:49.931 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T18:03:49.932 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T18:03:49.933 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T18:03:49.939 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T18:03:49.939 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T18:03:49.941 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T18:03:49.948 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T18:03:49.948 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T18:03:49.983 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T18:03:49.985 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T18:03:49.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T18:03:50.000 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T18:03:50.009 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T18:03:50.009 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T18:03:50.039 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T18:03:50.041 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T18:03:50.044 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T18:03:50.050 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T18:03:50.090 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T18:03:50.138 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:03:50.138 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T18:03:50.197 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T18:03:50.203 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T18:03:50.250 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:03:50.250 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T18:03:50.313 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T18:03:50.319 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T18:03:50.365 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:03:50.365 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T18:03:50.433 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T18:03:50.440 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T18:03:50.488 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:03:50.488 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T18:03:50.562 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-09-17T18:03:50.565 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-09-17T18:03:50.567 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2024-09-17T18:03:50.569 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-09-17T18:03:50.639 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T18:03:50.646 INFO:teuthology.task.internal:Starting timer... 2024-09-17T18:03:50.646 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T18:03:50.683 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T18:03:50.715 DEBUG:teuthology.task.selinux:Excluding smithi087: OS 'ubuntu' does not support SELinux 2024-09-17T18:03:50.716 DEBUG:teuthology.task.selinux:Excluding smithi134: OS 'ubuntu' does not support SELinux 2024-09-17T18:03:50.716 DEBUG:teuthology.task.selinux:Excluding smithi146: OS 'ubuntu' does not support SELinux 2024-09-17T18:03:50.716 DEBUG:teuthology.task.selinux:Excluding smithi154: OS 'ubuntu' does not support SELinux 2024-09-17T18:03:50.716 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T18:03:50.716 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-17T18:03:50.716 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T18:03:50.716 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T18:03:50.750 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-17T18:03:50.753 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-17T18:03:50.879 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T18:03:50.890 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T18:03:50.891 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi087.front.sepia.ceph.com,smithi134.front.sepia.ceph.com,smithi146.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T18:11:31.056 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com'), Remote(name='ubuntu@smithi146.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2024-09-17T18:11:31.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-17T18:11:31.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:11:31.142 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-09-17T18:11:31.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-17T18:11:31.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-17T18:11:31.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:11:31.299 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-17T18:11:31.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-17T18:11:31.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-17T18:11:31.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:11:31.462 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-09-17T18:11:31.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-17T18:11:31.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T18:11:31.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T18:11:31.622 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-17T18:11:31.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T18:11:31.698 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T18:11:31.708 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T18:11:31.709 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T18:11:31.709 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T18:11:31.712 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T18:11:31.712 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T18:11:31.714 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T18:11:31.714 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T18:11:31.717 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T18:11:31.717 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T18:11:31.743 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T18:11:31.743 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: Command line: ntpd -gq 2024-09-17T18:11:31.743 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: ---------------------------------------------------- 2024-09-17T18:11:31.743 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T18:11:31.743 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T18:11:31.743 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: corporation. Support and training for ntp-4 are 2024-09-17T18:11:31.744 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: available at https://www.nwtime.org/support 2024-09-17T18:11:31.744 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: ---------------------------------------------------- 2024-09-17T18:11:31.744 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: proto: precision = 0.061 usec (-24) 2024-09-17T18:11:31.744 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: basedate set to 2022-02-04 2024-09-17T18:11:31.744 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: gps base set to 2022-02-06 (week 2196) 2024-09-17T18:11:31.744 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T18:11:31.744 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: Command line: ntpd -gq 2024-09-17T18:11:31.744 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: ---------------------------------------------------- 2024-09-17T18:11:31.744 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T18:11:31.744 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T18:11:31.745 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: corporation. Support and training for ntp-4 are 2024-09-17T18:11:31.745 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: available at https://www.nwtime.org/support 2024-09-17T18:11:31.745 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: ---------------------------------------------------- 2024-09-17T18:11:31.745 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: proto: precision = 0.061 usec (-24) 2024-09-17T18:11:31.745 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: basedate set to 2022-02-04 2024-09-17T18:11:31.745 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: gps base set to 2022-02-06 (week 2196) 2024-09-17T18:11:31.745 INFO:teuthology.orchestra.run.smithi087.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T18:11:31.745 INFO:teuthology.orchestra.run.smithi134.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T18:11:31.746 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T18:11:31.746 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T18:11:31.746 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T18:11:31.746 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T18:11:31.746 INFO:teuthology.orchestra.run.smithi087.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T18:11:31.747 INFO:teuthology.orchestra.run.smithi134.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T18:11:31.749 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T18:11:31.749 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T18:11:31.749 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T18:11:31.749 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: Listen normally on 3 enp3s0f1 172.21.15.87:123 2024-09-17T18:11:31.749 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: Listen normally on 4 lo [::1]:123 2024-09-17T18:11:31.749 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5f5%5]:123 2024-09-17T18:11:31.749 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:31 ntpd[18508]: Listening on routing socket on fd #22 for interface updates 2024-09-17T18:11:31.750 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T18:11:31.750 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T18:11:31.750 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T18:11:31.750 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: Listen normally on 3 enp3s0f1 172.21.15.134:123 2024-09-17T18:11:31.750 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: Listen normally on 4 lo [::1]:123 2024-09-17T18:11:31.750 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de9%5]:123 2024-09-17T18:11:31.750 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:31 ntpd[18543]: Listening on routing socket on fd #22 for interface updates 2024-09-17T18:11:31.750 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T18:11:31.750 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: Command line: ntpd -gq 2024-09-17T18:11:31.751 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: ---------------------------------------------------- 2024-09-17T18:11:31.751 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T18:11:31.751 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T18:11:31.751 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: corporation. Support and training for ntp-4 are 2024-09-17T18:11:31.751 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: available at https://www.nwtime.org/support 2024-09-17T18:11:31.751 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: ---------------------------------------------------- 2024-09-17T18:11:31.751 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: proto: precision = 0.061 usec (-24) 2024-09-17T18:11:31.751 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: basedate set to 2022-02-04 2024-09-17T18:11:31.751 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: gps base set to 2022-02-06 (week 2196) 2024-09-17T18:11:31.751 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T18:11:31.751 INFO:teuthology.orchestra.run.smithi146.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T18:11:31.752 INFO:teuthology.orchestra.run.smithi146.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T18:11:31.752 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T18:11:31.753 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T18:11:31.753 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T18:11:31.753 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T18:11:31.753 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: Listen normally on 3 enp3s0f1 172.21.15.146:123 2024-09-17T18:11:31.753 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: Listen normally on 4 lo [::1]:123 2024-09-17T18:11:31.753 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:76fd%5]:123 2024-09-17T18:11:31.753 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:31 ntpd[18507]: Listening on routing socket on fd #22 for interface updates 2024-09-17T18:11:31.767 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T18:11:31.767 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: Command line: ntpd -gq 2024-09-17T18:11:31.767 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: ---------------------------------------------------- 2024-09-17T18:11:31.768 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T18:11:31.768 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T18:11:31.768 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: corporation. Support and training for ntp-4 are 2024-09-17T18:11:31.768 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: available at https://www.nwtime.org/support 2024-09-17T18:11:31.768 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: ---------------------------------------------------- 2024-09-17T18:11:31.768 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: proto: precision = 0.061 usec (-24) 2024-09-17T18:11:31.769 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: basedate set to 2022-02-04 2024-09-17T18:11:31.769 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: gps base set to 2022-02-06 (week 2196) 2024-09-17T18:11:31.769 INFO:teuthology.orchestra.run.smithi154.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T18:11:31.769 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T18:11:31.770 INFO:teuthology.orchestra.run.smithi154.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T18:11:31.770 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T18:11:31.771 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T18:11:31.771 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T18:11:31.771 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T18:11:31.771 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: Listen normally on 3 enp3s0f1 172.21.15.154:123 2024-09-17T18:11:31.771 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: Listen normally on 4 lo [::1]:123 2024-09-17T18:11:31.771 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7761%5]:123 2024-09-17T18:11:31.771 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:31 ntpd[18485]: Listening on routing socket on fd #22 for interface updates 2024-09-17T18:11:32.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:32 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:32.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:32 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:32.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:32 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:32.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:32 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:32.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:32 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:32.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:32 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:32.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:32 ntpd[18508]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:32.743 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:32 ntpd[18508]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:32.744 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:32 ntpd[18507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:32.744 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:32 ntpd[18507]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:32.744 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:32 ntpd[18507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:32 ntpd[18507]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:32 ntpd[18507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:32 ntpd[18507]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:32 ntpd[18507]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:32 ntpd[18507]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:32.768 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:32.768 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:32 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:33.742 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:33 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:33.742 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:33 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:33.742 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:33 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:33.742 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:33 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:33.742 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:33 ntpd[18543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:33.742 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:33 ntpd[18543]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:33.768 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:33 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:33.768 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:33 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:34 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:34 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:34 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:34 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:34 ntpd[18508]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:34.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:34 ntpd[18508]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:34.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:34 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:34.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:34 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:34.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:34 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:34.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:34 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:34.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:34 ntpd[18543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:34.744 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:34 ntpd[18543]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:34.744 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:34 ntpd[18507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:34.744 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:34 ntpd[18507]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:34.745 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:34 ntpd[18507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:34.745 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:34 ntpd[18507]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:34.745 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:34 ntpd[18507]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:34.745 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:34 ntpd[18507]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:34 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:35.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:35 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:35.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:35 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:35.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:35 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:35.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:35 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:35.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:35 ntpd[18508]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:35.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:35 ntpd[18508]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:35.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:35 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:35.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:35 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:35.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:35 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:35.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:35 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:35.744 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:35 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:35.744 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:35 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:35.744 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:35 ntpd[18543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:35.744 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:35 ntpd[18543]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:36.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:36 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:36 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:36 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:36 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:36 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:36 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:36 ntpd[18508]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:36 ntpd[18508]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:36 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:36 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:36 ntpd[18508]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:36 ntpd[18508]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:36.746 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:36 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.746 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:36 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.746 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:36 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.746 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:36 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.747 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:36 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.747 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:36 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.747 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:36 ntpd[18543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:36.747 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:36 ntpd[18543]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:36.747 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:36 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.747 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:36 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.747 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:36 ntpd[18543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:36.747 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:36 ntpd[18543]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:36.747 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.747 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.747 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.749 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:36.749 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:36 ntpd[18507]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:36.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:36.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:36.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.770 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:36.771 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:36.771 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:36.771 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:36.771 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:36.771 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:36 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:37.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:37 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:37.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:37 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:37.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:37 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:37.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:37 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:37.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:37 ntpd[18508]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:37.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:37 ntpd[18508]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:37.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:37 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:37.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:37 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:37.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:37 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:37.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:37 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:37.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:37 ntpd[18543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:37.744 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:37 ntpd[18543]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:38.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:38 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:38.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:38 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:38.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:38 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:38.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:38 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:38.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:38 ntpd[18508]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:38.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:38 ntpd[18508]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:38.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:38 ntpd[18508]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:38.742 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:38 ntpd[18508]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:38.743 INFO:teuthology.orchestra.run.smithi087.stdout:17 Sep 18:11:38 ntpd[18508]: ntpd: time slew -0.000896 s 2024-09-17T18:11:38.743 INFO:teuthology.orchestra.run.smithi087.stdout:ntpd: time slew -0.000896s 2024-09-17T18:11:38.743 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:38 ntpd[18508]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T18:11:38.743 INFO:teuthology.orchestra.run.smithi087.stderr:17 Sep 18:11:38 ntpd[18508]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T18:11:38.744 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:38 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:38.745 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:38 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:38.745 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:38 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:38.745 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:38 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:38.745 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:38 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:38.745 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:38 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:38.745 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:38 ntpd[18543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:38.745 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:38 ntpd[18543]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:38.745 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:38 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:38.745 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:38 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:38.746 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:38 ntpd[18543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:38.746 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:38 ntpd[18543]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:38 ntpd[18507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:38 ntpd[18507]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:38 ntpd[18507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:38 ntpd[18507]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:38 ntpd[18507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:38 ntpd[18507]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:38 ntpd[18507]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:38 ntpd[18507]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:38 ntpd[18507]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:38 ntpd[18507]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:38.748 INFO:teuthology.orchestra.run.smithi146.stdout:17 Sep 18:11:38 ntpd[18507]: ntpd: time slew +0.000396 s 2024-09-17T18:11:38.748 INFO:teuthology.orchestra.run.smithi146.stdout:ntpd: time slew +0.000396s 2024-09-17T18:11:38.748 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:38 ntpd[18507]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T18:11:38.748 INFO:teuthology.orchestra.run.smithi146.stderr:17 Sep 18:11:38 ntpd[18507]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T18:11:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:38 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:38 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:38 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:38 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:38 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:38 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:38 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:38 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:38.772 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:38 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:38.772 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:38 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:38.772 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 18:11:38 ntpd[18485]: ntpd: time slew +0.000647 s 2024-09-17T18:11:38.772 INFO:teuthology.orchestra.run.smithi154.stdout:ntpd: time slew +0.000647s 2024-09-17T18:11:38.773 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:38 ntpd[18485]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T18:11:38.773 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 18:11:38 ntpd[18485]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T18:11:38.791 INFO:teuthology.orchestra.run.smithi146.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T18:11:38.791 INFO:teuthology.orchestra.run.smithi146.stdout:============================================================================== 2024-09-17T18:11:38.791 INFO:teuthology.orchestra.run.smithi146.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:38.791 INFO:teuthology.orchestra.run.smithi146.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:38.791 INFO:teuthology.orchestra.run.smithi146.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:38.791 INFO:teuthology.orchestra.run.smithi146.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:38.797 INFO:teuthology.orchestra.run.smithi087.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T18:11:38.797 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================== 2024-09-17T18:11:38.797 INFO:teuthology.orchestra.run.smithi087.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:38.797 INFO:teuthology.orchestra.run.smithi087.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:38.797 INFO:teuthology.orchestra.run.smithi087.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:38.797 INFO:teuthology.orchestra.run.smithi087.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:38.824 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T18:11:38.824 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-09-17T18:11:38.824 INFO:teuthology.orchestra.run.smithi154.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:38.824 INFO:teuthology.orchestra.run.smithi154.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:38.824 INFO:teuthology.orchestra.run.smithi154.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:38.824 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:39.742 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:39 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:39.742 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:39 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:39.742 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:39 ntpd[18543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T18:11:39.742 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:39 ntpd[18543]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T18:11:39.742 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:39 ntpd[18543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T18:11:39.742 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:39 ntpd[18543]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T18:11:39.743 INFO:teuthology.orchestra.run.smithi134.stdout:17 Sep 18:11:39 ntpd[18543]: ntpd: time slew -0.000343 s 2024-09-17T18:11:39.743 INFO:teuthology.orchestra.run.smithi134.stdout:ntpd: time slew -0.000343s 2024-09-17T18:11:39.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:39 ntpd[18543]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T18:11:39.743 INFO:teuthology.orchestra.run.smithi134.stderr:17 Sep 18:11:39 ntpd[18543]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T18:11:39.794 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T18:11:39.795 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-09-17T18:11:39.795 INFO:teuthology.orchestra.run.smithi134.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:39.795 INFO:teuthology.orchestra.run.smithi134.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:39.795 INFO:teuthology.orchestra.run.smithi134.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:39.795 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:11:39.796 INFO:teuthology.run_tasks:Running task install... 2024-09-17T18:11:39.804 DEBUG:teuthology.task.install:project ceph 2024-09-17T18:11:39.805 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}} 2024-09-17T18:11:39.805 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'} 2024-09-17T18:11:39.805 INFO:teuthology.task.install:Using flavor: default 2024-09-17T18:11:39.810 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T18:11:39.810 INFO:teuthology.task.install:extra packages: [] 2024-09-17T18:11:39.811 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-key list | grep Ceph 2024-09-17T18:11:39.811 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-key list | grep Ceph 2024-09-17T18:11:39.812 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-key list | grep Ceph 2024-09-17T18:11:39.812 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-key list | grep Ceph 2024-09-17T18:11:39.873 INFO:teuthology.orchestra.run.smithi146.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T18:11:39.873 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T18:11:39.874 INFO:teuthology.orchestra.run.smithi087.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T18:11:39.900 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T18:11:39.902 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T18:11:39.902 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T18:11:39.904 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T18:11:39.904 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T18:11:39.905 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-17T18:11:39.905 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T18:11:39.909 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-17T18:11:39.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T18:11:39.916 INFO:teuthology.orchestra.run.smithi146.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T18:11:39.916 INFO:teuthology.orchestra.run.smithi146.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T18:11:39.916 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-17T18:11:39.916 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T18:11:39.927 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T18:11:39.927 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T18:11:39.928 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-17T18:11:39.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T18:11:40.061 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default/ 2024-09-17T18:11:40.062 INFO:teuthology.task.install.deb:Package version is 19.3.0-4975-g1889a165-1jammy 2024-09-17T18:11:40.066 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default/ 2024-09-17T18:11:40.066 INFO:teuthology.task.install.deb:Package version is 19.3.0-4975-g1889a165-1jammy 2024-09-17T18:11:40.070 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default/ 2024-09-17T18:11:40.070 INFO:teuthology.task.install.deb:Package version is 19.3.0-4975-g1889a165-1jammy 2024-09-17T18:11:40.074 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default/ 2024-09-17T18:11:40.074 INFO:teuthology.task.install.deb:Package version is 19.3.0-4975-g1889a165-1jammy 2024-09-17T18:11:40.174 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:11:40.174 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T18:11:40.179 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:11:40.180 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T18:11:40.190 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-09-17T18:11:40.191 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:11:40.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T18:11:40.193 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get update 2024-09-17T18:11:40.197 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:11:40.197 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T18:11:40.205 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-09-17T18:11:40.211 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2024-09-17T18:11:40.355 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T18:11:40.373 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T18:11:40.374 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T18:11:40.374 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T18:11:40.379 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T18:11:40.383 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T18:11:40.390 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T18:11:40.400 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T18:11:40.408 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T18:11:40.411 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T18:11:40.419 INFO:teuthology.orchestra.run.smithi146.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T18:11:40.430 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T18:11:40.432 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-17T18:11:40.435 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T18:11:40.441 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-17T18:11:40.451 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-17T18:11:40.454 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T18:11:40.455 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-17T18:11:40.463 INFO:teuthology.orchestra.run.smithi146.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T18:11:40.473 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T18:11:40.475 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-17T18:11:40.477 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T18:11:40.484 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-17T18:11:40.491 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T18:11:40.494 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-17T18:11:40.495 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T18:11:40.498 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-09-17T18:11:40.500 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T18:11:40.503 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-09-17T18:11:40.513 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-09-17T18:11:40.521 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-09-17T18:11:40.525 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-17T18:11:40.578 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T18:11:40.579 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T18:11:40.659 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T18:11:40.659 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T18:11:40.693 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T18:11:40.745 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 28.6 kB in 0s (78.7 kB/s) 2024-09-17T18:11:40.803 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 28.6 kB in 0s (69.7 kB/s) 2024-09-17T18:11:40.807 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 28.6 kB in 0s (65.8 kB/s) 2024-09-17T18:11:41.779 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-17T18:11:41.797 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4975-g1889a165-1jammy cephadm=19.3.0-4975-g1889a165-1jammy ceph-mds=19.3.0-4975-g1889a165-1jammy ceph-mgr=19.3.0-4975-g1889a165-1jammy ceph-common=19.3.0-4975-g1889a165-1jammy ceph-fuse=19.3.0-4975-g1889a165-1jammy ceph-test=19.3.0-4975-g1889a165-1jammy ceph-volume=19.3.0-4975-g1889a165-1jammy radosgw=19.3.0-4975-g1889a165-1jammy python3-rados=19.3.0-4975-g1889a165-1jammy python3-rgw=19.3.0-4975-g1889a165-1jammy python3-cephfs=19.3.0-4975-g1889a165-1jammy python3-rbd=19.3.0-4975-g1889a165-1jammy libcephfs2=19.3.0-4975-g1889a165-1jammy libcephfs-dev=19.3.0-4975-g1889a165-1jammy librados2=19.3.0-4975-g1889a165-1jammy librbd1=19.3.0-4975-g1889a165-1jammy rbd-fuse=19.3.0-4975-g1889a165-1jammy 2024-09-17T18:11:41.812 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2024-09-17T18:11:41.828 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4975-g1889a165-1jammy cephadm=19.3.0-4975-g1889a165-1jammy ceph-mds=19.3.0-4975-g1889a165-1jammy ceph-mgr=19.3.0-4975-g1889a165-1jammy ceph-common=19.3.0-4975-g1889a165-1jammy ceph-fuse=19.3.0-4975-g1889a165-1jammy ceph-test=19.3.0-4975-g1889a165-1jammy ceph-volume=19.3.0-4975-g1889a165-1jammy radosgw=19.3.0-4975-g1889a165-1jammy python3-rados=19.3.0-4975-g1889a165-1jammy python3-rgw=19.3.0-4975-g1889a165-1jammy python3-cephfs=19.3.0-4975-g1889a165-1jammy python3-rbd=19.3.0-4975-g1889a165-1jammy libcephfs2=19.3.0-4975-g1889a165-1jammy libcephfs-dev=19.3.0-4975-g1889a165-1jammy librados2=19.3.0-4975-g1889a165-1jammy librbd1=19.3.0-4975-g1889a165-1jammy rbd-fuse=19.3.0-4975-g1889a165-1jammy 2024-09-17T18:11:41.829 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-17T18:11:41.846 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4975-g1889a165-1jammy cephadm=19.3.0-4975-g1889a165-1jammy ceph-mds=19.3.0-4975-g1889a165-1jammy ceph-mgr=19.3.0-4975-g1889a165-1jammy ceph-common=19.3.0-4975-g1889a165-1jammy ceph-fuse=19.3.0-4975-g1889a165-1jammy ceph-test=19.3.0-4975-g1889a165-1jammy ceph-volume=19.3.0-4975-g1889a165-1jammy radosgw=19.3.0-4975-g1889a165-1jammy python3-rados=19.3.0-4975-g1889a165-1jammy python3-rgw=19.3.0-4975-g1889a165-1jammy python3-cephfs=19.3.0-4975-g1889a165-1jammy python3-rbd=19.3.0-4975-g1889a165-1jammy libcephfs2=19.3.0-4975-g1889a165-1jammy libcephfs-dev=19.3.0-4975-g1889a165-1jammy librados2=19.3.0-4975-g1889a165-1jammy librbd1=19.3.0-4975-g1889a165-1jammy rbd-fuse=19.3.0-4975-g1889a165-1jammy 2024-09-17T18:11:41.862 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-17T18:11:41.892 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2024-09-17T18:11:41.900 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-17T18:11:42.073 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-09-17T18:11:42.074 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-09-17T18:11:42.085 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-17T18:11:42.086 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-17T18:11:42.103 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2024-09-17T18:11:42.104 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2024-09-17T18:11:42.273 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T18:11:42.273 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T18:11:42.273 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T18:11:42.273 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T18:11:42.274 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T18:11:42.274 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T18:11:42.274 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T18:11:42.275 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-09-17T18:11:42.275 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T18:11:42.275 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T18:11:42.275 INFO:teuthology.orchestra.run.smithi154.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T18:11:42.275 INFO:teuthology.orchestra.run.smithi154.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-17T18:11:42.275 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-17T18:11:42.276 INFO:teuthology.orchestra.run.smithi154.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-17T18:11:42.276 INFO:teuthology.orchestra.run.smithi154.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T18:11:42.276 INFO:teuthology.orchestra.run.smithi154.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T18:11:42.277 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-17T18:11:42.277 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-17T18:11:42.277 INFO:teuthology.orchestra.run.smithi154.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-17T18:11:42.277 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-17T18:11:42.277 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-17T18:11:42.277 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-17T18:11:42.277 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-17T18:11:42.277 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-17T18:11:42.277 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-17T18:11:42.277 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-17T18:11:42.277 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T18:11:42.277 INFO:teuthology.orchestra.run.smithi154.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T18:11:42.277 INFO:teuthology.orchestra.run.smithi154.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T18:11:42.278 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T18:11:42.278 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-17T18:11:42.278 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet zip 2024-09-17T18:11:42.278 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-09-17T18:11:42.278 INFO:teuthology.orchestra.run.smithi154.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T18:11:42.278 INFO:teuthology.orchestra.run.smithi154.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T18:11:42.278 INFO:teuthology.orchestra.run.smithi154.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T18:11:42.278 INFO:teuthology.orchestra.run.smithi154.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T18:11:42.278 INFO:teuthology.orchestra.run.smithi154.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T18:11:42.279 INFO:teuthology.orchestra.run.smithi154.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T18:11:42.279 INFO:teuthology.orchestra.run.smithi154.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T18:11:42.279 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-09-17T18:11:42.279 INFO:teuthology.orchestra.run.smithi154.stdout: btrfs-tools 2024-09-17T18:11:42.283 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T18:11:42.283 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T18:11:42.283 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T18:11:42.283 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T18:11:42.283 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T18:11:42.283 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T18:11:42.284 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T18:11:42.284 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-09-17T18:11:42.285 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T18:11:42.285 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T18:11:42.286 INFO:teuthology.orchestra.run.smithi134.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T18:11:42.286 INFO:teuthology.orchestra.run.smithi134.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-17T18:11:42.286 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-17T18:11:42.286 INFO:teuthology.orchestra.run.smithi134.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-17T18:11:42.286 INFO:teuthology.orchestra.run.smithi134.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T18:11:42.286 INFO:teuthology.orchestra.run.smithi134.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T18:11:42.286 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-17T18:11:42.286 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-17T18:11:42.287 INFO:teuthology.orchestra.run.smithi134.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-17T18:11:42.287 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-17T18:11:42.287 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-17T18:11:42.287 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-17T18:11:42.287 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-17T18:11:42.287 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-17T18:11:42.287 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-17T18:11:42.287 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-17T18:11:42.287 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T18:11:42.287 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T18:11:42.287 INFO:teuthology.orchestra.run.smithi134.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T18:11:42.287 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T18:11:42.287 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-17T18:11:42.288 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet zip 2024-09-17T18:11:42.288 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-09-17T18:11:42.288 INFO:teuthology.orchestra.run.smithi134.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T18:11:42.288 INFO:teuthology.orchestra.run.smithi134.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T18:11:42.288 INFO:teuthology.orchestra.run.smithi134.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T18:11:42.288 INFO:teuthology.orchestra.run.smithi134.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T18:11:42.288 INFO:teuthology.orchestra.run.smithi134.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T18:11:42.288 INFO:teuthology.orchestra.run.smithi134.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T18:11:42.288 INFO:teuthology.orchestra.run.smithi134.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T18:11:42.289 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-09-17T18:11:42.289 INFO:teuthology.orchestra.run.smithi134.stdout: btrfs-tools 2024-09-17T18:11:42.312 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T18:11:42.312 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T18:11:42.312 INFO:teuthology.orchestra.run.smithi146.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T18:11:42.312 INFO:teuthology.orchestra.run.smithi146.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T18:11:42.312 INFO:teuthology.orchestra.run.smithi146.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T18:11:42.312 INFO:teuthology.orchestra.run.smithi146.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T18:11:42.312 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T18:11:42.313 INFO:teuthology.orchestra.run.smithi146.stdout:The following additional packages will be installed: 2024-09-17T18:11:42.313 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T18:11:42.313 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T18:11:42.313 INFO:teuthology.orchestra.run.smithi146.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T18:11:42.313 INFO:teuthology.orchestra.run.smithi146.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-17T18:11:42.313 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-17T18:11:42.314 INFO:teuthology.orchestra.run.smithi146.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-17T18:11:42.314 INFO:teuthology.orchestra.run.smithi146.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T18:11:42.314 INFO:teuthology.orchestra.run.smithi146.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T18:11:42.314 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-17T18:11:42.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-17T18:11:42.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-17T18:11:42.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-17T18:11:42.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-17T18:11:42.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-17T18:11:42.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-17T18:11:42.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-17T18:11:42.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-17T18:11:42.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-17T18:11:42.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T18:11:42.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T18:11:42.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T18:11:42.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T18:11:42.316 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-17T18:11:42.316 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet zip 2024-09-17T18:11:42.316 INFO:teuthology.orchestra.run.smithi146.stdout:Suggested packages: 2024-09-17T18:11:42.316 INFO:teuthology.orchestra.run.smithi146.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T18:11:42.316 INFO:teuthology.orchestra.run.smithi146.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T18:11:42.316 INFO:teuthology.orchestra.run.smithi146.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T18:11:42.316 INFO:teuthology.orchestra.run.smithi146.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T18:11:42.316 INFO:teuthology.orchestra.run.smithi146.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T18:11:42.316 INFO:teuthology.orchestra.run.smithi146.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T18:11:42.317 INFO:teuthology.orchestra.run.smithi146.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T18:11:42.317 INFO:teuthology.orchestra.run.smithi146.stdout:Recommended packages: 2024-09-17T18:11:42.317 INFO:teuthology.orchestra.run.smithi146.stdout: btrfs-tools 2024-09-17T18:11:42.379 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-09-17T18:11:42.379 INFO:teuthology.orchestra.run.smithi154.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T18:11:42.379 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T18:11:42.379 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-17T18:11:42.380 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-17T18:11:42.380 INFO:teuthology.orchestra.run.smithi154.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-17T18:11:42.380 INFO:teuthology.orchestra.run.smithi154.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-17T18:11:42.381 INFO:teuthology.orchestra.run.smithi154.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-17T18:11:42.381 INFO:teuthology.orchestra.run.smithi154.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-17T18:11:42.381 INFO:teuthology.orchestra.run.smithi154.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-17T18:11:42.381 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-17T18:11:42.381 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-17T18:11:42.382 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T18:11:42.382 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T18:11:42.382 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T18:11:42.382 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T18:11:42.382 INFO:teuthology.orchestra.run.smithi154.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T18:11:42.382 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T18:11:42.382 INFO:teuthology.orchestra.run.smithi154.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T18:11:42.382 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-17T18:11:42.382 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-17T18:11:42.382 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-17T18:11:42.382 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-17T18:11:42.382 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-17T18:11:42.382 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-17T18:11:42.383 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-17T18:11:42.383 INFO:teuthology.orchestra.run.smithi154.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-17T18:11:42.390 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-09-17T18:11:42.390 INFO:teuthology.orchestra.run.smithi134.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T18:11:42.390 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T18:11:42.390 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-17T18:11:42.392 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-17T18:11:42.392 INFO:teuthology.orchestra.run.smithi134.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-17T18:11:42.392 INFO:teuthology.orchestra.run.smithi134.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-17T18:11:42.392 INFO:teuthology.orchestra.run.smithi134.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-17T18:11:42.392 INFO:teuthology.orchestra.run.smithi134.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-17T18:11:42.392 INFO:teuthology.orchestra.run.smithi134.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-17T18:11:42.392 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-17T18:11:42.392 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-17T18:11:42.392 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T18:11:42.392 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T18:11:42.392 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T18:11:42.392 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T18:11:42.393 INFO:teuthology.orchestra.run.smithi134.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T18:11:42.393 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T18:11:42.393 INFO:teuthology.orchestra.run.smithi134.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T18:11:42.393 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-17T18:11:42.393 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-17T18:11:42.393 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-17T18:11:42.393 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-17T18:11:42.393 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-17T18:11:42.393 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-17T18:11:42.393 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-17T18:11:42.393 INFO:teuthology.orchestra.run.smithi134.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-17T18:11:42.422 INFO:teuthology.orchestra.run.smithi146.stdout:The following NEW packages will be installed: 2024-09-17T18:11:42.422 INFO:teuthology.orchestra.run.smithi146.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T18:11:42.422 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T18:11:42.423 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-17T18:11:42.423 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-17T18:11:42.423 INFO:teuthology.orchestra.run.smithi146.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-17T18:11:42.423 INFO:teuthology.orchestra.run.smithi146.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-17T18:11:42.423 INFO:teuthology.orchestra.run.smithi146.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-17T18:11:42.423 INFO:teuthology.orchestra.run.smithi146.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-17T18:11:42.423 INFO:teuthology.orchestra.run.smithi146.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-17T18:11:42.423 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-17T18:11:42.423 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-17T18:11:42.423 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T18:11:42.423 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T18:11:42.423 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T18:11:42.424 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T18:11:42.424 INFO:teuthology.orchestra.run.smithi146.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T18:11:42.424 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T18:11:42.424 INFO:teuthology.orchestra.run.smithi146.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T18:11:42.424 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-17T18:11:42.424 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-17T18:11:42.424 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-17T18:11:42.424 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-17T18:11:42.424 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-17T18:11:42.424 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-17T18:11:42.424 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-17T18:11:42.425 INFO:teuthology.orchestra.run.smithi146.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-17T18:11:42.451 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T18:11:42.451 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 244 MB of archives. 2024-09-17T18:11:42.451 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 909 MB of additional disk space will be used. 2024-09-17T18:11:42.451 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T18:11:42.524 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T18:11:42.524 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 244 MB of archives. 2024-09-17T18:11:42.525 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 909 MB of additional disk space will be used. 2024-09-17T18:11:42.525 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4975-g1889a165-1jammy [3,624 kB] 2024-09-17T18:11:42.535 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4975-g1889a165-1jammy [3,624 kB] 2024-09-17T18:11:42.540 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T18:11:42.543 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T18:11:42.560 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T18:11:42.563 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T18:11:42.563 INFO:teuthology.orchestra.run.smithi146.stdout:Need to get 244 MB of archives. 2024-09-17T18:11:42.563 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 909 MB of additional disk space will be used. 2024-09-17T18:11:42.563 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4975-g1889a165-1jammy [3,624 kB] 2024-09-17T18:11:42.570 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T18:11:42.609 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T18:11:42.622 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T18:11:42.627 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T18:11:42.639 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T18:11:42.643 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-17T18:11:42.645 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T18:11:42.646 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T18:11:42.646 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T18:11:42.654 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T18:11:42.656 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T18:11:42.659 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T18:11:42.661 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T18:11:42.661 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T18:11:42.679 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T18:11:42.681 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T18:11:42.683 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T18:11:42.683 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T18:11:42.684 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T18:11:42.685 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T18:11:42.685 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T18:11:42.686 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T18:11:42.696 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T18:11:42.696 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T18:11:42.713 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T18:11:42.714 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T18:11:42.716 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T18:11:42.717 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T18:11:42.717 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T18:11:42.718 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T18:11:42.719 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T18:11:42.719 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T18:11:42.730 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T18:11:42.731 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T18:11:42.747 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T18:11:42.748 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T18:11:42.753 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T18:11:42.754 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T18:11:42.754 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T18:11:42.755 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T18:11:42.756 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T18:11:42.758 INFO:teuthology.orchestra.run.smithi134.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T18:11:42.765 INFO:teuthology.orchestra.run.smithi134.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T18:11:42.766 INFO:teuthology.orchestra.run.smithi134.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T18:11:42.776 INFO:teuthology.orchestra.run.smithi134.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T18:11:42.779 INFO:teuthology.orchestra.run.smithi134.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T18:11:42.780 INFO:teuthology.orchestra.run.smithi134.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T18:11:42.780 INFO:teuthology.orchestra.run.smithi134.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T18:11:42.783 INFO:teuthology.orchestra.run.smithi134.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T18:11:42.794 INFO:teuthology.orchestra.run.smithi134.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4975-g1889a165-1jammy [3,332 kB] 2024-09-17T18:11:42.798 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4975-g1889a165-1jammy [3,332 kB] 2024-09-17T18:11:42.829 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4975-g1889a165-1jammy [3,332 kB] 2024-09-17T18:11:42.836 INFO:teuthology.orchestra.run.smithi134.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T18:11:42.837 INFO:teuthology.orchestra.run.smithi134.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T18:11:42.839 INFO:teuthology.orchestra.run.smithi134.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T18:11:42.839 INFO:teuthology.orchestra.run.smithi134.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T18:11:42.840 INFO:teuthology.orchestra.run.smithi134.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T18:11:42.858 INFO:teuthology.orchestra.run.smithi134.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T18:11:42.860 INFO:teuthology.orchestra.run.smithi134.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T18:11:42.860 INFO:teuthology.orchestra.run.smithi134.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T18:11:42.876 INFO:teuthology.orchestra.run.smithi134.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T18:11:42.876 INFO:teuthology.orchestra.run.smithi134.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T18:11:42.876 INFO:teuthology.orchestra.run.smithi134.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T18:11:42.877 INFO:teuthology.orchestra.run.smithi134.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T18:11:42.877 INFO:teuthology.orchestra.run.smithi134.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T18:11:42.878 INFO:teuthology.orchestra.run.smithi134.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T18:11:42.911 INFO:teuthology.orchestra.run.smithi134.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T18:11:42.912 INFO:teuthology.orchestra.run.smithi134.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T18:11:42.914 INFO:teuthology.orchestra.run.smithi134.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T18:11:42.916 INFO:teuthology.orchestra.run.smithi134.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T18:11:42.917 INFO:teuthology.orchestra.run.smithi134.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T18:11:42.918 INFO:teuthology.orchestra.run.smithi134.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T18:11:42.921 INFO:teuthology.orchestra.run.smithi134.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T18:11:42.924 INFO:teuthology.orchestra.run.smithi134.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T18:11:42.928 INFO:teuthology.orchestra.run.smithi134.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T18:11:42.929 INFO:teuthology.orchestra.run.smithi134.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4975-g1889a165-1jammy [722 kB] 2024-09-17T18:11:42.943 INFO:teuthology.orchestra.run.smithi134.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T18:11:42.947 INFO:teuthology.orchestra.run.smithi134.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T18:11:42.948 INFO:teuthology.orchestra.run.smithi134.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T18:11:42.949 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4975-g1889a165-1jammy [722 kB] 2024-09-17T18:11:42.951 INFO:teuthology.orchestra.run.smithi134.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T18:11:42.951 INFO:teuthology.orchestra.run.smithi134.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T18:11:42.952 INFO:teuthology.orchestra.run.smithi134.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T18:11:42.952 INFO:teuthology.orchestra.run.smithi134.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T18:11:42.954 INFO:teuthology.orchestra.run.smithi134.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T18:11:42.954 INFO:teuthology.orchestra.run.smithi134.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T18:11:42.961 INFO:teuthology.orchestra.run.smithi134.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4975-g1889a165-1jammy [356 kB] 2024-09-17T18:11:42.963 INFO:teuthology.orchestra.run.smithi134.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T18:11:42.978 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4975-g1889a165-1jammy [722 kB] 2024-09-17T18:11:42.980 INFO:teuthology.orchestra.run.smithi134.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T18:11:42.980 INFO:teuthology.orchestra.run.smithi134.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T18:11:42.983 INFO:teuthology.orchestra.run.smithi134.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T18:11:42.983 INFO:teuthology.orchestra.run.smithi134.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T18:11:42.987 INFO:teuthology.orchestra.run.smithi134.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4975-g1889a165-1jammy [32.8 kB] 2024-09-17T18:11:42.988 INFO:teuthology.orchestra.run.smithi134.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4975-g1889a165-1jammy [180 kB] 2024-09-17T18:11:42.990 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4975-g1889a165-1jammy [356 kB] 2024-09-17T18:11:42.992 INFO:teuthology.orchestra.run.smithi134.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4975-g1889a165-1jammy [71.3 kB] 2024-09-17T18:11:42.994 INFO:teuthology.orchestra.run.smithi134.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4975-g1889a165-1jammy [338 kB] 2024-09-17T18:11:42.994 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T18:11:43.000 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4975-g1889a165-1jammy [32.8 kB] 2024-09-17T18:11:43.001 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4975-g1889a165-1jammy [180 kB] 2024-09-17T18:11:43.007 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T18:11:43.013 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4975-g1889a165-1jammy [356 kB] 2024-09-17T18:11:43.013 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4975-g1889a165-1jammy [71.3 kB] 2024-09-17T18:11:43.015 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4975-g1889a165-1jammy [338 kB] 2024-09-17T18:11:43.019 INFO:teuthology.orchestra.run.smithi134.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4975-g1889a165-1jammy [7,966 kB] 2024-09-17T18:11:43.031 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T18:11:43.033 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4975-g1889a165-1jammy [7,966 kB] 2024-09-17T18:11:43.042 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4975-g1889a165-1jammy [32.8 kB] 2024-09-17T18:11:43.043 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4975-g1889a165-1jammy [180 kB] 2024-09-17T18:11:43.043 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T18:11:43.047 INFO:teuthology.orchestra.run.smithi146.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4975-g1889a165-1jammy [71.3 kB] 2024-09-17T18:11:43.049 INFO:teuthology.orchestra.run.smithi146.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4975-g1889a165-1jammy [338 kB] 2024-09-17T18:11:43.076 INFO:teuthology.orchestra.run.smithi146.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4975-g1889a165-1jammy [7,966 kB] 2024-09-17T18:11:43.088 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T18:11:43.125 INFO:teuthology.orchestra.run.smithi146.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T18:11:43.317 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T18:11:43.328 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T18:11:43.354 INFO:teuthology.orchestra.run.smithi146.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T18:11:43.358 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T18:11:43.365 INFO:teuthology.orchestra.run.smithi146.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T18:11:43.367 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-17T18:11:43.369 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T18:11:43.370 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T18:11:43.371 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T18:11:43.389 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T18:11:43.393 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T18:11:43.395 INFO:teuthology.orchestra.run.smithi146.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T18:11:43.399 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T18:11:43.403 INFO:teuthology.orchestra.run.smithi146.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-17T18:11:43.406 INFO:teuthology.orchestra.run.smithi146.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T18:11:43.407 INFO:teuthology.orchestra.run.smithi146.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T18:11:43.408 INFO:teuthology.orchestra.run.smithi146.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T18:11:43.410 INFO:teuthology.orchestra.run.smithi134.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4975-g1889a165-1jammy [112 kB] 2024-09-17T18:11:43.413 INFO:teuthology.orchestra.run.smithi134.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4975-g1889a165-1jammy [473 kB] 2024-09-17T18:11:43.422 INFO:teuthology.orchestra.run.smithi134.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4975-g1889a165-1jammy [28.2 MB] 2024-09-17T18:11:43.425 INFO:teuthology.orchestra.run.smithi146.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T18:11:43.429 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4975-g1889a165-1jammy [112 kB] 2024-09-17T18:11:43.430 INFO:teuthology.orchestra.run.smithi146.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T18:11:43.432 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4975-g1889a165-1jammy [473 kB] 2024-09-17T18:11:43.435 INFO:teuthology.orchestra.run.smithi146.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T18:11:43.449 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4975-g1889a165-1jammy [28.2 MB] 2024-09-17T18:11:43.479 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T18:11:43.480 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T18:11:43.484 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T18:11:43.488 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T18:11:43.492 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T18:11:43.493 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T18:11:43.494 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T18:11:43.496 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T18:11:43.496 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T18:11:43.497 INFO:teuthology.orchestra.run.smithi146.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4975-g1889a165-1jammy [112 kB] 2024-09-17T18:11:43.500 INFO:teuthology.orchestra.run.smithi146.stdout:Get:25 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4975-g1889a165-1jammy [473 kB] 2024-09-17T18:11:43.511 INFO:teuthology.orchestra.run.smithi146.stdout:Get:26 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4975-g1889a165-1jammy [28.2 MB] 2024-09-17T18:11:43.515 INFO:teuthology.orchestra.run.smithi146.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T18:11:43.516 INFO:teuthology.orchestra.run.smithi146.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T18:11:43.520 INFO:teuthology.orchestra.run.smithi146.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T18:11:43.524 INFO:teuthology.orchestra.run.smithi146.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T18:11:43.527 INFO:teuthology.orchestra.run.smithi146.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T18:11:43.529 INFO:teuthology.orchestra.run.smithi146.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T18:11:43.529 INFO:teuthology.orchestra.run.smithi146.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T18:11:43.531 INFO:teuthology.orchestra.run.smithi146.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T18:11:43.531 INFO:teuthology.orchestra.run.smithi146.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T18:11:43.562 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T18:11:43.579 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T18:11:43.580 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T18:11:43.580 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T18:11:43.581 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T18:11:43.586 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T18:11:43.587 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T18:11:43.599 INFO:teuthology.orchestra.run.smithi146.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T18:11:43.622 INFO:teuthology.orchestra.run.smithi146.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T18:11:43.622 INFO:teuthology.orchestra.run.smithi146.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T18:11:43.623 INFO:teuthology.orchestra.run.smithi146.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T18:11:43.624 INFO:teuthology.orchestra.run.smithi146.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T18:11:43.629 INFO:teuthology.orchestra.run.smithi146.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T18:11:43.644 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T18:11:43.645 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T18:11:43.647 INFO:teuthology.orchestra.run.smithi154.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T18:11:43.681 INFO:teuthology.orchestra.run.smithi146.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T18:11:43.681 INFO:teuthology.orchestra.run.smithi146.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T18:11:43.682 INFO:teuthology.orchestra.run.smithi146.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T18:11:43.684 INFO:teuthology.orchestra.run.smithi146.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T18:11:43.725 INFO:teuthology.orchestra.run.smithi154.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T18:11:43.725 INFO:teuthology.orchestra.run.smithi154.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T18:11:43.727 INFO:teuthology.orchestra.run.smithi154.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T18:11:43.729 INFO:teuthology.orchestra.run.smithi154.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T18:11:43.730 INFO:teuthology.orchestra.run.smithi154.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T18:11:43.741 INFO:teuthology.orchestra.run.smithi154.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T18:11:43.761 INFO:teuthology.orchestra.run.smithi146.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T18:11:43.762 INFO:teuthology.orchestra.run.smithi146.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T18:11:43.764 INFO:teuthology.orchestra.run.smithi146.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T18:11:43.766 INFO:teuthology.orchestra.run.smithi146.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T18:11:43.768 INFO:teuthology.orchestra.run.smithi146.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T18:11:43.806 INFO:teuthology.orchestra.run.smithi154.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T18:11:43.807 INFO:teuthology.orchestra.run.smithi154.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T18:11:43.808 INFO:teuthology.orchestra.run.smithi154.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T18:11:43.810 INFO:teuthology.orchestra.run.smithi154.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T18:11:43.843 INFO:teuthology.orchestra.run.smithi146.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T18:11:43.843 INFO:teuthology.orchestra.run.smithi146.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T18:11:43.844 INFO:teuthology.orchestra.run.smithi146.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T18:11:43.845 INFO:teuthology.orchestra.run.smithi146.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T18:11:43.848 INFO:teuthology.orchestra.run.smithi146.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T18:11:43.888 INFO:teuthology.orchestra.run.smithi154.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T18:11:43.889 INFO:teuthology.orchestra.run.smithi154.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T18:11:43.892 INFO:teuthology.orchestra.run.smithi154.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T18:11:43.894 INFO:teuthology.orchestra.run.smithi154.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T18:11:43.898 INFO:teuthology.orchestra.run.smithi154.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T18:11:43.899 INFO:teuthology.orchestra.run.smithi154.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T18:11:43.924 INFO:teuthology.orchestra.run.smithi146.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T18:11:43.925 INFO:teuthology.orchestra.run.smithi146.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T18:11:43.928 INFO:teuthology.orchestra.run.smithi146.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T18:11:43.930 INFO:teuthology.orchestra.run.smithi146.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T18:11:43.934 INFO:teuthology.orchestra.run.smithi146.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T18:11:43.969 INFO:teuthology.orchestra.run.smithi154.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T18:11:43.973 INFO:teuthology.orchestra.run.smithi154.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T18:11:44.005 INFO:teuthology.orchestra.run.smithi146.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T18:11:44.006 INFO:teuthology.orchestra.run.smithi146.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T18:11:44.011 INFO:teuthology.orchestra.run.smithi146.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T18:11:44.136 INFO:teuthology.orchestra.run.smithi154.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T18:11:44.138 INFO:teuthology.orchestra.run.smithi154.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T18:11:44.140 INFO:teuthology.orchestra.run.smithi154.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T18:11:44.140 INFO:teuthology.orchestra.run.smithi154.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T18:11:44.142 INFO:teuthology.orchestra.run.smithi154.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T18:11:44.173 INFO:teuthology.orchestra.run.smithi146.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T18:11:44.174 INFO:teuthology.orchestra.run.smithi146.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T18:11:44.176 INFO:teuthology.orchestra.run.smithi146.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T18:11:44.177 INFO:teuthology.orchestra.run.smithi146.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T18:11:44.178 INFO:teuthology.orchestra.run.smithi154.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T18:11:44.179 INFO:teuthology.orchestra.run.smithi146.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T18:11:44.181 INFO:teuthology.orchestra.run.smithi154.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T18:11:44.182 INFO:teuthology.orchestra.run.smithi154.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T18:11:44.211 INFO:teuthology.orchestra.run.smithi146.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T18:11:44.214 INFO:teuthology.orchestra.run.smithi146.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T18:11:44.214 INFO:teuthology.orchestra.run.smithi146.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T18:11:44.240 INFO:teuthology.orchestra.run.smithi154.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T18:11:44.241 INFO:teuthology.orchestra.run.smithi154.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T18:11:44.275 INFO:teuthology.orchestra.run.smithi146.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T18:11:44.275 INFO:teuthology.orchestra.run.smithi146.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T18:11:44.304 INFO:teuthology.orchestra.run.smithi154.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T18:11:44.304 INFO:teuthology.orchestra.run.smithi154.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T18:11:44.304 INFO:teuthology.orchestra.run.smithi154.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T18:11:44.306 INFO:teuthology.orchestra.run.smithi154.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T18:11:44.306 INFO:teuthology.orchestra.run.smithi154.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T18:11:44.307 INFO:teuthology.orchestra.run.smithi154.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T18:11:44.314 INFO:teuthology.orchestra.run.smithi154.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T18:11:44.339 INFO:teuthology.orchestra.run.smithi146.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T18:11:44.340 INFO:teuthology.orchestra.run.smithi146.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T18:11:44.340 INFO:teuthology.orchestra.run.smithi146.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T18:11:44.342 INFO:teuthology.orchestra.run.smithi146.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T18:11:44.342 INFO:teuthology.orchestra.run.smithi146.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T18:11:44.343 INFO:teuthology.orchestra.run.smithi146.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T18:11:44.350 INFO:teuthology.orchestra.run.smithi146.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T18:11:44.384 INFO:teuthology.orchestra.run.smithi154.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T18:11:44.387 INFO:teuthology.orchestra.run.smithi154.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T18:11:44.389 INFO:teuthology.orchestra.run.smithi154.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T18:11:44.420 INFO:teuthology.orchestra.run.smithi146.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T18:11:44.423 INFO:teuthology.orchestra.run.smithi146.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T18:11:44.425 INFO:teuthology.orchestra.run.smithi146.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T18:11:44.465 INFO:teuthology.orchestra.run.smithi154.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T18:11:44.472 INFO:teuthology.orchestra.run.smithi154.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T18:11:44.474 INFO:teuthology.orchestra.run.smithi154.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T18:11:44.475 INFO:teuthology.orchestra.run.smithi154.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T18:11:44.487 INFO:teuthology.orchestra.run.smithi154.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T18:11:44.488 INFO:teuthology.orchestra.run.smithi154.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T18:11:44.496 INFO:teuthology.orchestra.run.smithi154.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T18:11:44.502 INFO:teuthology.orchestra.run.smithi146.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T18:11:44.508 INFO:teuthology.orchestra.run.smithi146.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T18:11:44.510 INFO:teuthology.orchestra.run.smithi146.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T18:11:44.512 INFO:teuthology.orchestra.run.smithi146.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T18:11:44.523 INFO:teuthology.orchestra.run.smithi146.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T18:11:44.524 INFO:teuthology.orchestra.run.smithi146.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T18:11:44.532 INFO:teuthology.orchestra.run.smithi146.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T18:11:44.547 INFO:teuthology.orchestra.run.smithi154.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T18:11:44.548 INFO:teuthology.orchestra.run.smithi154.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T18:11:44.549 INFO:teuthology.orchestra.run.smithi154.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T18:11:44.584 INFO:teuthology.orchestra.run.smithi146.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T18:11:44.585 INFO:teuthology.orchestra.run.smithi146.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T18:11:44.586 INFO:teuthology.orchestra.run.smithi146.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T18:11:44.629 INFO:teuthology.orchestra.run.smithi154.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T18:11:44.632 INFO:teuthology.orchestra.run.smithi154.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T18:11:44.649 INFO:teuthology.orchestra.run.smithi154.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T18:11:44.649 INFO:teuthology.orchestra.run.smithi154.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T18:11:44.650 INFO:teuthology.orchestra.run.smithi154.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T18:11:44.655 INFO:teuthology.orchestra.run.smithi154.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T18:11:44.657 INFO:teuthology.orchestra.run.smithi154.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T18:11:44.666 INFO:teuthology.orchestra.run.smithi146.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T18:11:44.668 INFO:teuthology.orchestra.run.smithi146.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T18:11:44.685 INFO:teuthology.orchestra.run.smithi146.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T18:11:44.685 INFO:teuthology.orchestra.run.smithi146.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T18:11:44.686 INFO:teuthology.orchestra.run.smithi146.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T18:11:44.691 INFO:teuthology.orchestra.run.smithi146.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T18:11:44.693 INFO:teuthology.orchestra.run.smithi146.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T18:11:44.696 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 171 kB in 0s (454 kB/s) 2024-09-17T18:11:44.865 INFO:teuthology.orchestra.run.smithi154.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4975-g1889a165-1jammy [5,209 kB] 2024-09-17T18:11:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4975-g1889a165-1jammy [5,209 kB] 2024-09-17T18:11:44.983 INFO:teuthology.orchestra.run.smithi154.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4975-g1889a165-1jammy [251 kB] 2024-09-17T18:11:44.988 INFO:teuthology.orchestra.run.smithi154.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4975-g1889a165-1jammy [124 kB] 2024-09-17T18:11:44.991 INFO:teuthology.orchestra.run.smithi154.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4975-g1889a165-1jammy [1,561 kB] 2024-09-17T18:11:45.051 INFO:teuthology.orchestra.run.smithi154.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4975-g1889a165-1jammy [6,310 kB] 2024-09-17T18:11:45.066 INFO:teuthology.orchestra.run.smithi134.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4975-g1889a165-1jammy [251 kB] 2024-09-17T18:11:45.071 INFO:teuthology.orchestra.run.smithi134.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4975-g1889a165-1jammy [124 kB] 2024-09-17T18:11:45.074 INFO:teuthology.orchestra.run.smithi134.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4975-g1889a165-1jammy [1,561 kB] 2024-09-17T18:11:45.158 INFO:teuthology.orchestra.run.smithi134.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4975-g1889a165-1jammy [6,310 kB] 2024-09-17T18:11:45.178 INFO:teuthology.orchestra.run.smithi146.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4975-g1889a165-1jammy [5,209 kB] 2024-09-17T18:11:45.318 INFO:teuthology.orchestra.run.smithi154.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4975-g1889a165-1jammy [23.1 MB] 2024-09-17T18:11:45.361 INFO:teuthology.orchestra.run.smithi146.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4975-g1889a165-1jammy [251 kB] 2024-09-17T18:11:45.395 INFO:teuthology.orchestra.run.smithi146.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4975-g1889a165-1jammy [124 kB] 2024-09-17T18:11:45.398 INFO:teuthology.orchestra.run.smithi146.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4975-g1889a165-1jammy [1,561 kB] 2024-09-17T18:11:45.469 INFO:teuthology.orchestra.run.smithi134.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4975-g1889a165-1jammy [23.1 MB] 2024-09-17T18:11:45.479 INFO:teuthology.orchestra.run.smithi146.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4975-g1889a165-1jammy [6,310 kB] 2024-09-17T18:11:45.761 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-17T18:11:45.778 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4975-g1889a165-1jammy cephadm=19.3.0-4975-g1889a165-1jammy ceph-mds=19.3.0-4975-g1889a165-1jammy ceph-mgr=19.3.0-4975-g1889a165-1jammy ceph-common=19.3.0-4975-g1889a165-1jammy ceph-fuse=19.3.0-4975-g1889a165-1jammy ceph-test=19.3.0-4975-g1889a165-1jammy ceph-volume=19.3.0-4975-g1889a165-1jammy radosgw=19.3.0-4975-g1889a165-1jammy python3-rados=19.3.0-4975-g1889a165-1jammy python3-rgw=19.3.0-4975-g1889a165-1jammy python3-cephfs=19.3.0-4975-g1889a165-1jammy python3-rbd=19.3.0-4975-g1889a165-1jammy libcephfs2=19.3.0-4975-g1889a165-1jammy libcephfs-dev=19.3.0-4975-g1889a165-1jammy librados2=19.3.0-4975-g1889a165-1jammy librbd1=19.3.0-4975-g1889a165-1jammy rbd-fuse=19.3.0-4975-g1889a165-1jammy 2024-09-17T18:11:45.838 INFO:teuthology.orchestra.run.smithi146.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4975-g1889a165-1jammy [23.1 MB] 2024-09-17T18:11:45.840 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-17T18:11:46.047 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-09-17T18:11:46.048 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-09-17T18:11:46.246 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T18:11:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T18:11:46.246 INFO:teuthology.orchestra.run.smithi087.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T18:11:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T18:11:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T18:11:46.247 INFO:teuthology.orchestra.run.smithi087.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T18:11:46.247 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T18:11:46.250 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2024-09-17T18:11:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T18:11:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T18:11:46.250 INFO:teuthology.orchestra.run.smithi087.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T18:11:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-17T18:11:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-17T18:11:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-17T18:11:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T18:11:46.251 INFO:teuthology.orchestra.run.smithi087.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T18:11:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-17T18:11:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-17T18:11:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-17T18:11:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-17T18:11:46.252 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-17T18:11:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-17T18:11:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-17T18:11:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-17T18:11:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-17T18:11:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-17T18:11:46.253 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T18:11:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T18:11:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T18:11:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T18:11:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-17T18:11:46.254 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet zip 2024-09-17T18:11:46.254 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2024-09-17T18:11:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T18:11:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T18:11:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T18:11:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T18:11:46.255 INFO:teuthology.orchestra.run.smithi087.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T18:11:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T18:11:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T18:11:46.256 INFO:teuthology.orchestra.run.smithi087.stdout:Recommended packages: 2024-09-17T18:11:46.256 INFO:teuthology.orchestra.run.smithi087.stdout: btrfs-tools 2024-09-17T18:11:46.351 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2024-09-17T18:11:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T18:11:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T18:11:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-17T18:11:46.351 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-17T18:11:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-17T18:11:46.352 INFO:teuthology.orchestra.run.smithi087.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-17T18:11:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-17T18:11:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-17T18:11:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-17T18:11:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-17T18:11:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-17T18:11:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T18:11:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T18:11:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T18:11:46.353 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T18:11:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T18:11:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T18:11:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T18:11:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-17T18:11:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-17T18:11:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-17T18:11:46.354 INFO:teuthology.orchestra.run.smithi087.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-17T18:11:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-17T18:11:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-17T18:11:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-17T18:11:46.355 INFO:teuthology.orchestra.run.smithi087.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-17T18:11:46.410 INFO:teuthology.orchestra.run.smithi087.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T18:11:46.410 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 244 MB of archives. 2024-09-17T18:11:46.410 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 909 MB of additional disk space will be used. 2024-09-17T18:11:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T18:11:46.448 INFO:teuthology.orchestra.run.smithi154.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4975-g1889a165-1jammy [14.0 kB] 2024-09-17T18:11:46.448 INFO:teuthology.orchestra.run.smithi154.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4975-g1889a165-1jammy [880 kB] 2024-09-17T18:11:46.465 INFO:teuthology.orchestra.run.smithi154.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4975-g1889a165-1jammy [2,452 kB] 2024-09-17T18:11:46.498 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T18:11:46.500 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T18:11:46.510 INFO:teuthology.orchestra.run.smithi154.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4975-g1889a165-1jammy [813 kB] 2024-09-17T18:11:46.517 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T18:11:46.566 INFO:teuthology.orchestra.run.smithi154.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4975-g1889a165-1jammy [160 kB] 2024-09-17T18:11:46.569 INFO:teuthology.orchestra.run.smithi154.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4975-g1889a165-1jammy [61.5 MB] 2024-09-17T18:11:46.574 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T18:11:46.579 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T18:11:46.591 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T18:11:46.595 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-17T18:11:46.596 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T18:11:46.597 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T18:11:46.598 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T18:11:46.606 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T18:11:46.608 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T18:11:46.610 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T18:11:46.612 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T18:11:46.612 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T18:11:46.629 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T18:11:46.631 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T18:11:46.633 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T18:11:46.634 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T18:11:46.634 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T18:11:46.635 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T18:11:46.636 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T18:11:46.636 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T18:11:46.646 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T18:11:46.647 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T18:11:46.663 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T18:11:46.664 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T18:11:46.666 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T18:11:46.667 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T18:11:46.667 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T18:11:46.667 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T18:11:46.668 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T18:11:46.669 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T18:11:46.680 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T18:11:46.681 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T18:11:46.694 INFO:teuthology.orchestra.run.smithi134.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4975-g1889a165-1jammy [14.0 kB] 2024-09-17T18:11:46.695 INFO:teuthology.orchestra.run.smithi134.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4975-g1889a165-1jammy [880 kB] 2024-09-17T18:11:46.697 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T18:11:46.697 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T18:11:46.703 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T18:11:46.703 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T18:11:46.703 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T18:11:46.704 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T18:11:46.705 INFO:teuthology.orchestra.run.smithi087.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T18:11:46.707 INFO:teuthology.orchestra.run.smithi087.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T18:11:46.708 INFO:teuthology.orchestra.run.smithi087.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4975-g1889a165-1jammy [3,624 kB] 2024-09-17T18:11:46.712 INFO:teuthology.orchestra.run.smithi134.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4975-g1889a165-1jammy [2,452 kB] 2024-09-17T18:11:46.714 INFO:teuthology.orchestra.run.smithi087.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T18:11:46.715 INFO:teuthology.orchestra.run.smithi087.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T18:11:46.725 INFO:teuthology.orchestra.run.smithi087.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T18:11:46.727 INFO:teuthology.orchestra.run.smithi087.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T18:11:46.728 INFO:teuthology.orchestra.run.smithi087.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T18:11:46.729 INFO:teuthology.orchestra.run.smithi087.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T18:11:46.731 INFO:teuthology.orchestra.run.smithi087.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T18:11:46.761 INFO:teuthology.orchestra.run.smithi134.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4975-g1889a165-1jammy [813 kB] 2024-09-17T18:11:46.781 INFO:teuthology.orchestra.run.smithi087.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T18:11:46.782 INFO:teuthology.orchestra.run.smithi087.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T18:11:46.783 INFO:teuthology.orchestra.run.smithi087.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T18:11:46.783 INFO:teuthology.orchestra.run.smithi087.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T18:11:46.784 INFO:teuthology.orchestra.run.smithi087.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T18:11:46.801 INFO:teuthology.orchestra.run.smithi087.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T18:11:46.803 INFO:teuthology.orchestra.run.smithi087.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T18:11:46.803 INFO:teuthology.orchestra.run.smithi087.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T18:11:46.817 INFO:teuthology.orchestra.run.smithi087.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T18:11:46.818 INFO:teuthology.orchestra.run.smithi087.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T18:11:46.818 INFO:teuthology.orchestra.run.smithi087.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T18:11:46.818 INFO:teuthology.orchestra.run.smithi087.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T18:11:46.819 INFO:teuthology.orchestra.run.smithi087.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T18:11:46.819 INFO:teuthology.orchestra.run.smithi087.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T18:11:46.820 INFO:teuthology.orchestra.run.smithi134.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4975-g1889a165-1jammy [160 kB] 2024-09-17T18:11:46.824 INFO:teuthology.orchestra.run.smithi134.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4975-g1889a165-1jammy [61.5 MB] 2024-09-17T18:11:46.834 INFO:teuthology.orchestra.run.smithi087.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T18:11:46.834 INFO:teuthology.orchestra.run.smithi087.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T18:11:46.837 INFO:teuthology.orchestra.run.smithi087.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T18:11:46.851 INFO:teuthology.orchestra.run.smithi087.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T18:11:46.852 INFO:teuthology.orchestra.run.smithi087.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T18:11:46.852 INFO:teuthology.orchestra.run.smithi087.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T18:11:46.855 INFO:teuthology.orchestra.run.smithi087.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T18:11:46.858 INFO:teuthology.orchestra.run.smithi087.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T18:11:46.858 INFO:teuthology.orchestra.run.smithi087.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T18:11:46.859 INFO:teuthology.orchestra.run.smithi087.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T18:11:46.868 INFO:teuthology.orchestra.run.smithi087.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T18:11:46.868 INFO:teuthology.orchestra.run.smithi087.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T18:11:46.871 INFO:teuthology.orchestra.run.smithi087.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T18:11:46.884 INFO:teuthology.orchestra.run.smithi087.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T18:11:46.885 INFO:teuthology.orchestra.run.smithi087.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T18:11:46.885 INFO:teuthology.orchestra.run.smithi087.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T18:11:46.887 INFO:teuthology.orchestra.run.smithi087.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T18:11:46.887 INFO:teuthology.orchestra.run.smithi087.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T18:11:46.893 INFO:teuthology.orchestra.run.smithi087.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T18:11:46.893 INFO:teuthology.orchestra.run.smithi087.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T18:11:46.901 INFO:teuthology.orchestra.run.smithi087.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T18:11:46.904 INFO:teuthology.orchestra.run.smithi087.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T18:11:46.904 INFO:teuthology.orchestra.run.smithi087.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T18:11:47.199 INFO:teuthology.orchestra.run.smithi146.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4975-g1889a165-1jammy [14.0 kB] 2024-09-17T18:11:47.199 INFO:teuthology.orchestra.run.smithi146.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4975-g1889a165-1jammy [880 kB] 2024-09-17T18:11:47.218 INFO:teuthology.orchestra.run.smithi146.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4975-g1889a165-1jammy [2,452 kB] 2024-09-17T18:11:47.283 INFO:teuthology.orchestra.run.smithi146.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4975-g1889a165-1jammy [813 kB] 2024-09-17T18:11:47.351 INFO:teuthology.orchestra.run.smithi146.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4975-g1889a165-1jammy [160 kB] 2024-09-17T18:11:47.354 INFO:teuthology.orchestra.run.smithi146.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4975-g1889a165-1jammy [61.5 MB] 2024-09-17T18:11:47.963 INFO:teuthology.orchestra.run.smithi087.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4975-g1889a165-1jammy [3,332 kB] 2024-09-17T18:11:48.779 INFO:teuthology.orchestra.run.smithi087.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4975-g1889a165-1jammy [722 kB] 2024-09-17T18:11:49.003 INFO:teuthology.orchestra.run.smithi087.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4975-g1889a165-1jammy [356 kB] 2024-09-17T18:11:49.081 INFO:teuthology.orchestra.run.smithi087.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4975-g1889a165-1jammy [32.8 kB] 2024-09-17T18:11:49.082 INFO:teuthology.orchestra.run.smithi087.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4975-g1889a165-1jammy [180 kB] 2024-09-17T18:11:49.155 INFO:teuthology.orchestra.run.smithi087.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4975-g1889a165-1jammy [71.3 kB] 2024-09-17T18:11:49.157 INFO:teuthology.orchestra.run.smithi087.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4975-g1889a165-1jammy [338 kB] 2024-09-17T18:11:49.234 INFO:teuthology.orchestra.run.smithi087.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4975-g1889a165-1jammy [7,966 kB] 2024-09-17T18:11:50.036 INFO:teuthology.orchestra.run.smithi134.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4975-g1889a165-1jammy [8,625 kB] 2024-09-17T18:11:50.275 INFO:teuthology.orchestra.run.smithi134.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4975-g1889a165-1jammy [14.2 kB] 2024-09-17T18:11:50.275 INFO:teuthology.orchestra.run.smithi134.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4975-g1889a165-1jammy [48.5 MB] 2024-09-17T18:11:50.289 INFO:teuthology.orchestra.run.smithi154.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4975-g1889a165-1jammy [8,625 kB] 2024-09-17T18:11:50.592 INFO:teuthology.orchestra.run.smithi154.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4975-g1889a165-1jammy [14.2 kB] 2024-09-17T18:11:50.592 INFO:teuthology.orchestra.run.smithi154.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4975-g1889a165-1jammy [48.5 MB] 2024-09-17T18:11:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4975-g1889a165-1jammy [8,625 kB] 2024-09-17T18:11:50.792 INFO:teuthology.orchestra.run.smithi087.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4975-g1889a165-1jammy [112 kB] 2024-09-17T18:11:50.849 INFO:teuthology.orchestra.run.smithi087.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4975-g1889a165-1jammy [473 kB] 2024-09-17T18:11:50.917 INFO:teuthology.orchestra.run.smithi087.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4975-g1889a165-1jammy [28.2 MB] 2024-09-17T18:11:51.011 INFO:teuthology.orchestra.run.smithi146.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4975-g1889a165-1jammy [14.2 kB] 2024-09-17T18:11:51.012 INFO:teuthology.orchestra.run.smithi146.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4975-g1889a165-1jammy [48.5 MB] 2024-09-17T18:11:53.023 INFO:teuthology.orchestra.run.smithi134.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4975-g1889a165-1jammy [130 kB] 2024-09-17T18:11:53.025 INFO:teuthology.orchestra.run.smithi134.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4975-g1889a165-1jammy [39.0 kB] 2024-09-17T18:11:53.027 INFO:teuthology.orchestra.run.smithi134.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4975-g1889a165-1jammy [15.8 MB] 2024-09-17T18:11:53.232 INFO:teuthology.orchestra.run.smithi154.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4975-g1889a165-1jammy [130 kB] 2024-09-17T18:11:53.235 INFO:teuthology.orchestra.run.smithi154.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4975-g1889a165-1jammy [39.0 kB] 2024-09-17T18:11:53.236 INFO:teuthology.orchestra.run.smithi154.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4975-g1889a165-1jammy [15.8 MB] 2024-09-17T18:11:53.703 INFO:teuthology.orchestra.run.smithi134.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4975-g1889a165-1jammy [91.3 kB] 2024-09-17T18:11:53.882 INFO:teuthology.orchestra.run.smithi154.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4975-g1889a165-1jammy [91.3 kB] 2024-09-17T18:11:53.994 INFO:teuthology.orchestra.run.smithi146.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4975-g1889a165-1jammy [130 kB] 2024-09-17T18:11:53.997 INFO:teuthology.orchestra.run.smithi146.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4975-g1889a165-1jammy [39.0 kB] 2024-09-17T18:11:53.998 INFO:teuthology.orchestra.run.smithi146.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4975-g1889a165-1jammy [15.8 MB] 2024-09-17T18:11:54.280 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 244 MB in 11s (21.6 MB/s) 2024-09-17T18:11:54.354 INFO:teuthology.orchestra.run.smithi146.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4975-g1889a165-1jammy [91.3 kB] 2024-09-17T18:11:54.446 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T18:11:54.462 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 244 MB in 11s (21.2 MB/s) 2024-09-17T18:11:54.547 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T18:11:54.553 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T18:11:54.627 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T18:11:54.644 INFO:teuthology.orchestra.run.smithi087.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4975-g1889a165-1jammy [5,209 kB] 2024-09-17T18:11:54.734 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T18:11:54.837 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T18:11:54.842 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T18:11:54.897 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T18:11:54.913 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T18:11:54.913 INFO:teuthology.orchestra.run.smithi087.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4975-g1889a165-1jammy [251 kB] 2024-09-17T18:11:54.918 INFO:teuthology.orchestra.run.smithi087.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4975-g1889a165-1jammy [124 kB] 2024-09-17T18:11:54.932 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 244 MB in 12s (20.4 MB/s) 2024-09-17T18:11:54.933 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T18:11:54.933 INFO:teuthology.orchestra.run.smithi087.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4975-g1889a165-1jammy [1,561 kB] 2024-09-17T18:11:54.947 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T18:11:55.019 INFO:teuthology.orchestra.run.smithi087.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4975-g1889a165-1jammy [6,310 kB] 2024-09-17T18:11:55.092 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T18:11:55.187 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T18:11:55.193 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T18:11:55.236 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T18:11:55.263 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T18:11:55.274 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T18:11:55.283 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T18:11:55.303 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T18:11:55.310 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T18:11:55.350 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T18:11:55.374 INFO:teuthology.orchestra.run.smithi087.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4975-g1889a165-1jammy [23.1 MB] 2024-09-17T18:11:55.614 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T18:11:55.664 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T18:11:55.665 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T18:11:55.665 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T18:11:55.681 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T18:11:55.686 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T18:11:55.787 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T18:11:55.813 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T18:11:55.861 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:11:55.980 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T18:11:56.007 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T18:11:56.038 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T18:11:56.109 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T18:11:56.136 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T18:11:56.185 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:11:56.215 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T18:11:56.242 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T18:11:56.273 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:11:56.450 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T18:11:56.477 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T18:11:56.525 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:11:56.596 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T18:11:56.609 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T18:11:56.622 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T18:11:56.636 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T18:11:56.662 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:11:56.676 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:11:56.720 INFO:teuthology.orchestra.run.smithi087.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4975-g1889a165-1jammy [14.0 kB] 2024-09-17T18:11:56.721 INFO:teuthology.orchestra.run.smithi087.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4975-g1889a165-1jammy [880 kB] 2024-09-17T18:11:56.741 INFO:teuthology.orchestra.run.smithi087.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4975-g1889a165-1jammy [2,452 kB] 2024-09-17T18:11:56.851 INFO:teuthology.orchestra.run.smithi087.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4975-g1889a165-1jammy [813 kB] 2024-09-17T18:11:56.878 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T18:11:56.892 INFO:teuthology.orchestra.run.smithi087.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4975-g1889a165-1jammy [160 kB] 2024-09-17T18:11:56.904 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T18:11:56.907 INFO:teuthology.orchestra.run.smithi087.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4975-g1889a165-1jammy [61.5 MB] 2024-09-17T18:11:56.945 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:11:57.007 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T18:11:57.029 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T18:11:57.033 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T18:11:57.056 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T18:11:57.074 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:11:57.095 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T18:11:57.256 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T18:11:57.282 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T18:11:57.314 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:11:57.407 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librados2. 2024-09-17T18:11:57.428 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T18:11:57.433 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../007-librados2_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:11:57.453 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T18:11:57.465 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librados2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:11:57.494 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T18:11:57.651 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T18:11:57.677 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T18:11:57.717 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T18:11:57.813 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librados2. 2024-09-17T18:11:57.840 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../007-librados2_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:11:57.880 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librados2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:11:57.943 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libnbd0. 2024-09-17T18:11:57.970 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-17T18:11:58.010 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-17T18:11:58.045 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librados2. 2024-09-17T18:11:58.071 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../007-librados2_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:11:58.111 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librados2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:11:58.320 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librbd1. 2024-09-17T18:11:58.324 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libnbd0. 2024-09-17T18:11:58.347 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../009-librbd1_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:11:58.350 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-17T18:11:58.383 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-17T18:11:58.387 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librbd1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:11:58.556 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libnbd0. 2024-09-17T18:11:58.582 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-17T18:11:58.614 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-17T18:11:58.694 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librbd1. 2024-09-17T18:11:58.720 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../009-librbd1_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:11:58.761 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librbd1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:11:58.823 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T18:11:58.838 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:11:58.873 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:11:58.909 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librbd1. 2024-09-17T18:11:58.935 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../009-librbd1_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:11:59.126 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rados. 2024-09-17T18:11:59.136 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librbd1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:11:59.152 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:11:59.192 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rados (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:11:59.214 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T18:11:59.233 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:11:59.272 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:11:59.524 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rados. 2024-09-17T18:11:59.540 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:11:59.570 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T18:11:59.574 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rados (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:11:59.596 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:11:59.636 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libcephfs2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:11:59.670 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T18:11:59.697 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:11:59.737 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-argparse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:11:59.922 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rados. 2024-09-17T18:11:59.937 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:11:59.972 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rados (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:11:59.989 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T18:12:00.015 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:00.044 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T18:12:00.056 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cephfs (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:00.070 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:00.102 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-argparse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:00.104 INFO:teuthology.orchestra.run.smithi087.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4975-g1889a165-1jammy [8,625 kB] 2024-09-17T18:12:00.274 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T18:12:00.301 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:00.322 INFO:teuthology.orchestra.run.smithi087.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4975-g1889a165-1jammy [14.2 kB] 2024-09-17T18:12:00.322 INFO:teuthology.orchestra.run.smithi087.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4975-g1889a165-1jammy [48.5 MB] 2024-09-17T18:12:00.341 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-ceph-argparse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:00.342 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T18:12:00.355 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T18:12:00.368 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:00.381 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:00.409 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:00.421 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cephfs (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:00.593 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T18:12:00.620 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:00.660 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cephfs (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:00.720 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T18:12:00.732 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T18:12:00.746 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T18:12:00.759 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:00.786 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T18:12:00.799 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:00.971 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T18:12:00.997 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:01.037 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:01.073 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T18:12:01.099 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T18:12:01.127 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T18:12:01.147 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T18:12:01.154 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T18:12:01.185 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T18:12:01.357 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T18:12:01.383 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T18:12:01.423 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T18:12:01.425 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T18:12:01.440 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:01.484 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rbd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:01.505 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T18:12:01.532 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T18:12:01.572 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T18:12:01.743 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T18:12:01.769 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T18:12:01.809 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T18:12:01.833 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T18:12:01.836 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T18:12:01.859 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:01.862 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T18:12:01.899 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rbd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:01.902 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T18:12:02.070 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T18:12:02.085 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:02.128 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rbd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:02.163 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T18:12:02.179 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T18:12:02.213 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T18:12:02.219 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T18:12:02.246 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T18:12:02.286 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T18:12:02.440 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T18:12:02.466 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T18:12:02.478 INFO:teuthology.orchestra.run.smithi087.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4975-g1889a165-1jammy [130 kB] 2024-09-17T18:12:02.480 INFO:teuthology.orchestra.run.smithi087.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4975-g1889a165-1jammy [39.0 kB] 2024-09-17T18:12:02.481 INFO:teuthology.orchestra.run.smithi087.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4975-g1889a165-1jammy [15.8 MB] 2024-09-17T18:12:02.491 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T18:12:02.497 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T18:12:02.517 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T18:12:02.522 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T18:12:02.548 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T18:12:02.558 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T18:12:02.588 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T18:12:02.767 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T18:12:02.782 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T18:12:02.825 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T18:12:02.869 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua5.1. 2024-09-17T18:12:02.883 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T18:12:02.896 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T18:12:02.909 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T18:12:02.936 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T18:12:02.949 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T18:12:02.964 INFO:teuthology.orchestra.run.smithi087.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4975-g1889a165-1jammy [91.3 kB] 2024-09-17T18:12:03.111 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T18:12:03.126 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T18:12:03.169 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T18:12:03.247 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua-any. 2024-09-17T18:12:03.262 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-17T18:12:03.269 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua5.1. 2024-09-17T18:12:03.296 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T18:12:03.305 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T18:12:03.336 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T18:12:03.506 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package lua5.1. 2024-09-17T18:12:03.516 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package zip. 2024-09-17T18:12:03.532 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-17T18:12:03.532 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T18:12:03.541 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 244 MB in 17s (14.7 MB/s) 2024-09-17T18:12:03.566 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T18:12:03.573 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T18:12:03.614 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-any. 2024-09-17T18:12:03.629 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-17T18:12:03.664 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T18:12:03.707 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T18:12:03.807 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T18:12:03.813 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T18:12:03.869 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package unzip. 2024-09-17T18:12:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package lua-any. 2024-09-17T18:12:03.896 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T18:12:03.897 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T18:12:03.908 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package zip. 2024-09-17T18:12:03.919 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-17T18:12:03.923 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-17T18:12:03.936 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T18:12:03.959 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T18:12:03.966 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T18:12:04.211 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package zip. 2024-09-17T18:12:04.227 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-17T18:12:04.242 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T18:12:04.269 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T18:12:04.269 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T18:12:04.288 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package unzip. 2024-09-17T18:12:04.309 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T18:12:04.313 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T18:12:04.332 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package luarocks. 2024-09-17T18:12:04.353 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T18:12:04.358 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T18:12:04.398 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T18:12:04.578 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T18:12:04.604 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T18:12:04.606 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package unzip. 2024-09-17T18:12:04.632 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T18:12:04.637 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T18:12:04.672 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T18:12:04.707 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package luarocks. 2024-09-17T18:12:04.733 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T18:12:04.773 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T18:12:04.931 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librgw2. 2024-09-17T18:12:04.955 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../026-librgw2_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:04.985 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package luarocks. 2024-09-17T18:12:04.988 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librgw2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:05.012 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T18:12:05.043 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T18:12:05.091 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T18:12:05.117 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T18:12:05.165 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:12:05.306 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librgw2. 2024-09-17T18:12:05.322 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../026-librgw2_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:05.365 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librgw2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:05.417 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librgw2. 2024-09-17T18:12:05.444 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../026-librgw2_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:05.483 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librgw2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:05.591 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T18:12:05.615 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:05.658 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:05.744 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T18:12:05.770 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T18:12:05.810 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:12:05.967 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T18:12:05.986 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T18:12:05.993 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:06.012 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T18:12:06.034 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:06.052 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T18:12:06.077 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T18:12:06.093 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:06.105 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T18:12:06.127 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:06.131 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T18:12:06.171 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:12:06.363 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T18:12:06.387 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T18:12:06.390 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:06.413 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T18:12:06.430 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libradosstriper1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:06.457 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T18:12:06.457 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T18:12:06.482 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T18:12:06.521 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T18:12:06.533 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T18:12:06.559 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T18:12:06.599 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T18:12:06.723 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T18:12:06.749 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:06.781 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libradosstriper1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:06.800 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-common. 2024-09-17T18:12:06.824 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T18:12:06.826 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:06.851 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:06.866 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:06.891 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libradosstriper1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:06.961 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librados2. 2024-09-17T18:12:06.987 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../007-librados2_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:07.027 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librados2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:07.184 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-common. 2024-09-17T18:12:07.211 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:07.251 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:07.344 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-common. 2024-09-17T18:12:07.370 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:07.411 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:07.463 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libnbd0. 2024-09-17T18:12:07.489 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-17T18:12:07.521 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-17T18:12:07.833 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librbd1. 2024-09-17T18:12:07.859 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../009-librbd1_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:07.899 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librbd1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:08.346 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-base. 2024-09-17T18:12:08.352 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T18:12:08.373 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:08.378 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:08.419 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:08.422 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-base (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:08.680 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rados. 2024-09-17T18:12:08.695 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:08.706 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-base. 2024-09-17T18:12:08.729 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rados (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:08.733 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:08.782 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-base (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:08.849 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-base. 2024-09-17T18:12:08.875 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:08.925 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-base (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:08.967 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T18:12:08.994 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T18:12:09.007 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T18:12:09.034 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:09.034 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T18:12:09.074 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-argparse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:09.303 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T18:12:09.329 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T18:12:09.343 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T18:12:09.369 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:09.369 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T18:12:09.394 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T18:12:09.418 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cephfs (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:09.421 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T18:12:09.460 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T18:12:09.656 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T18:12:09.680 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T18:12:09.681 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T18:12:09.707 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T18:12:09.719 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T18:12:09.730 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T18:12:09.756 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T18:12:09.757 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T18:12:09.762 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T18:12:09.788 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:09.797 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T18:12:09.829 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:10.005 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T18:12:10.032 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T18:12:10.059 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T18:12:10.072 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T18:12:10.085 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T18:12:10.116 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T18:12:10.125 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T18:12:10.144 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T18:12:10.149 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T18:12:10.175 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T18:12:10.183 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T18:12:10.224 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T18:12:10.403 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T18:12:10.408 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T18:12:10.430 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T18:12:10.435 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T18:12:10.470 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T18:12:10.478 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T18:12:10.497 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T18:12:10.505 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T18:12:10.544 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T18:12:10.551 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T18:12:10.578 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T18:12:10.626 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T18:12:10.722 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T18:12:10.749 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T18:12:10.789 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T18:12:10.803 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T18:12:10.829 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T18:12:10.869 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T18:12:10.947 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T18:12:10.973 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T18:12:11.014 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T18:12:11.079 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T18:12:11.092 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-portend. 2024-09-17T18:12:11.105 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:11.118 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-17T18:12:11.154 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rbd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:11.160 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T18:12:11.172 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T18:12:11.198 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T18:12:11.238 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T18:12:11.317 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T18:12:11.343 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T18:12:11.383 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T18:12:11.461 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T18:12:11.488 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T18:12:11.500 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T18:12:11.526 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T18:12:11.528 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T18:12:11.540 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T18:12:11.558 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T18:12:11.566 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T18:12:11.607 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T18:12:11.628 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-portend. 2024-09-17T18:12:11.643 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-17T18:12:11.678 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T18:12:11.797 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T18:12:11.824 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T18:12:11.836 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-portend. 2024-09-17T18:12:11.856 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T18:12:11.862 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-17T18:12:11.885 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T18:12:11.902 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T18:12:11.911 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T18:12:11.939 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T18:12:11.951 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T18:12:11.965 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T18:12:12.005 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T18:12:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T18:12:12.213 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T18:12:12.228 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T18:12:12.240 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T18:12:12.262 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T18:12:12.267 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T18:12:12.280 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T18:12:12.288 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T18:12:12.308 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T18:12:12.335 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T18:12:12.337 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T18:12:12.375 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T18:12:12.558 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T18:12:12.579 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T18:12:12.584 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T18:12:12.608 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T18:12:12.624 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T18:12:12.645 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T18:12:12.695 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T18:12:12.722 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T18:12:12.749 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package lua5.1. 2024-09-17T18:12:12.762 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T18:12:12.775 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T18:12:12.824 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T18:12:12.881 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T18:12:12.908 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T18:12:12.939 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T18:12:12.986 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T18:12:13.013 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T18:12:13.053 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T18:12:13.098 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T18:12:13.125 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T18:12:13.152 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package lua-any. 2024-09-17T18:12:13.167 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-17T18:12:13.190 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T18:12:13.210 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T18:12:13.242 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-mako. 2024-09-17T18:12:13.269 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T18:12:13.309 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T18:12:13.381 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T18:12:13.407 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T18:12:13.446 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package zip. 2024-09-17T18:12:13.447 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T18:12:13.472 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-17T18:12:13.493 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T18:12:13.513 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T18:12:13.519 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T18:12:13.559 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T18:12:13.645 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T18:12:13.672 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T18:12:13.708 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T18:12:13.712 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T18:12:13.735 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T18:12:13.767 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T18:12:13.821 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-mako. 2024-09-17T18:12:13.847 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T18:12:13.879 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T18:12:13.882 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package unzip. 2024-09-17T18:12:13.908 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T18:12:13.959 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T18:12:14.031 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T18:12:14.058 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T18:12:14.078 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-mako. 2024-09-17T18:12:14.098 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T18:12:14.104 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T18:12:14.144 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T18:12:14.207 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T18:12:14.234 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T18:12:14.274 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T18:12:14.342 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webob. 2024-09-17T18:12:14.355 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package luarocks. 2024-09-17T18:12:14.369 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T18:12:14.381 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T18:12:14.400 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T18:12:14.421 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T18:12:14.481 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T18:12:14.507 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T18:12:14.510 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T18:12:14.525 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T18:12:14.547 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T18:12:14.560 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T18:12:14.703 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T18:12:14.730 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T18:12:14.773 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T18:12:14.846 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librgw2. 2024-09-17T18:12:14.873 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../026-librgw2_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:14.912 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librgw2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:15.231 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T18:12:15.258 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T18:12:15.298 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T18:12:15.523 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T18:12:15.538 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:15.590 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:15.592 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T18:12:15.618 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T18:12:15.658 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T18:12:15.747 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webob. 2024-09-17T18:12:15.774 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T18:12:15.784 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-paste. 2024-09-17T18:12:15.806 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T18:12:15.811 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T18:12:15.909 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T18:12:15.911 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-webob. 2024-09-17T18:12:15.935 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T18:12:15.937 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T18:12:15.977 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T18:12:15.984 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T18:12:16.099 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T18:12:16.127 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T18:12:16.160 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T18:12:16.284 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T18:12:16.321 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T18:12:16.322 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T18:12:16.347 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:16.349 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T18:12:16.387 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libradosstriper1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:16.392 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T18:12:16.469 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T18:12:16.496 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T18:12:16.536 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T18:12:16.658 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T18:12:16.662 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T18:12:16.685 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T18:12:16.689 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T18:12:16.725 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T18:12:16.729 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T18:12:16.839 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-paste. 2024-09-17T18:12:16.857 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-common. 2024-09-17T18:12:16.866 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T18:12:16.884 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:16.908 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T18:12:16.924 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:16.961 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-paste. 2024-09-17T18:12:16.982 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T18:12:16.987 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T18:12:17.008 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T18:12:17.019 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T18:12:17.049 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T18:12:17.167 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T18:12:17.182 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T18:12:17.216 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T18:12:17.351 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T18:12:17.351 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T18:12:17.374 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T18:12:17.378 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T18:12:17.414 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T18:12:17.418 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T18:12:17.513 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T18:12:17.541 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T18:12:17.580 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T18:12:17.716 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T18:12:17.729 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T18:12:17.743 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T18:12:17.755 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T18:12:17.783 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T18:12:17.795 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T18:12:17.883 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T18:12:17.910 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T18:12:17.949 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T18:12:18.086 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T18:12:18.112 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T18:12:18.152 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T18:12:18.167 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T18:12:18.194 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T18:12:18.233 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T18:12:18.235 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T18:12:18.263 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T18:12:18.302 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T18:12:18.396 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-base. 2024-09-17T18:12:18.422 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:18.455 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T18:12:18.471 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-base (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:18.481 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T18:12:18.522 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T18:12:18.536 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-idna. 2024-09-17T18:12:18.563 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T18:12:18.603 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T18:12:18.623 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T18:12:18.647 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T18:12:18.682 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T18:12:18.872 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T18:12:18.893 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T18:12:18.899 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T18:12:18.920 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T18:12:18.930 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T18:12:18.960 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T18:12:18.994 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-idna. 2024-09-17T18:12:19.020 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T18:12:19.042 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T18:12:19.060 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T18:12:19.068 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T18:12:19.108 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T18:12:19.259 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests. 2024-09-17T18:12:19.286 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T18:12:19.287 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-idna. 2024-09-17T18:12:19.314 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T18:12:19.325 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T18:12:19.354 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T18:12:19.371 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T18:12:19.397 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T18:12:19.419 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T18:12:19.437 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T18:12:19.446 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T18:12:19.486 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T18:12:19.637 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T18:12:19.640 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T18:12:19.663 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T18:12:19.667 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T18:12:19.703 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T18:12:19.706 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T18:12:19.758 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests. 2024-09-17T18:12:19.786 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T18:12:19.789 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T18:12:19.804 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T18:12:19.824 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T18:12:19.839 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T18:12:19.981 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T18:12:19.996 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:20.001 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-requests. 2024-09-17T18:12:20.021 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T18:12:20.031 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:20.051 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T18:12:20.135 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T18:12:20.162 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T18:12:20.202 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T18:12:20.354 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T18:12:20.381 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T18:12:20.429 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T18:12:20.497 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T18:12:20.512 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:20.536 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T18:12:20.555 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:20.562 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:20.605 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:20.715 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T18:12:20.730 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:20.765 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:20.888 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T18:12:20.915 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T18:12:20.935 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T18:12:20.955 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T18:12:20.961 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:20.993 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:21.055 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T18:12:21.081 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T18:12:21.167 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T18:12:21.170 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T18:12:21.196 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:21.216 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T18:12:21.236 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:21.243 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T18:12:21.274 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T18:12:21.296 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T18:12:21.322 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T18:12:21.387 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T18:12:21.470 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T18:12:21.496 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T18:12:21.536 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T18:12:21.539 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T18:12:21.566 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T18:12:21.602 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T18:12:21.605 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T18:12:21.629 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:21.669 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:21.673 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T18:12:21.700 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T18:12:21.740 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T18:12:21.839 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T18:12:21.866 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T18:12:21.866 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T18:12:21.893 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T18:12:21.906 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T18:12:21.925 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T18:12:22.055 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T18:12:22.059 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T18:12:22.075 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:22.081 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:22.109 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:22.121 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mon (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:22.167 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-portend. 2024-09-17T18:12:22.182 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-17T18:12:22.217 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T18:12:22.261 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T18:12:22.288 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:22.327 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:22.463 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T18:12:22.489 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:22.520 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T18:12:22.529 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mon (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:22.546 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T18:12:22.587 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T18:12:22.675 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T18:12:22.702 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:22.722 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T18:12:22.733 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-osd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:22.749 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:22.788 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mon (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:22.890 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T18:12:22.916 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T18:12:22.956 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T18:12:23.158 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T18:12:23.185 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:23.224 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-osd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:23.301 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T18:12:23.327 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T18:12:23.334 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T18:12:23.361 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:23.367 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T18:12:23.392 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-osd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:23.679 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T18:12:23.707 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T18:12:23.746 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T18:12:23.795 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph. 2024-09-17T18:12:23.821 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../067-ceph_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:23.861 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:24.040 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T18:12:24.067 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T18:12:24.107 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T18:12:24.180 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T18:12:24.207 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:24.247 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:24.303 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph. 2024-09-17T18:12:24.318 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../067-ceph_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:24.352 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:24.409 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-mako. 2024-09-17T18:12:24.436 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T18:12:24.445 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph. 2024-09-17T18:12:24.461 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../067-ceph_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:24.476 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T18:12:24.503 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:24.592 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T18:12:24.618 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:24.622 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T18:12:24.648 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:24.658 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mds (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:24.688 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:24.788 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T18:12:24.815 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T18:12:24.830 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T18:12:24.846 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T18:12:24.857 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:24.897 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:25.003 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephadm. 2024-09-17T18:12:25.018 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../070-cephadm_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:25.050 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T18:12:25.061 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:25.077 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:25.116 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mds (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:25.157 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T18:12:25.184 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T18:12:25.223 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T18:12:25.355 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T18:12:25.382 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T18:12:25.422 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T18:12:25.484 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T18:12:25.511 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:25.536 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephadm. 2024-09-17T18:12:25.550 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mds (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:25.559 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webob. 2024-09-17T18:12:25.563 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../070-cephadm_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:25.587 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T18:12:25.602 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:25.626 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T18:12:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T18:12:25.708 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T18:12:25.751 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T18:12:25.894 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephadm. 2024-09-17T18:12:25.910 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../070-cephadm_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:25.922 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T18:12:25.944 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:25.949 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T18:12:25.979 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T18:12:26.006 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T18:12:26.049 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T18:12:26.155 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T18:12:26.255 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T18:12:26.282 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T18:12:26.322 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T18:12:26.391 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T18:12:26.418 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T18:12:26.457 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T18:12:26.458 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T18:12:26.485 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T18:12:26.525 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T18:12:26.591 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T18:12:26.606 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T18:12:26.640 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T18:12:26.735 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-paste. 2024-09-17T18:12:26.752 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T18:12:26.785 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T18:12:26.814 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-babel. 2024-09-17T18:12:26.842 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T18:12:26.881 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T18:12:27.113 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T18:12:27.129 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T18:12:27.171 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T18:12:27.192 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T18:12:27.220 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T18:12:27.259 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T18:12:27.449 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T18:12:27.476 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T18:12:27.479 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-babel. 2024-09-17T18:12:27.507 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T18:12:27.515 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T18:12:27.554 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T18:12:27.620 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T18:12:27.629 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-babel. 2024-09-17T18:12:27.648 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:27.656 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T18:12:27.687 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:27.695 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T18:12:27.794 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T18:12:27.821 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T18:12:27.860 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T18:12:27.882 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T18:12:27.909 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T18:12:27.949 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T18:12:27.973 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T18:12:28.000 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T18:12:28.024 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T18:12:28.039 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T18:12:28.051 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T18:12:28.090 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T18:12:28.163 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T18:12:28.190 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T18:12:28.230 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T18:12:28.302 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T18:12:28.329 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:28.368 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:28.376 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-routes. 2024-09-17T18:12:28.378 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T18:12:28.403 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T18:12:28.405 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:28.435 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T18:12:28.444 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:28.593 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T18:12:28.620 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T18:12:28.659 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T18:12:28.722 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T18:12:28.746 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T18:12:28.749 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T18:12:28.773 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:28.781 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T18:12:28.788 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T18:12:28.808 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T18:12:28.813 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:28.847 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T18:12:29.004 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-idna. 2024-09-17T18:12:29.031 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T18:12:29.071 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T18:12:29.091 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-routes. 2024-09-17T18:12:29.118 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T18:12:29.142 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-routes. 2024-09-17T18:12:29.157 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T18:12:29.168 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T18:12:29.208 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T18:12:29.373 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T18:12:29.400 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T18:12:29.432 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T18:12:29.486 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T18:12:29.513 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:29.537 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T18:12:29.550 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:29.569 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:29.586 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:29.727 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-requests. 2024-09-17T18:12:29.754 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T18:12:29.785 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T18:12:30.096 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T18:12:30.123 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T18:12:30.163 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T18:12:30.466 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T18:12:30.492 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:30.532 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:30.929 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T18:12:30.956 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:30.996 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:31.315 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T18:12:31.342 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T18:12:31.381 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T18:12:31.577 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T18:12:31.607 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T18:12:31.652 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T18:12:31.843 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T18:12:31.869 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T18:12:31.909 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T18:12:32.139 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T18:12:32.166 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T18:12:32.205 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T18:12:32.225 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T18:12:32.254 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T18:12:32.255 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T18:12:32.266 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T18:12:32.280 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T18:12:32.281 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:32.299 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T18:12:32.320 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:32.324 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T18:12:32.600 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T18:12:32.628 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T18:12:32.666 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T18:12:32.724 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T18:12:32.751 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:32.769 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T18:12:32.790 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mon (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:32.796 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T18:12:32.827 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T18:12:32.845 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T18:12:32.872 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T18:12:32.911 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T18:12:32.928 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T18:12:32.955 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T18:12:33.072 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T18:12:33.198 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T18:12:33.225 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T18:12:33.264 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T18:12:33.281 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T18:12:33.309 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T18:12:33.347 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T18:12:33.352 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T18:12:33.379 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:33.418 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-osd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:33.567 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T18:12:33.595 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T18:12:33.633 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T18:12:33.661 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T18:12:33.736 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T18:12:33.765 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T18:12:33.792 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:33.802 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T18:12:33.822 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:34.378 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T18:12:34.395 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:34.428 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:34.478 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T18:12:34.494 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:34.513 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph. 2024-09-17T18:12:34.536 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:34.540 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../067-ceph_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:34.580 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:34.767 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T18:12:34.795 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T18:12:34.834 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T18:12:34.891 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T18:12:34.917 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:34.957 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:35.145 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T18:12:35.173 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T18:12:35.212 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T18:12:35.327 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T18:12:35.354 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:35.385 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mds (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:35.415 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T18:12:35.443 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T18:12:35.481 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T18:12:35.514 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T18:12:35.515 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T18:12:35.531 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T18:12:35.542 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T18:12:35.565 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T18:12:35.745 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T18:12:35.784 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T18:12:35.788 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephadm. 2024-09-17T18:12:35.812 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T18:12:35.815 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../070-cephadm_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:35.851 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T18:12:35.855 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:36.010 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T18:12:36.038 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-17T18:12:36.084 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T18:12:36.111 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T18:12:36.112 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T18:12:36.150 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T18:12:36.183 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T18:12:36.210 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T18:12:36.249 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T18:12:36.363 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T18:12:36.391 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T18:12:36.429 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T18:12:36.495 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T18:12:36.523 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T18:12:36.562 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T18:12:36.585 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T18:12:36.585 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T18:12:36.591 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T18:12:36.592 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T18:12:36.626 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T18:12:36.630 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T18:12:36.873 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T18:12:36.901 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-17T18:12:36.916 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T18:12:36.932 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-17T18:12:36.939 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T18:12:36.950 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T18:12:36.974 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T18:12:36.978 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T18:12:37.017 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T18:12:37.260 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T18:12:37.261 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T18:12:37.287 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T18:12:37.289 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T18:12:37.318 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T18:12:37.327 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T18:12:37.361 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T18:12:37.389 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T18:12:37.428 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T18:12:37.606 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T18:12:37.613 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T18:12:37.622 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T18:12:37.640 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-babel. 2024-09-17T18:12:37.640 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T18:12:37.655 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T18:12:37.667 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T18:12:37.679 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T18:12:37.706 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T18:12:37.714 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T18:12:37.742 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T18:12:37.773 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T18:12:37.983 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T18:12:37.990 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T18:12:38.011 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T18:12:38.018 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T18:12:38.050 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T18:12:38.057 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T18:12:38.093 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T18:12:38.119 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T18:12:38.167 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T18:12:38.360 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T18:12:38.362 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T18:12:38.388 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T18:12:38.389 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T18:12:38.428 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T18:12:38.435 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T18:12:38.445 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T18:12:38.473 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:38.503 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:38.579 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T18:12:38.606 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:38.645 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:38.831 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T18:12:38.859 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T18:12:38.898 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T18:12:39.066 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T18:12:39.082 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T18:12:39.092 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T18:12:39.100 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T18:12:39.112 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:39.117 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:39.140 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T18:12:39.148 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:39.159 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:39.234 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T18:12:39.262 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T18:12:39.300 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T18:12:39.420 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T18:12:39.448 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T18:12:39.451 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-routes. 2024-09-17T18:12:39.468 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T18:12:39.478 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T18:12:39.486 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T18:12:39.496 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T18:12:39.509 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T18:12:39.528 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package jq. 2024-09-17T18:12:39.534 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T18:12:39.544 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T18:12:39.578 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T18:12:39.806 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package socat. 2024-09-17T18:12:39.813 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T18:12:39.822 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T18:12:39.822 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T18:12:39.831 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T18:12:39.840 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T18:12:39.849 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:39.859 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T18:12:39.864 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T18:12:39.871 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T18:12:39.879 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:39.898 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T18:12:40.123 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package jq. 2024-09-17T18:12:40.152 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T18:12:40.159 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package jq. 2024-09-17T18:12:40.167 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T18:12:40.175 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T18:12:40.183 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T18:12:40.190 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T18:12:40.217 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T18:12:40.225 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T18:12:40.445 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package socat. 2024-09-17T18:12:40.461 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T18:12:40.484 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package socat. 2024-09-17T18:12:40.494 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T18:12:40.512 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T18:12:40.547 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-test. 2024-09-17T18:12:40.551 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T18:12:40.576 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:40.613 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-test (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:40.781 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T18:12:40.797 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T18:12:40.839 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T18:12:40.862 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T18:12:40.879 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T18:12:40.921 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T18:12:41.211 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-test. 2024-09-17T18:12:41.238 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:41.277 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-test (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:41.358 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-test. 2024-09-17T18:12:41.374 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:41.416 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-test (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:42.843 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T18:12:42.843 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T18:12:42.870 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:42.872 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T18:12:42.909 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-volume (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:42.910 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T18:12:43.213 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T18:12:43.229 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:43.271 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs-dev (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:43.396 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T18:12:43.420 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T18:12:43.454 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T18:12:43.481 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T18:12:43.498 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:43.539 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-volume (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:43.574 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T18:12:43.602 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T18:12:43.604 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T18:12:43.633 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:43.640 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T18:12:43.670 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-volume (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:43.819 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T18:12:43.841 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T18:12:43.846 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:43.869 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T18:12:43.876 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs-dev (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:43.907 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T18:12:43.954 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T18:12:43.982 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T18:12:43.982 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T18:12:43.999 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:44.020 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T18:12:44.041 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libcephfs-dev (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:44.171 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T18:12:44.199 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T18:12:44.219 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T18:12:44.237 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T18:12:44.246 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T18:12:44.327 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T18:12:44.343 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T18:12:44.371 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T18:12:44.385 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T18:12:44.408 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T18:12:44.436 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T18:12:44.474 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T18:12:44.567 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T18:12:44.595 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T18:12:44.634 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T18:12:44.665 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T18:12:44.693 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T18:12:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T18:12:44.896 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package pkg-config. 2024-09-17T18:12:44.925 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T18:12:44.954 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T18:12:45.005 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T18:12:45.033 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T18:12:45.071 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T18:12:45.093 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T18:12:45.105 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T18:12:45.121 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T18:12:45.133 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:45.160 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T18:12:45.172 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:45.183 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T18:12:45.211 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T18:12:45.249 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T18:12:45.493 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package pkg-config. 2024-09-17T18:12:45.521 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T18:12:45.559 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T18:12:45.590 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package pkg-config. 2024-09-17T18:12:45.618 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T18:12:45.656 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T18:12:45.669 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T18:12:45.697 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T18:12:45.735 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T18:12:45.804 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T18:12:45.820 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T18:12:45.854 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T18:12:45.917 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T18:12:45.934 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T18:12:45.975 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T18:12:46.005 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T18:12:46.033 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T18:12:46.063 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T18:12:46.100 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T18:12:46.128 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T18:12:46.166 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T18:12:46.316 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T18:12:46.344 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T18:12:46.366 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T18:12:46.382 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T18:12:46.394 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T18:12:46.395 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T18:12:46.424 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T18:12:46.433 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T18:12:46.462 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T18:12:46.469 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T18:12:46.497 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T18:12:46.535 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T18:12:46.685 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T18:12:46.713 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T18:12:46.740 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T18:12:46.745 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T18:12:46.751 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T18:12:46.768 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T18:12:46.772 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T18:12:46.806 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T18:12:46.811 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T18:12:46.881 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T18:12:46.909 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T18:12:46.947 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T18:12:47.030 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T18:12:47.058 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T18:12:47.088 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T18:12:47.126 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T18:12:47.131 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-py. 2024-09-17T18:12:47.154 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T18:12:47.159 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-17T18:12:47.192 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T18:12:47.197 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T18:12:47.259 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T18:12:47.287 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-17T18:12:47.325 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T18:12:47.399 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T18:12:47.427 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T18:12:47.466 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T18:12:47.504 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T18:12:47.517 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T18:12:47.532 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T18:12:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T18:12:47.570 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T18:12:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T18:12:47.595 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T18:12:47.612 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T18:12:47.646 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T18:12:47.769 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-py. 2024-09-17T18:12:47.797 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-17T18:12:47.835 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T18:12:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-py. 2024-09-17T18:12:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-17T18:12:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T18:12:47.974 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T18:12:48.002 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T18:12:48.040 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T18:12:48.063 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T18:12:48.091 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T18:12:48.130 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T18:12:48.164 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T18:12:48.192 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T18:12:48.222 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T18:12:48.259 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T18:12:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T18:12:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T18:12:48.351 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T18:12:48.379 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T18:12:48.418 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T18:12:48.432 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-toml. 2024-09-17T18:12:48.461 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-17T18:12:48.499 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T18:12:48.668 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T18:12:48.696 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T18:12:48.697 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T18:12:48.725 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T18:12:48.734 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T18:12:48.763 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T18:12:48.776 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T18:12:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T18:12:48.805 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T18:12:48.817 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T18:12:48.834 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T18:12:48.855 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T18:12:49.037 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-toml. 2024-09-17T18:12:49.065 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-17T18:12:49.103 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T18:12:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-toml. 2024-09-17T18:12:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-17T18:12:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T18:12:49.222 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T18:12:49.250 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T18:12:49.288 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T18:12:49.398 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T18:12:49.410 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T18:12:49.426 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T18:12:49.426 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:49.464 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T18:12:49.469 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T18:12:49.485 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T18:12:49.518 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T18:12:49.566 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T18:12:49.594 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T18:12:49.632 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T18:12:49.763 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T18:12:49.791 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T18:12:49.809 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T18:12:49.821 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T18:12:49.837 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T18:12:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T18:12:49.866 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T18:12:49.876 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T18:12:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T18:12:50.108 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T18:12:50.135 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T18:12:50.166 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T18:12:50.170 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T18:12:50.182 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T18:12:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T18:12:50.199 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T18:12:50.236 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T18:12:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T18:12:50.295 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package radosgw. 2024-09-17T18:12:50.324 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../117-radosgw_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:50.361 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking radosgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:50.435 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package jq. 2024-09-17T18:12:50.463 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T18:12:50.502 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T18:12:50.755 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package socat. 2024-09-17T18:12:50.782 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T18:12:50.821 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T18:12:50.928 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package radosgw. 2024-09-17T18:12:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../117-radosgw_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:50.986 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking radosgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:51.024 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package radosgw. 2024-09-17T18:12:51.052 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../117-radosgw_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:51.090 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking radosgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:51.133 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T18:12:51.161 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T18:12:51.199 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T18:12:51.223 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T18:12:51.251 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:51.289 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking rbd-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:51.562 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-test. 2024-09-17T18:12:51.577 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:51.727 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-test (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:51.827 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T18:12:51.989 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T18:12:51.993 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T18:12:52.005 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:52.009 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:52.047 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking rbd-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:52.051 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:52.086 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T18:12:52.212 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T18:12:52.343 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T18:12:52.348 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T18:12:52.473 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T18:12:52.594 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T18:12:52.598 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T18:12:52.720 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T18:12:52.724 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T18:12:52.815 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T18:12:52.980 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T18:12:52.982 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T18:12:53.242 INFO:teuthology.orchestra.run.smithi134.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T18:12:53.296 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T18:12:53.314 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T18:12:53.532 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:53.707 INFO:teuthology.orchestra.run.smithi154.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T18:12:53.730 INFO:teuthology.orchestra.run.smithi146.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T18:12:53.768 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:54.007 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user cephadm....done 2024-09-17T18:12:54.022 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:54.100 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T18:12:54.127 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4975-g1889a165-1jammy_all.deb ... 2024-09-17T18:12:54.163 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T18:12:54.166 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-volume (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:54.318 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user cephadm....done 2024-09-17T18:12:54.448 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T18:12:54.469 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T18:12:54.474 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T18:12:54.486 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:12:54.528 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs-dev (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:54.647 INFO:teuthology.orchestra.run.smithi146.stdout:Adding system user cephadm....done 2024-09-17T18:12:54.698 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T18:12:54.751 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T18:12:54.770 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T18:12:54.856 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T18:12:54.884 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T18:12:54.922 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T18:12:54.924 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T18:12:55.002 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T18:12:55.038 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T18:12:55.128 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T18:12:55.184 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T18:12:55.252 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T18:12:55.280 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T18:12:55.289 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T18:12:55.310 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T18:12:55.387 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T18:12:55.407 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T18:12:55.437 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T18:12:55.562 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T18:12:55.631 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T18:12:55.641 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T18:12:55.683 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T18:12:55.710 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T18:12:55.749 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T18:12:55.756 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T18:12:55.864 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T18:12:55.892 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T18:12:56.018 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T18:12:56.058 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T18:12:56.171 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package pkg-config. 2024-09-17T18:12:56.199 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T18:12:56.215 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T18:12:56.237 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T18:12:56.328 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T18:12:56.418 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T18:12:56.442 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T18:12:56.465 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T18:12:56.481 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T18:12:56.515 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T18:12:56.678 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T18:12:56.693 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T18:12:56.697 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T18:12:56.910 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T18:12:56.938 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T18:12:56.945 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T18:12:56.956 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T18:12:56.962 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T18:12:56.976 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T18:12:57.164 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T18:12:57.213 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T18:12:57.225 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T18:12:57.245 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T18:12:57.273 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T18:12:57.311 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T18:12:57.443 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T18:12:57.480 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T18:12:57.711 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T18:12:57.731 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-argparse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:57.732 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T18:12:57.907 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T18:12:57.935 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T18:12:57.953 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T18:12:57.973 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T18:12:57.982 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T18:12:57.999 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T18:12:58.100 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-17T18:12:58.201 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T18:12:58.204 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-ceph-argparse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:58.251 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T18:12:58.279 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T18:12:58.309 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T18:12:58.319 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T18:12:58.322 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-argparse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:12:58.445 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T18:12:58.463 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T18:12:58.590 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-17T18:12:58.637 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-py. 2024-09-17T18:12:58.660 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T18:12:58.664 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-17T18:12:58.703 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T18:12:58.704 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T18:12:58.707 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T18:12:58.786 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-17T18:12:58.808 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T18:12:58.912 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T18:12:58.917 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T18:12:59.030 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T18:12:59.031 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T18:12:59.059 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T18:12:59.072 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T18:12:59.103 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T18:12:59.106 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T18:12:59.150 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T18:12:59.157 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T18:12:59.160 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T18:12:59.259 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T18:12:59.408 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T18:12:59.552 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T18:12:59.558 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T18:12:59.580 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T18:12:59.584 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T18:12:59.601 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T18:12:59.618 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T18:12:59.647 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T18:12:59.728 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T18:12:59.773 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T18:12:59.809 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T18:12:59.840 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T18:12:59.895 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T18:12:59.896 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-toml. 2024-09-17T18:12:59.923 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-17T18:12:59.962 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T18:12:59.995 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T18:13:00.021 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T18:13:00.140 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T18:13:00.241 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T18:13:00.263 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T18:13:00.265 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T18:13:00.293 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T18:13:00.331 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T18:13:00.372 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T18:13:00.484 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T18:13:00.490 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T18:13:00.565 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T18:13:00.635 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T18:13:00.663 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T18:13:00.690 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T18:13:00.701 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T18:13:00.750 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T18:13:00.760 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T18:13:00.970 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T18:13:00.998 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T18:13:01.009 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T18:13:01.037 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T18:13:01.061 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T18:13:01.187 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T18:13:01.318 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T18:13:01.351 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T18:13:01.444 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T18:13:01.602 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T18:13:01.728 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T18:13:01.757 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package radosgw. 2024-09-17T18:13:01.786 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../117-radosgw_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:13:01.824 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking radosgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:01.854 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T18:13:01.856 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T18:13:02.155 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T18:13:02.222 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T18:13:02.266 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T18:13:02.367 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T18:13:02.414 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T18:13:02.468 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T18:13:02.591 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T18:13:02.623 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T18:13:02.693 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T18:13:02.717 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T18:13:02.721 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4975-g1889a165-1jammy_amd64.deb ... 2024-09-17T18:13:02.761 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T18:13:02.761 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking rbd-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:02.882 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T18:13:03.035 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T18:13:03.081 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T18:13:03.161 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T18:13:03.226 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T18:13:03.365 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T18:13:03.395 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T18:13:03.436 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T18:13:03.491 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T18:13:03.510 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T18:13:03.695 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T18:13:03.751 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T18:13:03.789 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T18:13:03.862 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T18:13:04.063 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T18:13:04.075 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T18:13:04.082 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T18:13:04.113 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T18:13:04.239 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:04.348 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T18:13:04.408 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T18:13:04.529 INFO:teuthology.orchestra.run.smithi087.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T18:13:04.540 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T18:13:04.661 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T18:13:04.674 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T18:13:04.769 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:04.833 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T18:13:04.876 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:04.909 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T18:13:05.035 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:05.078 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T18:13:05.336 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T18:13:05.371 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T18:13:05.376 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user cephadm....done 2024-09-17T18:13:05.524 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T18:13:05.662 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T18:13:05.800 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T18:13:05.931 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T18:13:06.051 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T18:13:06.174 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:13:06.177 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T18:13:06.283 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T18:13:06.428 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T18:13:06.526 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T18:13:06.602 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T18:13:06.661 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T18:13:06.696 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T18:13:06.787 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T18:13:06.822 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T18:13:06.828 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:13:06.860 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T18:13:06.946 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T18:13:07.089 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T18:13:07.111 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:13:07.115 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T18:13:07.205 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T18:13:07.237 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T18:13:07.347 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T18:13:07.348 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T18:13:07.450 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T18:13:07.474 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T18:13:07.513 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T18:13:07.599 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:13:07.639 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T18:13:07.708 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T18:13:07.711 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T18:13:07.767 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T18:13:07.978 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T18:13:07.990 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T18:13:08.009 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T18:13:08.017 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T18:13:08.246 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T18:13:08.252 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T18:13:08.252 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:13:08.283 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T18:13:08.353 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T18:13:08.480 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T18:13:08.520 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T18:13:08.535 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T18:13:08.647 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T18:13:08.765 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T18:13:08.779 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T18:13:08.786 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:13:08.906 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T18:13:08.911 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T18:13:09.016 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-argparse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:09.030 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T18:13:09.165 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T18:13:09.213 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T18:13:09.275 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T18:13:09.290 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T18:13:09.401 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-17T18:13:09.416 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T18:13:09.424 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T18:13:09.456 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T18:13:09.527 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T18:13:09.653 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T18:13:09.675 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T18:13:09.700 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T18:13:09.707 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T18:13:09.778 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T18:13:09.809 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T18:13:09.941 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T18:13:09.951 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T18:13:10.038 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T18:13:10.071 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T18:13:10.077 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T18:13:10.192 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T18:13:10.347 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T18:13:10.370 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T18:13:10.421 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T18:13:10.452 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T18:13:10.452 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T18:13:10.498 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T18:13:10.499 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T18:13:10.594 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T18:13:10.608 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T18:13:10.638 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T18:13:10.764 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T18:13:10.791 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T18:13:10.887 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T18:13:10.890 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T18:13:10.976 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T18:13:10.979 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T18:13:10.997 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T18:13:11.092 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T18:13:11.102 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T18:13:11.234 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T18:13:11.281 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T18:13:11.343 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T18:13:11.343 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T18:13:11.386 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T18:13:11.452 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T18:13:11.561 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T18:13:11.591 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T18:13:11.654 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T18:13:11.660 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T18:13:11.713 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T18:13:11.850 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T18:13:11.905 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T18:13:11.955 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T18:13:11.972 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T18:13:11.976 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T18:13:12.031 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T18:13:12.090 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T18:13:12.098 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T18:13:12.102 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T18:13:12.192 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T18:13:12.341 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:13:12.416 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T18:13:12.437 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T18:13:12.442 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T18:13:12.563 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T18:13:12.675 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T18:13:12.751 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T18:13:12.758 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T18:13:12.801 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T18:13:12.965 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T18:13:13.018 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T18:13:13.036 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T18:13:13.044 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:13:13.153 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T18:13:13.233 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T18:13:13.252 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T18:13:13.303 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T18:13:13.351 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T18:13:13.430 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T18:13:13.479 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T18:13:13.585 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:13:13.611 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T18:13:13.697 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T18:13:13.711 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T18:13:13.797 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T18:13:13.912 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T18:13:14.045 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T18:13:14.058 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T18:13:14.073 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T18:13:14.199 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T18:13:14.296 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T18:13:14.318 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T18:13:14.330 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T18:13:14.484 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T18:13:14.564 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T18:13:14.619 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T18:13:14.686 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T18:13:14.749 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T18:13:14.849 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T18:13:14.941 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T18:13:14.963 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T18:13:15.025 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T18:13:15.113 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T18:13:15.217 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T18:13:15.298 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T18:13:15.378 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T18:13:15.399 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librados2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:15.500 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:15.506 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T18:13:15.585 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T18:13:15.609 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T18:13:15.646 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T18:13:15.791 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T18:13:15.836 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T18:13:15.954 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:15.995 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:16.014 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T18:13:16.097 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libradosstriper1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:16.135 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T18:13:16.223 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T18:13:16.236 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librados2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:16.305 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T18:13:16.316 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T18:13:16.354 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:16.480 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T18:13:16.507 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librbd1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:16.630 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T18:13:16.652 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T18:13:16.658 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-modules-core (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:16.776 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:16.777 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librados2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:16.816 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libcephfs2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:16.904 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:16.942 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libradosstriper1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:16.969 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T18:13:16.969 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T18:13:17.030 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T18:13:17.093 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T18:13:17.341 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:17.361 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librbd1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:17.467 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libradosstriper1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:17.471 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-modules-core (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:17.489 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs-dev (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:17.593 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T18:13:17.612 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rados (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:17.622 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:17.746 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librgw2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:17.811 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T18:13:17.835 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T18:13:17.835 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T18:13:17.870 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librbd1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:17.872 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T18:13:18.004 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-modules-core (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:18.063 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:13:18.130 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:18.197 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T18:13:18.290 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libcephfs-dev (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:18.344 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T18:13:18.345 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T18:13:18.416 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rados (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:18.456 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T18:13:18.542 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librgw2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:18.557 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T18:13:18.658 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T18:13:18.668 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T18:13:18.832 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs-dev (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:18.958 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rados (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:18.959 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T18:13:19.084 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librgw2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:19.100 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rbd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:19.210 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up rbd-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:19.211 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T18:13:19.211 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T18:13:19.310 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:19.428 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cephfs (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:19.461 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:13:19.563 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:19.587 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T18:13:19.880 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rbd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:19.888 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T18:13:20.006 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up rbd-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:20.097 INFO:teuthology.orchestra.run.smithi134.stdout:Adding group ceph....done 2024-09-17T18:13:20.132 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:20.140 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T18:13:20.258 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cephfs (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:20.382 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T18:13:20.400 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:20.439 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rbd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:20.465 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user ceph....done 2024-09-17T18:13:20.565 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:20.617 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T18:13:20.633 INFO:teuthology.orchestra.run.smithi134.stdout:Setting system user ceph properties....done 2024-09-17T18:13:20.651 INFO:teuthology.orchestra.run.smithi134.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T18:13:20.691 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:20.787 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T18:13:20.808 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cephfs (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:20.859 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T18:13:20.893 INFO:teuthology.orchestra.run.smithi146.stdout:Adding group ceph....done 2024-09-17T18:13:20.910 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:21.110 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T18:13:21.153 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T18:13:21.177 INFO:teuthology.orchestra.run.smithi146.stdout:Adding system user ceph....done 2024-09-17T18:13:21.236 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T18:13:21.346 INFO:teuthology.orchestra.run.smithi146.stdout:Setting system user ceph properties....done 2024-09-17T18:13:21.362 INFO:teuthology.orchestra.run.smithi146.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T18:13:21.453 INFO:teuthology.orchestra.run.smithi154.stdout:Adding group ceph....done 2024-09-17T18:13:21.500 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T18:13:21.521 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T18:13:21.648 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T18:13:21.655 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-test (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:21.780 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user ceph....done 2024-09-17T18:13:21.781 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up radosgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:21.821 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T18:13:21.914 INFO:teuthology.orchestra.run.smithi154.stdout:Setting system user ceph properties....done 2024-09-17T18:13:21.930 INFO:teuthology.orchestra.run.smithi154.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T18:13:21.948 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T18:13:22.077 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T18:13:22.211 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T18:13:22.211 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T18:13:22.224 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T18:13:22.284 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-test (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:22.409 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T18:13:22.410 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up radosgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:22.467 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T18:13:22.592 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T18:13:22.682 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-base (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:22.718 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T18:13:22.808 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T18:13:22.869 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T18:13:22.869 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T18:13:22.870 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-test (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:22.996 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up radosgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:22.998 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T18:13:23.053 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T18:13:23.179 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T18:13:23.329 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-base (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:23.478 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T18:13:23.478 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T18:13:23.484 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mds (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:23.564 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T18:13:23.681 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T18:13:23.716 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T18:13:23.716 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T18:13:23.832 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T18:13:23.922 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-base (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:23.958 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T18:13:24.122 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mds (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:24.200 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T18:13:24.202 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:24.280 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T18:13:24.326 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T18:13:24.333 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T18:13:24.333 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T18:13:24.421 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T18:13:24.421 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T18:13:24.644 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T18:13:24.758 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mds (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:24.799 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:24.879 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-osd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:24.945 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T18:13:24.980 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T18:13:24.980 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T18:13:25.029 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T18:13:25.029 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T18:13:25.156 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T18:13:25.156 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T18:13:25.221 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T18:13:25.347 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T18:13:25.468 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:25.500 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-osd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:25.613 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:25.614 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T18:13:25.682 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T18:13:25.682 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T18:13:25.731 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:25.787 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T18:13:25.787 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T18:13:25.849 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mon (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:25.968 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T18:13:26.041 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T18:13:26.041 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T18:13:26.161 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-osd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:26.210 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T18:13:26.293 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:26.416 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T18:13:26.417 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T18:13:26.419 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:26.475 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:26.579 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mon (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:26.587 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T18:13:26.601 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:26.702 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-dashboard (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:26.797 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T18:13:26.797 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T18:13:26.853 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-volume (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:26.871 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T18:13:26.929 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:27.030 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:27.190 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mon (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:27.207 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T18:13:27.214 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T18:13:27.296 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:27.317 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librados2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:27.390 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T18:13:27.412 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T18:13:27.413 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T18:13:27.418 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:27.422 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:27.535 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T18:13:27.549 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-dashboard (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:27.691 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-volume (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:27.692 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T18:13:27.871 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:27.907 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:28.014 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libradosstriper1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:28.051 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:28.061 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T18:13:28.149 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T18:13:28.170 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T18:13:28.312 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-dashboard (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:28.323 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T18:13:28.408 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librbd1 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:28.517 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-modules-core (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:28.620 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T18:13:28.698 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-volume (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:28.833 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T18:13:28.833 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T18:13:29.051 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T18:13:29.168 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T18:13:29.321 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T18:13:29.328 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs-dev (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:29.337 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T18:13:29.343 DEBUG:teuthology.parallel:result is None 2024-09-17T18:13:29.448 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T18:13:29.454 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rados (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:29.580 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librgw2 (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:29.706 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T18:13:30.067 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T18:13:30.072 DEBUG:teuthology.parallel:result is None 2024-09-17T18:13:30.430 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T18:13:30.943 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rbd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:31.042 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T18:13:31.047 DEBUG:teuthology.parallel:result is None 2024-09-17T18:13:31.069 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up rbd-fuse (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:31.194 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:31.320 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cephfs (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:31.446 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-common (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:31.939 INFO:teuthology.orchestra.run.smithi087.stdout:Adding group ceph....done 2024-09-17T18:13:32.316 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user ceph....done 2024-09-17T18:13:32.467 INFO:teuthology.orchestra.run.smithi087.stdout:Setting system user ceph properties....done 2024-09-17T18:13:32.480 INFO:teuthology.orchestra.run.smithi087.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T18:13:32.615 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T18:13:32.940 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T18:13:33.405 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-test (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:33.531 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up radosgw (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:34.017 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T18:13:34.018 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T18:13:34.508 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-base (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:34.829 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T18:13:35.310 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mds (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:35.537 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T18:13:35.537 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T18:13:36.013 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:36.230 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T18:13:36.230 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T18:13:36.713 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-osd (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:36.993 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T18:13:36.993 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T18:13:37.472 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:37.599 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:37.733 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mon (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:37.925 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T18:13:37.925 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T18:13:38.401 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-cephadm (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:38.527 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:38.652 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-dashboard (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:38.803 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-volume (19.3.0-4975-g1889a165-1jammy) ... 2024-09-17T18:13:39.164 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T18:13:39.291 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T18:13:39.435 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T18:13:40.494 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T18:13:41.138 INFO:teuthology.orchestra.run.smithi087.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T18:13:41.143 DEBUG:teuthology.parallel:result is None 2024-09-17T18:13:41.144 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T18:13:41.293 DEBUG:teuthology.orchestra.run.smithi087:> dpkg-query -W -f '${Version}' ceph 2024-09-17T18:13:41.313 INFO:teuthology.orchestra.run.smithi087.stdout:19.3.0-4975-g1889a165-1jammy 2024-09-17T18:13:41.313 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4975-g1889a165-1jammy 2024-09-17T18:13:41.314 INFO:teuthology.task.install:The correct ceph version 19.3.0-4975-g1889a165-1jammy is installed. 2024-09-17T18:13:41.315 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T18:13:41.463 DEBUG:teuthology.orchestra.run.smithi134:> dpkg-query -W -f '${Version}' ceph 2024-09-17T18:13:41.482 INFO:teuthology.orchestra.run.smithi134.stdout:19.3.0-4975-g1889a165-1jammy 2024-09-17T18:13:41.482 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4975-g1889a165-1jammy 2024-09-17T18:13:41.482 INFO:teuthology.task.install:The correct ceph version 19.3.0-4975-g1889a165-1jammy is installed. 2024-09-17T18:13:41.484 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T18:13:41.621 DEBUG:teuthology.orchestra.run.smithi146:> dpkg-query -W -f '${Version}' ceph 2024-09-17T18:13:41.641 INFO:teuthology.orchestra.run.smithi146.stdout:19.3.0-4975-g1889a165-1jammy 2024-09-17T18:13:41.641 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4975-g1889a165-1jammy 2024-09-17T18:13:41.641 INFO:teuthology.task.install:The correct ceph version 19.3.0-4975-g1889a165-1jammy is installed. 2024-09-17T18:13:41.643 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T18:13:41.782 DEBUG:teuthology.orchestra.run.smithi154:> dpkg-query -W -f '${Version}' ceph 2024-09-17T18:13:41.801 INFO:teuthology.orchestra.run.smithi154.stdout:19.3.0-4975-g1889a165-1jammy 2024-09-17T18:13:41.802 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4975-g1889a165-1jammy 2024-09-17T18:13:41.802 INFO:teuthology.task.install:The correct ceph version 19.3.0-4975-g1889a165-1jammy is installed. 2024-09-17T18:13:41.804 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T18:13:41.804 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:13:41.804 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T18:13:41.819 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:13:41.819 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T18:13:41.833 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:13:41.834 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T18:13:41.848 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:13:41.848 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T18:13:41.861 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T18:13:41.861 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:13:41.862 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T18:13:41.874 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T18:13:41.929 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:13:41.930 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T18:13:41.943 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T18:13:41.997 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:13:41.997 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T18:13:42.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T18:13:42.067 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:13:42.067 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T18:13:42.080 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T18:13:42.134 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T18:13:42.135 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:13:42.135 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T18:13:42.148 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T18:13:42.202 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:13:42.202 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T18:13:42.215 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T18:13:42.269 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:13:42.269 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T18:13:42.283 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T18:13:42.338 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:13:42.338 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T18:13:42.352 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T18:13:42.406 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T18:13:42.406 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:13:42.406 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T18:13:42.420 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T18:13:42.474 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:13:42.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T18:13:42.487 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T18:13:42.541 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:13:42.541 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T18:13:42.555 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T18:13:42.614 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:13:42.614 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T18:13:42.627 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T18:13:42.682 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T18:13:42.764 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T18:13:42.764 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2024-09-17T18:13:42.767 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-09-17T18:13:42.769 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2024-09-17T18:13:42.772 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2024-09-17T18:13:42.785 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T18:13:42.785 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T18:13:42.820 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T18:13:42.823 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T18:13:42.828 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T18:13:42.841 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T18:13:42.841 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T18:13:42.876 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T18:13:42.879 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T18:13:42.881 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T18:13:42.906 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T18:13:42.906 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T18:13:42.907 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228', 'branch': 'wip-bharath10-testing-2024-09-17-1348', 'description': 'rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-stupid} rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'job_id': '7909228', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-bharath10-testing-2024-09-17-1348'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath10-testing-2024-09-17-1348', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}}, 'owner': 'scheduled_skanta@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 3421, 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath10-testing-2024-09-17-1348', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_1889a165b5128787ec693450a3d1c5df5d6dc203/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203', 'targets': {'smithi087.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMT5zFu1EqHqCz5Ft1I2ixE4TSfpvrU9j21Qpg2vub0oVKT8NXtPucTMgwuPXewBLN2F4tjhi1NsNZWJZkflA+s=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUwYvyJLbm8yWhdJ1dOYAC96Q7ifhXlgLAGEWfV/ETSCJmMyNXYcAZYVZ5r0yayliPbbr6jiozg8Sar8A3HE64=', 'smithi146.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL72oPKhr/CAn16r3OdoD4aAiSdPpcPK1gIjl81iKZMZHbpy7Ao+cpLCKAHFjjWq8q+VJOe4fBesC6infFbyZQA=', 'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdAVshsWTl60G2ikF2CYBTWgBRvjdXzCFGC8/vnmL1rIuZJSz9+W1b7A6lTukR15I0QcG10G/GJfz8Yl/LCCYU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203', 'cluster': 'ceph'}}, {'thrashosds': {'aggressive_pg_num_changes': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200}}, {'rados': {'clients': ['client.0'], 'ec_pool': True, 'erasure_code_profile': {'c': 2, 'crush-failure-domain': 'osd', 'k': 4, 'm': 3, 'name': 'shecprofile', 'plugin': 'shec'}, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 400, 'write_append_excl': False}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_15:01:33', 'tube': 'smithi', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T18:13:42.907 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T18:13:42.932 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T18:13:42.934 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T18:13:42.937 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T18:13:42.943 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T18:13:42.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T18:13:42.983 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T18:13:42.985 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T18:13:43.000 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:13:43.000 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T18:13:43.039 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T18:13:43.040 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-09-17T18:13:43.087 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T18:13:43.087 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:43.087 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-09-17T18:13:43.087 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:43.087 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-17 18:07:52.990431825 +0000 2024-09-17T18:13:43.087 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-17 18:07:52.742434041 +0000 2024-09-17T18:13:43.087 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-17 18:07:52.742434041 +0000 2024-09-17T18:13:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-09-17T18:13:43.088 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T18:13:43.141 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-17T18:13:43.141 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-17T18:13:43.141 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000437332 s, 1.2 MB/s 2024-09-17T18:13:43.142 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T18:13:43.197 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-09-17T18:13:43.243 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T18:13:43.243 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:43.243 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-09-17T18:13:43.243 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:43.243 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-17 18:07:53.490427360 +0000 2024-09-17T18:13:43.243 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-17 18:07:53.226429717 +0000 2024-09-17T18:13:43.243 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-17 18:07:53.226429717 +0000 2024-09-17T18:13:43.244 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-09-17T18:13:43.244 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T18:13:43.298 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-17T18:13:43.298 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-17T18:13:43.298 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000452383 s, 1.1 MB/s 2024-09-17T18:13:43.300 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T18:13:43.348 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-09-17T18:13:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T18:13:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:43.398 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-17T18:13:43.398 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:43.398 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-17 18:07:54.010422715 +0000 2024-09-17T18:13:43.398 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-17 18:07:53.754425002 +0000 2024-09-17T18:13:43.398 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-17 18:07:53.754425002 +0000 2024-09-17T18:13:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-09-17T18:13:43.398 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T18:13:43.450 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-17T18:13:43.450 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-17T18:13:43.450 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000383431 s, 1.3 MB/s 2024-09-17T18:13:43.452 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T18:13:43.500 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-09-17T18:13:43.547 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T18:13:43.548 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:43.548 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 919 Links: 1 2024-09-17T18:13:43.548 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:43.548 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-17 18:07:54.510418249 +0000 2024-09-17T18:13:43.548 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-17 18:07:54.234420715 +0000 2024-09-17T18:13:43.548 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-17 18:07:54.234420715 +0000 2024-09-17T18:13:43.548 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-09-17T18:13:43.548 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T18:13:43.601 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-17T18:13:43.601 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-17T18:13:43.601 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000274538 s, 1.9 MB/s 2024-09-17T18:13:43.602 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T18:13:43.652 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-17T18:13:43.652 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:13:43.652 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T18:13:43.658 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T18:13:43.658 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-09-17T18:13:43.707 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T18:13:43.707 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:43.707 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-09-17T18:13:43.707 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:43.707 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-17 18:07:58.935535412 +0000 2024-09-17T18:13:43.707 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-17 18:07:58.679537700 +0000 2024-09-17T18:13:43.707 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-17 18:07:58.679537700 +0000 2024-09-17T18:13:43.707 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-09-17T18:13:43.708 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T18:13:43.761 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-17T18:13:43.761 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-17T18:13:43.761 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000371481 s, 1.4 MB/s 2024-09-17T18:13:43.763 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T18:13:43.812 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-09-17T18:13:43.859 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T18:13:43.859 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:43.859 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-09-17T18:13:43.859 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:43.859 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-17 18:07:59.475530590 +0000 2024-09-17T18:13:43.859 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-17 18:07:59.187533162 +0000 2024-09-17T18:13:43.859 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-17 18:07:59.187533162 +0000 2024-09-17T18:13:43.859 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-09-17T18:13:43.859 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T18:13:43.912 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-17T18:13:43.912 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-17T18:13:43.912 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000370303 s, 1.4 MB/s 2024-09-17T18:13:43.913 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T18:13:43.964 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-09-17T18:13:44.010 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T18:13:44.010 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:44.010 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-09-17T18:13:44.010 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:44.012 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-17 18:07:59.951526338 +0000 2024-09-17T18:13:44.012 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-17 18:07:59.699528589 +0000 2024-09-17T18:13:44.012 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-17 18:07:59.699528589 +0000 2024-09-17T18:13:44.012 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-09-17T18:13:44.012 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T18:13:44.065 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-17T18:13:44.065 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-17T18:13:44.065 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00041368 s, 1.2 MB/s 2024-09-17T18:13:44.066 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T18:13:44.116 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-09-17T18:13:44.162 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T18:13:44.162 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:44.162 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-09-17T18:13:44.163 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:44.163 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-17 18:08:00.459521800 +0000 2024-09-17T18:13:44.163 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-17 18:08:00.187524230 +0000 2024-09-17T18:13:44.163 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-17 18:08:00.187524230 +0000 2024-09-17T18:13:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-09-17T18:13:44.163 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T18:13:44.216 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-17T18:13:44.216 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-17T18:13:44.216 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00033683 s, 1.5 MB/s 2024-09-17T18:13:44.217 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T18:13:44.268 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-17T18:13:44.268 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:13:44.268 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T18:13:44.274 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T18:13:44.274 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2024-09-17T18:13:44.319 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T18:13:44.320 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:44.320 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-09-17T18:13:44.320 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:44.320 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-17 18:08:00.354584769 +0000 2024-09-17T18:13:44.320 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-17 18:08:00.350584805 +0000 2024-09-17T18:13:44.320 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-17 18:08:00.350584805 +0000 2024-09-17T18:13:44.320 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2024-09-17T18:13:44.320 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T18:13:44.374 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T18:13:44.374 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T18:13:44.374 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000412087 s, 1.2 MB/s 2024-09-17T18:13:44.375 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T18:13:44.428 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2024-09-17T18:13:44.475 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T18:13:44.475 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:44.475 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-09-17T18:13:44.475 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:44.475 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-17 18:08:01.082578267 +0000 2024-09-17T18:13:44.476 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-17 18:08:00.846580375 +0000 2024-09-17T18:13:44.476 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-17 18:08:00.846580375 +0000 2024-09-17T18:13:44.476 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2024-09-17T18:13:44.476 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T18:13:44.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T18:13:44.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T18:13:44.530 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.00041815 s, 1.2 MB/s 2024-09-17T18:13:44.531 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T18:13:44.580 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2024-09-17T18:13:44.629 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T18:13:44.629 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:44.629 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-09-17T18:13:44.629 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:44.629 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-17 18:08:01.542574157 +0000 2024-09-17T18:13:44.629 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-17 18:08:01.326576087 +0000 2024-09-17T18:13:44.630 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-17 18:08:01.326576087 +0000 2024-09-17T18:13:44.630 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2024-09-17T18:13:44.630 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T18:13:44.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T18:13:44.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T18:13:44.682 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000394527 s, 1.3 MB/s 2024-09-17T18:13:44.684 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T18:13:44.732 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2024-09-17T18:13:44.779 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T18:13:44.779 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:44.779 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 931 Links: 1 2024-09-17T18:13:44.779 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:44.779 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-17 18:08:02.034569763 +0000 2024-09-17T18:13:44.779 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-17 18:08:01.794571907 +0000 2024-09-17T18:13:44.780 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-17 18:08:01.794571907 +0000 2024-09-17T18:13:44.780 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2024-09-17T18:13:44.780 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T18:13:44.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T18:13:44.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T18:13:44.834 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000323023 s, 1.6 MB/s 2024-09-17T18:13:44.835 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T18:13:44.884 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-17T18:13:44.884 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:13:44.884 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T18:13:44.891 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T18:13:44.891 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-09-17T18:13:44.940 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T18:13:44.940 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:44.940 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 870 Links: 1 2024-09-17T18:13:44.940 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:44.940 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-17 18:07:59.746409127 +0000 2024-09-17T18:13:44.940 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-17 18:07:59.494411374 +0000 2024-09-17T18:13:44.940 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-17 18:07:59.494411374 +0000 2024-09-17T18:13:44.940 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-17T18:13:44.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T18:13:44.995 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-17T18:13:44.995 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-17T18:13:44.995 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000399616 s, 1.3 MB/s 2024-09-17T18:13:44.996 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T18:13:45.045 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-09-17T18:13:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T18:13:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:45.091 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-09-17T18:13:45.092 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:45.092 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-17 18:08:00.214404953 +0000 2024-09-17T18:13:45.092 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-17 18:07:59.986406986 +0000 2024-09-17T18:13:45.092 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-17 18:07:59.986406986 +0000 2024-09-17T18:13:45.092 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-17T18:13:45.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T18:13:45.145 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-17T18:13:45.145 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-17T18:13:45.145 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000313364 s, 1.6 MB/s 2024-09-17T18:13:45.147 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T18:13:45.198 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-09-17T18:13:45.244 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T18:13:45.244 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:45.244 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-17T18:13:45.244 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:45.244 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-17 18:08:00.686400743 +0000 2024-09-17T18:13:45.244 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-17 18:08:00.462402741 +0000 2024-09-17T18:13:45.244 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-17 18:08:00.462402741 +0000 2024-09-17T18:13:45.244 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-17T18:13:45.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T18:13:45.298 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-17T18:13:45.298 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-17T18:13:45.298 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000422407 s, 1.2 MB/s 2024-09-17T18:13:45.299 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T18:13:45.348 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-09-17T18:13:45.399 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T18:13:45.399 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T18:13:45.399 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-09-17T18:13:45.400 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T18:13:45.400 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-17 18:08:01.174396391 +0000 2024-09-17T18:13:45.400 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-17 18:08:00.938398495 +0000 2024-09-17T18:13:45.400 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-17 18:08:00.938398495 +0000 2024-09-17T18:13:45.400 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-17T18:13:45.400 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T18:13:45.454 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-17T18:13:45.454 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-17T18:13:45.454 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000388098 s, 1.3 MB/s 2024-09-17T18:13:45.455 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T18:13:45.505 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-17T18:13:45.505 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2024-09-17T18:13:45.505 INFO:tasks.ceph:Generating config... 2024-09-17T18:13:45.506 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-17T18:13:45.506 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-17T18:13:45.506 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-17T18:13:45.507 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2024-09-17T18:13:45.507 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T18:13:45.507 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T18:13:45.507 INFO:tasks.ceph:[osd] bluestore write v2 = False 2024-09-17T18:13:45.507 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-09-17T18:13:45.507 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-17T18:13:45.507 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-17T18:13:45.507 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T18:13:45.507 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T18:13:45.507 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-17T18:13:45.507 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T18:13:45.507 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T18:13:45.507 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T18:13:45.508 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-17T18:13:45.508 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2024-09-17T18:13:45.508 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-09-17T18:13:45.508 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-09-17T18:13:45.508 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T18:13:45.508 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-09-17T18:13:45.508 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-17T18:13:45.508 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-09-17T18:13:45.508 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-09-17T18:13:45.508 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T18:13:45.508 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-09-17T18:13:45.508 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-09-17T18:13:45.508 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-09-17T18:13:45.509 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-09-17T18:13:45.509 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-17T18:13:45.509 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-17T18:13:45.509 INFO:tasks.ceph:[global] mon election default strategy = 1 2024-09-17T18:13:45.509 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2024-09-17T18:13:45.509 INFO:tasks.ceph:[global] ms tcp read timeout = 5 2024-09-17T18:13:45.509 INFO:tasks.ceph:[global] osd_recovery_max_active = 10 2024-09-17T18:13:45.509 INFO:tasks.ceph:[global] osd_recovery_max_single_start = 10 2024-09-17T18:13:45.509 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T18:13:45.509 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T18:13:45.509 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T18:13:45.509 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T18:13:45.510 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T18:13:45.510 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-09-17T18:13:45.510 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T18:13:45.510 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T18:13:45.544 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T18:13:45.561 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T18:13:45.638 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T18:13:45.693 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.87'), ('mon.b', '172.21.15.134'), ('mon.c', '172.21.15.146')] 2024-09-17T18:13:45.694 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.87,172.21.15.134,172.21.15.146', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2024-09-17T18:13:45.694 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:13:45.695 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T18:13:45.739 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.87 --add b 172.21.15.134 --add c 172.21.15.146 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:13:45.826 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:13:45.827 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: generated fsid 61bbf164-0ac7-4613-95ea-b1c3bf551ccb 2024-09-17T18:13:45.827 INFO:teuthology.orchestra.run.smithi087.stdout:setting min_mon_release = quincy 2024-09-17T18:13:45.827 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 0 2024-09-17T18:13:45.827 INFO:teuthology.orchestra.run.smithi087.stdout:fsid 61bbf164-0ac7-4613-95ea-b1c3bf551ccb 2024-09-17T18:13:45.827 INFO:teuthology.orchestra.run.smithi087.stdout:last_changed 2024-09-17T18:13:45.827158+0000 2024-09-17T18:13:45.827 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T18:13:45.827158+0000 2024-09-17T18:13:45.827 INFO:teuthology.orchestra.run.smithi087.stdout:min_mon_release 17 (quincy) 2024-09-17T18:13:45.827 INFO:teuthology.orchestra.run.smithi087.stdout:election_strategy: 1 2024-09-17T18:13:45.827 INFO:teuthology.orchestra.run.smithi087.stdout:0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2024-09-17T18:13:45.827 INFO:teuthology.orchestra.run.smithi087.stdout:1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-09-17T18:13:45.827 INFO:teuthology.orchestra.run.smithi087.stdout:2: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.c 2024-09-17T18:13:45.828 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T18:13:45.829 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T18:13:45.874 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 61bbf164-0ac7-4613-95ea-b1c3bf551ccb... 2024-09-17T18:13:45.875 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T18:13:45.920 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T18:13:45.922 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T18:13:45.925 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T18:13:45.949 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-09-17T18:13:45.949 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2024-09-17T18:13:45.949 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T18:13:45.949 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2024-09-17T18:13:45.949 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.950 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2024-09-17T18:13:45.950 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.950 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2024-09-17T18:13:45.950 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.950 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2024-09-17T18:13:45.950 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2024-09-17T18:13:45.950 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.950 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2024-09-17T18:13:45.950 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2024-09-17T18:13:45.950 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.950 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T18:13:45.950 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2024-09-17T18:13:45.950 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.950 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T18:13:45.951 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T18:13:45.951 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.951 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2024-09-17T18:13:45.951 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.951 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2024-09-17T18:13:45.951 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2024-09-17T18:13:45.951 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2024-09-17T18:13:45.951 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2024-09-17T18:13:45.951 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2024-09-17T18:13:45.951 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2024-09-17T18:13:45.951 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2024-09-17T18:13:45.951 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T18:13:45.951 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T18:13:45.952 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2024-09-17T18:13:45.952 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.952 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T18:13:45.952 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.952 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2024-09-17T18:13:45.952 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.952 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2024-09-17T18:13:45.952 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.952 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2024-09-17T18:13:45.952 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2024-09-17T18:13:45.953 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2024-09-17T18:13:45.953 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.87,172.21.15.134,172.21.15.146" 2024-09-17T18:13:45.953 INFO:teuthology.orchestra.run.smithi087.stdout: mon client directed command retry = 5 2024-09-17T18:13:45.953 INFO:teuthology.orchestra.run.smithi087.stdout: mon election default strategy = 1 2024-09-17T18:13:45.953 INFO:teuthology.orchestra.run.smithi087.stdout: ms inject socket failures = 2500 2024-09-17T18:13:45.953 INFO:teuthology.orchestra.run.smithi087.stdout: ms tcp read timeout = 5 2024-09-17T18:13:45.953 INFO:teuthology.orchestra.run.smithi087.stdout: osd_recovery_max_active = 10 2024-09-17T18:13:45.953 INFO:teuthology.orchestra.run.smithi087.stdout: osd_recovery_max_single_start = 10 2024-09-17T18:13:45.953 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 61bbf164-0ac7-4613-95ea-b1c3bf551ccb 2024-09-17T18:13:45.954 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.954 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2024-09-17T18:13:45.954 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2024-09-17T18:13:45.954 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.954 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2024-09-17T18:13:45.954 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 120 2024-09-17T18:13:45.954 INFO:teuthology.orchestra.run.smithi087.stdout: osd mclock profile = high_recovery_ops 2024-09-17T18:13:45.954 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.954 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2024-09-17T18:13:45.954 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2024-09-17T18:13:45.954 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.954 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2024-09-17T18:13:45.955 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2024-09-17T18:13:45.955 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2024-09-17T18:13:45.955 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug trim objects = true 2024-09-17T18:13:45.955 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.955 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2024-09-17T18:13:45.955 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2024-09-17T18:13:45.955 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.955 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2024-09-17T18:13:45.955 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.955 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2024-09-17T18:13:45.955 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.955 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2024-09-17T18:13:45.955 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.956 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2024-09-17T18:13:45.956 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2024-09-17T18:13:45.956 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.956 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2024-09-17T18:13:45.956 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2024-09-17T18:13:45.956 INFO:teuthology.orchestra.run.smithi087.stdout: debug monc = 20 2024-09-17T18:13:45.956 INFO:teuthology.orchestra.run.smithi087.stdout: bdev async discard = True 2024-09-17T18:13:45.956 INFO:teuthology.orchestra.run.smithi087.stdout: bdev enable discard = True 2024-09-17T18:13:45.956 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore allocator = stupid 2024-09-17T18:13:45.956 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2024-09-17T18:13:45.956 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2024-09-17T18:13:45.956 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore write v2 = False 2024-09-17T18:13:45.957 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore zero block detection = True 2024-09-17T18:13:45.957 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 20 2024-09-17T18:13:45.957 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 20 2024-09-17T18:13:45.957 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-09-17T18:13:45.957 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2024-09-17T18:13:45.957 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 10 2024-09-17T18:13:45.957 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T18:13:45.957 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2024-09-17T18:13:45.957 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2024-09-17T18:13:45.957 INFO:teuthology.orchestra.run.smithi087.stdout: osd blocked scrub grace period = 3600 2024-09-17T18:13:45.957 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug reject backfill probability = 0.3 2024-09-17T18:13:45.957 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify cached snaps = True 2024-09-17T18:13:45.957 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify missing on start = True 2024-09-17T18:13:45.958 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2024-09-17T18:13:45.958 INFO:teuthology.orchestra.run.smithi087.stdout: osd max backfills = 3 2024-09-17T18:13:45.958 INFO:teuthology.orchestra.run.smithi087.stdout: osd max markdown count = 1000 2024-09-17T18:13:45.958 INFO:teuthology.orchestra.run.smithi087.stdout: osd mclock override recovery settings = True 2024-09-17T18:13:45.958 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2024-09-17T18:13:45.958 INFO:teuthology.orchestra.run.smithi087.stdout: osd op queue = debug_random 2024-09-17T18:13:45.958 INFO:teuthology.orchestra.run.smithi087.stdout: osd op queue cut off = debug_random 2024-09-17T18:13:45.958 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub min interval = 60 2024-09-17T18:13:45.958 INFO:teuthology.orchestra.run.smithi087.stdout: osd shutdown pgref assert = True 2024-09-17T18:13:45.958 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.958 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2024-09-17T18:13:45.958 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-09-17T18:13:45.958 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2024-09-17T18:13:45.959 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-09-17T18:13:45.959 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-09-17T18:13:45.959 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-09-17T18:13:45.959 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-09-17T18:13:45.959 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2024-09-17T18:13:45.959 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.959 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2024-09-17T18:13:45.959 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-09-17T18:13:45.959 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-09-17T18:13:45.959 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2024-09-17T18:13:45.959 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-09-17T18:13:45.959 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2024-09-17T18:13:45.959 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2024-09-17T18:13:45.960 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-09-17T18:13:45.960 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2024-09-17T18:13:45.960 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2024-09-17T18:13:45.960 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-09-17T18:13:45.960 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.960 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T18:13:45.960 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T18:13:45.960 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T18:13:45.960 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.960 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T18:13:45.960 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T18:13:45.960 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T18:13:45.961 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.961 INFO:teuthology.orchestra.run.smithi087.stdout: # 1m isn't quite enough 2024-09-17T18:13:45.961 INFO:teuthology.orchestra.run.smithi087.stdout: mon_down_mkfs_grace = 2m 2024-09-17T18:13:45.961 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.961 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_filestore_osds = false 2024-09-17T18:13:45.961 INFO:teuthology.orchestra.run.smithi087.stdout: mon scrub interval = 300 2024-09-17T18:13:45.961 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:13:45.961 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2024-09-17T18:13:45.961 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2024-09-17T18:13:45.961 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2024-09-17T18:13:45.961 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2024-09-17T18:13:45.961 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T18:13:45.961 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T18:13:45.962 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2024-09-17T18:13:45.962 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2024-09-17T18:13:45.962 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2024-09-17T18:13:45.963 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-09-17T18:13:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-09-17T18:13:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T18:13:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-09-17T18:13:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-09-17T18:13:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-09-17T18:13:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-09-17T18:13:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-09-17T18:13:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-09-17T18:13:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-09-17T18:13:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T18:13:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-09-17T18:13:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T18:13:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T18:13:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-09-17T18:13:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-09-17T18:13:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-09-17T18:13:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-09-17T18:13:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-09-17T18:13:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-09-17T18:13:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-09-17T18:13:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-09-17T18:13:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T18:13:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T18:13:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-09-17T18:13:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T18:13:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-09-17T18:13:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-09-17T18:13:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-09-17T18:13:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-09-17T18:13:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-09-17T18:13:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.87,172.21.15.134,172.21.15.146" 2024-09-17T18:13:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: mon client directed command retry = 5 2024-09-17T18:13:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: mon election default strategy = 1 2024-09-17T18:13:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject socket failures = 2500 2024-09-17T18:13:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: ms tcp read timeout = 5 2024-09-17T18:13:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: osd_recovery_max_active = 10 2024-09-17T18:13:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: osd_recovery_max_single_start = 10 2024-09-17T18:13:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 61bbf164-0ac7-4613-95ea-b1c3bf551ccb 2024-09-17T18:13:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.968 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-09-17T18:13:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-09-17T18:13:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-09-17T18:13:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 120 2024-09-17T18:13:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-09-17T18:13:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-09-17T18:13:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-09-17T18:13:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-09-17T18:13:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-09-17T18:13:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-09-17T18:13:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2024-09-17T18:13:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-09-17T18:13:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-09-17T18:13:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-09-17T18:13:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-09-17T18:13:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-09-17T18:13:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-09-17T18:13:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-09-17T18:13:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-09-17T18:13:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-09-17T18:13:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: debug monc = 20 2024-09-17T18:13:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2024-09-17T18:13:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2024-09-17T18:13:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = stupid 2024-09-17T18:13:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-09-17T18:13:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-09-17T18:13:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore write v2 = False 2024-09-17T18:13:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore zero block detection = True 2024-09-17T18:13:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 20 2024-09-17T18:13:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 20 2024-09-17T18:13:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-17T18:13:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-09-17T18:13:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 10 2024-09-17T18:13:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T18:13:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-09-17T18:13:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-09-17T18:13:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: osd blocked scrub grace period = 3600 2024-09-17T18:13:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug reject backfill probability = 0.3 2024-09-17T18:13:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify cached snaps = True 2024-09-17T18:13:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify missing on start = True 2024-09-17T18:13:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-09-17T18:13:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: osd max backfills = 3 2024-09-17T18:13:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: osd max markdown count = 1000 2024-09-17T18:13:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock override recovery settings = True 2024-09-17T18:13:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-09-17T18:13:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: osd op queue = debug_random 2024-09-17T18:13:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: osd op queue cut off = debug_random 2024-09-17T18:13:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub min interval = 60 2024-09-17T18:13:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: osd shutdown pgref assert = True 2024-09-17T18:13:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.972 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-09-17T18:13:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-17T18:13:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-09-17T18:13:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-09-17T18:13:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-09-17T18:13:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-09-17T18:13:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-09-17T18:13:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-09-17T18:13:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.973 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-09-17T18:13:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-17T18:13:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-09-17T18:13:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-09-17T18:13:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-09-17T18:13:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-09-17T18:13:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-09-17T18:13:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-09-17T18:13:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-09-17T18:13:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-09-17T18:13:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-09-17T18:13:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T18:13:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T18:13:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T18:13:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T18:13:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T18:13:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T18:13:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-09-17T18:13:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-09-17T18:13:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-09-17T18:13:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: mon scrub interval = 300 2024-09-17T18:13:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T18:13:45.975 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-09-17T18:13:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-09-17T18:13:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-09-17T18:13:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-09-17T18:13:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T18:13:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T18:13:45.976 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-09-17T18:13:45.976 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-09-17T18:13:45.976 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-09-17T18:13:45.976 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2024-09-17T18:13:45.976 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2024-09-17T18:13:45.976 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T18:13:45.976 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2024-09-17T18:13:45.976 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.977 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2024-09-17T18:13:45.977 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.977 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2024-09-17T18:13:45.977 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.977 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2024-09-17T18:13:45.977 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2024-09-17T18:13:45.977 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.977 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2024-09-17T18:13:45.977 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2024-09-17T18:13:45.977 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.978 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T18:13:45.978 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2024-09-17T18:13:45.978 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.978 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T18:13:45.978 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T18:13:45.978 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.978 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2024-09-17T18:13:45.978 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.978 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2024-09-17T18:13:45.978 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2024-09-17T18:13:45.978 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2024-09-17T18:13:45.979 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2024-09-17T18:13:45.979 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2024-09-17T18:13:45.979 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2024-09-17T18:13:45.979 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2024-09-17T18:13:45.979 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T18:13:45.979 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T18:13:45.979 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2024-09-17T18:13:45.979 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.979 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T18:13:45.979 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.979 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2024-09-17T18:13:45.979 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.980 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2024-09-17T18:13:45.980 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.980 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2024-09-17T18:13:45.980 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2024-09-17T18:13:45.980 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2024-09-17T18:13:45.980 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.87,172.21.15.134,172.21.15.146" 2024-09-17T18:13:45.980 INFO:teuthology.orchestra.run.smithi146.stdout: mon client directed command retry = 5 2024-09-17T18:13:45.980 INFO:teuthology.orchestra.run.smithi146.stdout: mon election default strategy = 1 2024-09-17T18:13:45.980 INFO:teuthology.orchestra.run.smithi146.stdout: ms inject socket failures = 2500 2024-09-17T18:13:45.980 INFO:teuthology.orchestra.run.smithi146.stdout: ms tcp read timeout = 5 2024-09-17T18:13:45.980 INFO:teuthology.orchestra.run.smithi146.stdout: osd_recovery_max_active = 10 2024-09-17T18:13:45.980 INFO:teuthology.orchestra.run.smithi146.stdout: osd_recovery_max_single_start = 10 2024-09-17T18:13:45.981 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 61bbf164-0ac7-4613-95ea-b1c3bf551ccb 2024-09-17T18:13:45.981 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.981 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2024-09-17T18:13:45.981 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2024-09-17T18:13:45.981 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.981 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2024-09-17T18:13:45.981 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 120 2024-09-17T18:13:45.981 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2024-09-17T18:13:45.981 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.981 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2024-09-17T18:13:45.981 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2024-09-17T18:13:45.981 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.982 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2024-09-17T18:13:45.982 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2024-09-17T18:13:45.982 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2024-09-17T18:13:45.982 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug trim objects = true 2024-09-17T18:13:45.982 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.982 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2024-09-17T18:13:45.982 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2024-09-17T18:13:45.982 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.982 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2024-09-17T18:13:45.982 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.982 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2024-09-17T18:13:45.983 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.983 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2024-09-17T18:13:45.983 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.983 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2024-09-17T18:13:45.983 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2024-09-17T18:13:45.983 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.983 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2024-09-17T18:13:45.983 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2024-09-17T18:13:45.983 INFO:teuthology.orchestra.run.smithi146.stdout: debug monc = 20 2024-09-17T18:13:45.983 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2024-09-17T18:13:45.983 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2024-09-17T18:13:45.983 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = stupid 2024-09-17T18:13:45.983 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2024-09-17T18:13:45.984 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2024-09-17T18:13:45.984 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore write v2 = False 2024-09-17T18:13:45.984 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore zero block detection = True 2024-09-17T18:13:45.984 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 20 2024-09-17T18:13:45.984 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 20 2024-09-17T18:13:45.984 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T18:13:45.984 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2024-09-17T18:13:45.984 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 10 2024-09-17T18:13:45.984 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T18:13:45.984 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2024-09-17T18:13:45.984 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2024-09-17T18:13:45.984 INFO:teuthology.orchestra.run.smithi146.stdout: osd blocked scrub grace period = 3600 2024-09-17T18:13:45.984 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug reject backfill probability = 0.3 2024-09-17T18:13:45.984 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify cached snaps = True 2024-09-17T18:13:45.985 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify missing on start = True 2024-09-17T18:13:45.985 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2024-09-17T18:13:45.985 INFO:teuthology.orchestra.run.smithi146.stdout: osd max backfills = 3 2024-09-17T18:13:45.985 INFO:teuthology.orchestra.run.smithi146.stdout: osd max markdown count = 1000 2024-09-17T18:13:45.985 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock override recovery settings = True 2024-09-17T18:13:45.985 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2024-09-17T18:13:45.985 INFO:teuthology.orchestra.run.smithi146.stdout: osd op queue = debug_random 2024-09-17T18:13:45.985 INFO:teuthology.orchestra.run.smithi146.stdout: osd op queue cut off = debug_random 2024-09-17T18:13:45.985 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub min interval = 60 2024-09-17T18:13:45.985 INFO:teuthology.orchestra.run.smithi146.stdout: osd shutdown pgref assert = True 2024-09-17T18:13:45.985 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.985 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2024-09-17T18:13:45.986 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T18:13:45.986 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2024-09-17T18:13:45.986 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-17T18:13:45.986 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-17T18:13:45.986 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-17T18:13:45.986 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-17T18:13:45.986 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2024-09-17T18:13:45.986 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.986 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2024-09-17T18:13:45.986 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T18:13:45.986 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-17T18:13:45.986 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2024-09-17T18:13:45.986 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-17T18:13:45.986 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2024-09-17T18:13:45.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2024-09-17T18:13:45.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-17T18:13:45.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2024-09-17T18:13:45.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2024-09-17T18:13:45.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-17T18:13:45.987 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.987 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T18:13:45.987 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T18:13:45.987 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T18:13:45.987 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.987 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T18:13:45.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T18:13:45.987 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T18:13:45.987 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.988 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2024-09-17T18:13:45.988 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2024-09-17T18:13:45.988 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.988 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2024-09-17T18:13:45.988 INFO:teuthology.orchestra.run.smithi146.stdout: mon scrub interval = 300 2024-09-17T18:13:45.988 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T18:13:45.988 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2024-09-17T18:13:45.988 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2024-09-17T18:13:45.988 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2024-09-17T18:13:45.988 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2024-09-17T18:13:45.988 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T18:13:45.988 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T18:13:45.989 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2024-09-17T18:13:45.989 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2024-09-17T18:13:45.989 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2024-09-17T18:13:45.990 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-09-17T18:13:45.990 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-09-17T18:13:45.990 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T18:13:45.990 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-09-17T18:13:45.990 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.990 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-09-17T18:13:45.990 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.991 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-09-17T18:13:45.991 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.991 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-09-17T18:13:45.991 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-09-17T18:13:45.991 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.991 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-09-17T18:13:45.991 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-09-17T18:13:45.991 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.991 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T18:13:45.991 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-09-17T18:13:45.991 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.991 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T18:13:45.991 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T18:13:45.992 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.992 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-09-17T18:13:45.992 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.992 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-09-17T18:13:45.992 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-09-17T18:13:45.992 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-09-17T18:13:45.992 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-09-17T18:13:45.992 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-09-17T18:13:45.992 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-09-17T18:13:45.992 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-09-17T18:13:45.992 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T18:13:45.992 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T18:13:45.993 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-09-17T18:13:45.993 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.993 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T18:13:45.993 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.993 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-09-17T18:13:45.993 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.993 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-09-17T18:13:45.993 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.993 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-09-17T18:13:45.993 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-09-17T18:13:45.993 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-09-17T18:13:45.993 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.87,172.21.15.134,172.21.15.146" 2024-09-17T18:13:45.994 INFO:teuthology.orchestra.run.smithi134.stdout: mon client directed command retry = 5 2024-09-17T18:13:45.994 INFO:teuthology.orchestra.run.smithi134.stdout: mon election default strategy = 1 2024-09-17T18:13:45.994 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject socket failures = 2500 2024-09-17T18:13:45.994 INFO:teuthology.orchestra.run.smithi134.stdout: ms tcp read timeout = 5 2024-09-17T18:13:45.994 INFO:teuthology.orchestra.run.smithi134.stdout: osd_recovery_max_active = 10 2024-09-17T18:13:45.994 INFO:teuthology.orchestra.run.smithi134.stdout: osd_recovery_max_single_start = 10 2024-09-17T18:13:45.994 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = 61bbf164-0ac7-4613-95ea-b1c3bf551ccb 2024-09-17T18:13:45.994 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.994 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-09-17T18:13:45.994 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-09-17T18:13:45.994 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.994 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-09-17T18:13:45.995 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 120 2024-09-17T18:13:45.995 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-09-17T18:13:45.995 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.995 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-09-17T18:13:45.995 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-09-17T18:13:45.995 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.995 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-09-17T18:13:45.995 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-09-17T18:13:45.995 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-09-17T18:13:45.995 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug trim objects = true 2024-09-17T18:13:45.995 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.995 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-09-17T18:13:45.995 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-09-17T18:13:45.996 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.996 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-09-17T18:13:45.996 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.996 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-09-17T18:13:45.996 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.996 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-09-17T18:13:45.996 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.996 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-09-17T18:13:45.996 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-09-17T18:13:45.996 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.996 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-09-17T18:13:45.997 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-09-17T18:13:45.997 INFO:teuthology.orchestra.run.smithi134.stdout: debug monc = 20 2024-09-17T18:13:45.997 INFO:teuthology.orchestra.run.smithi134.stdout: bdev async discard = True 2024-09-17T18:13:45.997 INFO:teuthology.orchestra.run.smithi134.stdout: bdev enable discard = True 2024-09-17T18:13:45.997 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore allocator = stupid 2024-09-17T18:13:45.997 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-09-17T18:13:45.997 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-09-17T18:13:45.997 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore write v2 = False 2024-09-17T18:13:45.997 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore zero block detection = True 2024-09-17T18:13:45.997 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 20 2024-09-17T18:13:45.997 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 20 2024-09-17T18:13:45.997 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-17T18:13:45.997 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-09-17T18:13:45.998 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 10 2024-09-17T18:13:45.998 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T18:13:45.998 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-09-17T18:13:45.998 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-09-17T18:13:45.998 INFO:teuthology.orchestra.run.smithi134.stdout: osd blocked scrub grace period = 3600 2024-09-17T18:13:45.998 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug reject backfill probability = 0.3 2024-09-17T18:13:45.998 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify cached snaps = True 2024-09-17T18:13:45.998 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify missing on start = True 2024-09-17T18:13:45.998 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-09-17T18:13:45.998 INFO:teuthology.orchestra.run.smithi134.stdout: osd max backfills = 3 2024-09-17T18:13:45.998 INFO:teuthology.orchestra.run.smithi134.stdout: osd max markdown count = 1000 2024-09-17T18:13:45.998 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock override recovery settings = True 2024-09-17T18:13:45.998 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-09-17T18:13:45.999 INFO:teuthology.orchestra.run.smithi134.stdout: osd op queue = debug_random 2024-09-17T18:13:45.999 INFO:teuthology.orchestra.run.smithi134.stdout: osd op queue cut off = debug_random 2024-09-17T18:13:45.999 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub min interval = 60 2024-09-17T18:13:45.999 INFO:teuthology.orchestra.run.smithi134.stdout: osd shutdown pgref assert = True 2024-09-17T18:13:45.999 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:45.999 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-09-17T18:13:45.999 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-17T18:13:45.999 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-09-17T18:13:45.999 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-17T18:13:45.999 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-17T18:13:45.999 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-17T18:13:45.999 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-17T18:13:45.999 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-09-17T18:13:45.999 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:46.000 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-09-17T18:13:46.000 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-17T18:13:46.000 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-17T18:13:46.000 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-09-17T18:13:46.000 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-17T18:13:46.000 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-09-17T18:13:46.000 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-09-17T18:13:46.000 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-17T18:13:46.000 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-09-17T18:13:46.000 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-09-17T18:13:46.000 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-17T18:13:46.000 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:46.000 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T18:13:46.001 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T18:13:46.001 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T18:13:46.001 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:46.001 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T18:13:46.001 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T18:13:46.001 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T18:13:46.001 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:46.001 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-09-17T18:13:46.001 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-09-17T18:13:46.001 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:46.001 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-09-17T18:13:46.001 INFO:teuthology.orchestra.run.smithi134.stdout: mon scrub interval = 300 2024-09-17T18:13:46.001 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-17T18:13:46.001 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-09-17T18:13:46.002 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-09-17T18:13:46.002 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-09-17T18:13:46.002 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-09-17T18:13:46.002 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T18:13:46.002 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T18:13:46.002 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-09-17T18:13:46.002 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-09-17T18:13:46.002 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-09-17T18:13:46.003 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T18:13:46.003 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T18:13:46.085 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T18:13:46.086 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:13:46.086 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T18:13:46.091 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:13:46.091 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T18:13:46.139 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T18:13:46.139 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:13:46.139 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T18:13:46.139 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T18:13:46.204 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:13:46.205 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:13:46.251 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-09-17T18:13:46.252 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:13:46.252 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T18:13:46.252 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T18:13:46.276 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:13:46.276 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:13:46.323 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T18:13:46.323 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:13:46.323 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T18:13:46.323 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T18:13:46.346 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:13:46.346 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:13:46.395 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T18:13:46.396 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:13:46.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T18:13:46.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T18:13:46.418 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:13:46.418 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:13:46.463 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T18:13:46.464 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T18:13:46.464 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T18:13:46.508 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T18:13:46.511 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T18:13:46.552 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T18:13:46.574 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T18:13:46.575 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T18:13:46.575 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T18:13:46.653 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T18:13:46.664 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T18:13:46.664 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2024-09-17T18:13:46.664 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T18:13:46.677 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-17T18:13:46.677 INFO:tasks.ceph:role: osd.0 2024-09-17T18:13:46.677 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T18:13:46.677 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T18:13:46.739 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:13:46.739 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:13:46.739 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:13:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:13:46.740 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:13:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:13:46.740 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:13:46.740 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:13:46.740 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:13:46.740 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:13:47.195 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-09-17T18:13:47.197 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-09-17T18:13:47.197 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T18:13:47.292 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T18:13:47.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:13:47.302 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:13:47.303 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T18:13:47.356 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-17T18:13:47.357 INFO:tasks.ceph:role: osd.4 2024-09-17T18:13:47.357 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T18:13:47.357 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T18:13:47.418 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:13:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:13:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:13:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:13:47.419 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:13:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:13:47.419 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:13:47.419 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:13:47.419 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:13:47.419 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:13:47.886 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-09-17T18:13:47.888 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-09-17T18:13:47.888 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-09-17T18:13:48.058 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T18:13:48.069 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:13:48.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:13:48.070 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2024-09-17T18:13:48.123 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-17T18:13:48.123 INFO:tasks.ceph:role: osd.8 2024-09-17T18:13:48.123 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T18:13:48.123 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T18:13:48.187 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:13:48.187 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:13:48.187 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:13:48.187 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:13:48.187 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:13:48.187 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:13:48.187 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:13:48.187 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:13:48.187 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:13:48.187 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:13:48.666 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-09-17T18:13:48.668 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-09-17T18:13:48.669 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2024-09-17T18:13:48.809 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2024-09-17T18:13:48.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:13:48.821 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:13:48.821 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2024-09-17T18:13:48.875 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-17T18:13:48.875 INFO:tasks.ceph:role: osd.12 2024-09-17T18:13:48.875 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T18:13:48.875 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T18:13:48.939 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:13:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:13:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:13:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:13:48.939 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:13:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:13:48.939 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:13:48.939 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:13:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:13:48.939 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:13:49.370 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-09-17T18:13:49.372 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-09-17T18:13:49.372 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2024-09-17T18:13:49.468 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2024-09-17T18:13:49.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:13:49.477 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:13:49.478 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:13:49.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:49.585+0000 7ffaa4ad07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T18:13:49.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:49.589+0000 7ffaa4ad07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T18:13:49.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:49.589+0000 7ffaa4ad07c0 -1 bdev(0x559ff842d800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T18:13:49.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:49.589+0000 7ffaa4ad07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T18:13:52.775 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T18:13:52.787 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:13:52.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:52.869+0000 7f4b24c5c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T18:13:52.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:52.869+0000 7f4b24c5c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T18:13:52.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:52.869+0000 7f4b24c5c7c0 -1 bdev(0x5612ac9af800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T18:13:52.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:52.869+0000 7f4b24c5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T18:13:56.030 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T18:13:56.087 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:13:56.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:56.165+0000 7fbb9f2697c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2024-09-17T18:13:56.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:56.165+0000 7fbb9f2697c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2024-09-17T18:13:56.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:56.165+0000 7fbb9f2697c0 -1 bdev(0x5576528e3800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2024-09-17T18:13:56.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:56.165+0000 7fbb9f2697c0 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2024-09-17T18:13:59.331 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2024-09-17T18:13:59.392 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:13:59.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:59.469+0000 7f2d9deab7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2024-09-17T18:13:59.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:59.469+0000 7f2d9deab7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2024-09-17T18:13:59.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:59.469+0000 7f2d9deab7c0 -1 bdev(0x555cf9bfd800 /var/lib/ceph/osd/ceph-12/block) open stat got: (1) Operation not permitted 2024-09-17T18:13:59.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:13:59.469+0000 7f2d9deab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2024-09-17T18:14:02.593 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2024-09-17T18:14:02.647 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T18:14:02.662 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-17T18:14:02.663 INFO:tasks.ceph:role: osd.1 2024-09-17T18:14:02.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-17T18:14:02.663 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T18:14:02.726 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:14:02.726 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:14:02.726 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:14:02.726 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:14:02.726 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:14:02.727 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:14:02.727 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:14:02.727 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:14:02.727 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:14:02.727 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:14:03.211 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-17T18:14:03.213 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-17T18:14:03.213 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-17T18:14:03.333 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T18:14:03.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:14:03.344 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:14:03.344 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T18:14:03.398 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-17T18:14:03.398 INFO:tasks.ceph:role: osd.5 2024-09-17T18:14:03.398 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-17T18:14:03.399 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T18:14:03.465 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:14:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:14:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:14:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:14:03.465 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:14:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:14:03.465 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:14:03.466 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:14:03.466 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:14:03.466 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:14:03.888 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-17T18:14:03.890 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-17T18:14:03.891 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T18:14:03.955 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T18:14:04.006 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:14:04.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:14:04.007 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2024-09-17T18:14:04.060 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-17T18:14:04.060 INFO:tasks.ceph:role: osd.9 2024-09-17T18:14:04.060 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-17T18:14:04.060 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T18:14:04.122 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:14:04.122 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:14:04.122 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:14:04.122 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:14:04.122 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:14:04.122 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:14:04.123 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:14:04.123 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:14:04.123 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:14:04.123 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:14:04.592 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-17T18:14:04.595 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-17T18:14:04.595 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2024-09-17T18:14:04.688 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2024-09-17T18:14:04.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:14:04.699 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:14:04.699 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2024-09-17T18:14:04.752 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-17T18:14:04.752 INFO:tasks.ceph:role: osd.13 2024-09-17T18:14:04.752 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-17T18:14:04.753 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T18:14:04.814 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:14:04.814 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:14:04.814 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:14:04.814 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:14:04.815 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:14:04.815 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:14:04.815 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:14:04.815 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:14:04.815 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:14:04.815 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:14:05.274 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-17T18:14:05.276 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-17T18:14:05.277 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2024-09-17T18:14:05.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2024-09-17T18:14:05.437 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:14:05.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:14:05.438 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:14:05.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:05.559+0000 7f1ea1ac17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T18:14:05.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:05.563+0000 7f1ea1ac17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T18:14:05.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:05.563+0000 7f1ea1ac17c0 -1 bdev(0x559aacedf800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T18:14:05.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:05.563+0000 7f1ea1ac17c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T18:14:08.743 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T18:14:08.758 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:14:08.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:08.839+0000 7fb2df61b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T18:14:08.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:08.843+0000 7fb2df61b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T18:14:08.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:08.843+0000 7fb2df61b7c0 -1 bdev(0x55643bc4f800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T18:14:08.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:08.843+0000 7fb2df61b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T18:14:11.974 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T18:14:12.031 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:14:12.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:12.111+0000 7fb9ea0437c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2024-09-17T18:14:12.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:12.111+0000 7fb9ea0437c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2024-09-17T18:14:12.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:12.111+0000 7fb9ea0437c0 -1 bdev(0x564086f33800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2024-09-17T18:14:12.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:12.115+0000 7fb9ea0437c0 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2024-09-17T18:14:15.256 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2024-09-17T18:14:15.310 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:14:15.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:15.395+0000 7f0cf26fa7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2024-09-17T18:14:15.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:15.395+0000 7f0cf26fa7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2024-09-17T18:14:15.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:15.395+0000 7f0cf26fa7c0 -1 bdev(0x564e0e6b1800 /var/lib/ceph/osd/ceph-13/block) open stat got: (1) Operation not permitted 2024-09-17T18:14:15.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-17T18:14:15.395+0000 7f0cf26fa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2024-09-17T18:14:18.516 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2024-09-17T18:14:18.575 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T18:14:18.589 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-17T18:14:18.590 INFO:tasks.ceph:role: osd.2 2024-09-17T18:14:18.590 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T18:14:18.590 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T18:14:18.651 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:14:18.651 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:14:18.651 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:14:18.651 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:14:18.651 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:14:18.651 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:14:18.652 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:14:18.652 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:14:18.652 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:14:18.652 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:14:19.110 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-17T18:14:19.112 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-17T18:14:19.113 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-17T18:14:19.203 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T18:14:19.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:14:19.213 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:14:19.214 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T18:14:19.265 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-17T18:14:19.265 INFO:tasks.ceph:role: osd.6 2024-09-17T18:14:19.266 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T18:14:19.266 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T18:14:19.327 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:14:19.327 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:14:19.327 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:14:19.327 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:14:19.327 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:14:19.327 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:14:19.327 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:14:19.327 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:14:19.328 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:14:19.328 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:14:19.796 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-17T18:14:19.798 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-17T18:14:19.799 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2024-09-17T18:14:19.970 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T18:14:19.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:14:19.983 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:14:19.984 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2024-09-17T18:14:20.039 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-17T18:14:20.039 INFO:tasks.ceph:role: osd.10 2024-09-17T18:14:20.039 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T18:14:20.039 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T18:14:20.103 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:14:20.103 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:14:20.104 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:14:20.104 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:14:20.104 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:14:20.104 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:14:20.104 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:14:20.104 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:14:20.104 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:14:20.104 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:14:20.573 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-17T18:14:20.575 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-17T18:14:20.575 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2024-09-17T18:14:20.718 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2024-09-17T18:14:20.730 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:14:20.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:14:20.732 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2024-09-17T18:14:20.786 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-17T18:14:20.786 INFO:tasks.ceph:role: osd.14 2024-09-17T18:14:20.786 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T18:14:20.786 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T18:14:20.851 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:14:20.851 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:14:20.851 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:14:20.851 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:14:20.851 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:14:20.851 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:14:20.851 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:14:20.851 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:14:20.851 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:14:20.852 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:14:21.282 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-17T18:14:21.284 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-17T18:14:21.284 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2024-09-17T18:14:21.372 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2024-09-17T18:14:21.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:14:21.384 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:14:21.385 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:14:21.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:21.485+0000 7fc3ccaa57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T18:14:21.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:21.489+0000 7fc3ccaa57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T18:14:21.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:21.489+0000 7fc3ccaa57c0 -1 bdev(0x5578bc741800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T18:14:21.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:21.489+0000 7fc3ccaa57c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T18:14:24.612 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T18:14:24.625 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:14:24.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:24.700+0000 7f73d72bc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T18:14:24.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:24.700+0000 7f73d72bc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T18:14:24.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:24.700+0000 7f73d72bc7c0 -1 bdev(0x557fad319800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T18:14:24.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:24.704+0000 7f73d72bc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T18:14:27.842 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T18:14:27.900 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:14:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:27.976+0000 7fb519f037c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2024-09-17T18:14:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:27.976+0000 7fb519f037c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2024-09-17T18:14:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:27.976+0000 7fb519f037c0 -1 bdev(0x559512d39800 /var/lib/ceph/osd/ceph-10/block) open stat got: (1) Operation not permitted 2024-09-17T18:14:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:27.976+0000 7fb519f037c0 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2024-09-17T18:14:31.107 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2024-09-17T18:14:31.164 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:14:31.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:31.240+0000 7f87bbd537c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2024-09-17T18:14:31.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:31.240+0000 7f87bbd537c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2024-09-17T18:14:31.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:31.240+0000 7f87bbd537c0 -1 bdev(0x5569575db800 /var/lib/ceph/osd/ceph-14/block) open stat got: (1) Operation not permitted 2024-09-17T18:14:31.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T18:14:31.240+0000 7f87bbd537c0 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2024-09-17T18:14:34.369 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2024-09-17T18:14:34.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T18:14:34.437 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-17T18:14:34.437 INFO:tasks.ceph:role: osd.3 2024-09-17T18:14:34.437 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T18:14:34.438 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T18:14:34.499 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:14:34.499 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:14:34.499 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:14:34.499 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:14:34.499 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:14:34.499 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:14:34.500 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:14:34.500 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:14:34.500 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:14:34.500 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:14:34.960 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-17T18:14:34.962 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-17T18:14:34.962 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-09-17T18:14:35.100 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T18:14:35.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:14:35.111 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:14:35.111 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T18:14:35.167 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-17T18:14:35.167 INFO:tasks.ceph:role: osd.7 2024-09-17T18:14:35.167 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T18:14:35.167 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T18:14:35.231 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:14:35.231 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:14:35.231 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:14:35.231 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:14:35.232 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:14:35.232 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:14:35.232 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:14:35.232 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:14:35.232 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:14:35.232 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:14:35.668 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-17T18:14:35.670 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-17T18:14:35.670 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2024-09-17T18:14:35.733 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T18:14:35.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:14:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:14:35.784 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2024-09-17T18:14:35.837 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-17T18:14:35.837 INFO:tasks.ceph:role: osd.11 2024-09-17T18:14:35.837 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T18:14:35.837 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T18:14:35.903 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:14:35.903 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:14:35.904 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:14:35.904 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:14:35.904 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:14:35.904 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:14:35.904 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:14:35.904 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:14:35.904 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:14:35.904 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:14:36.358 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-17T18:14:36.360 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-17T18:14:36.360 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2024-09-17T18:14:36.458 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2024-09-17T18:14:36.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:14:36.468 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:14:36.468 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2024-09-17T18:14:36.527 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-17T18:14:36.527 INFO:tasks.ceph:role: osd.15 2024-09-17T18:14:36.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T18:14:36.527 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T18:14:36.592 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T18:14:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T18:14:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T18:14:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T18:14:36.592 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T18:14:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-17T18:14:36.592 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T18:14:36.592 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T18:14:36.593 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T18:14:36.593 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T18:14:37.048 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-17T18:14:37.053 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-17T18:14:37.053 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2024-09-17T18:14:37.193 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2024-09-17T18:14:37.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:14:37.206 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T18:14:37.206 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:14:37.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:37.314+0000 7f47d13b87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T18:14:37.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:37.318+0000 7f47d13b87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T18:14:37.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:37.318+0000 7f47d13b87c0 -1 bdev(0x559448655800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T18:14:37.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:37.318+0000 7f47d13b87c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T18:14:40.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T18:14:40.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:14:40.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:40.542+0000 7f19133077c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T18:14:40.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:40.542+0000 7f19133077c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T18:14:40.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:40.542+0000 7f19133077c0 -1 bdev(0x55b7fbb29800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T18:14:40.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:40.542+0000 7f19133077c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T18:14:43.705 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T18:14:43.760 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:14:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:43.838+0000 7fbaab32e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2024-09-17T18:14:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:43.838+0000 7fbaab32e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2024-09-17T18:14:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:43.838+0000 7fbaab32e7c0 -1 bdev(0x55922a909800 /var/lib/ceph/osd/ceph-11/block) open stat got: (1) Operation not permitted 2024-09-17T18:14:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:43.838+0000 7fbaab32e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2024-09-17T18:14:46.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2024-09-17T18:14:47.044 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:14:47.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:47.130+0000 7fbff5c8f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2024-09-17T18:14:47.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:47.130+0000 7fbff5c8f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2024-09-17T18:14:47.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:47.130+0000 7fbff5c8f7c0 -1 bdev(0x55811e36f800 /var/lib/ceph/osd/ceph-15/block) open stat got: (1) Operation not permitted 2024-09-17T18:14:47.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T18:14:47.130+0000 7fbff5c8f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2024-09-17T18:14:50.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2024-09-17T18:14:50.307 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T18:14:50.307 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:14:50.308 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T18:14:50.323 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:14:50.323 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T18:14:50.381 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:14:50.381 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T18:14:50.437 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:14:50.438 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2024-09-17T18:14:50.493 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:14:50.493 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2024-09-17T18:14:50.549 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:14:50.549 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T18:14:50.563 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:14:50.563 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T18:14:50.617 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:14:50.617 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2024-09-17T18:14:50.673 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:14:50.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2024-09-17T18:14:50.728 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:14:50.729 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T18:14:50.743 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:14:50.743 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T18:14:50.802 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:14:50.802 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2024-09-17T18:14:50.854 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:14:50.855 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2024-09-17T18:14:50.909 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:14:50.910 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T18:14:50.923 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:14:50.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T18:14:50.979 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:14:50.980 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T18:14:51.034 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:14:51.034 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2024-09-17T18:14:51.086 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:14:51.086 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2024-09-17T18:14:51.138 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:14:51.138 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T18:14:51.183 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T18:14:51.183 DEBUG:teuthology.orchestra.run.smithi087:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T18:14:51.186 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T18:14:51.188 DEBUG:teuthology.orchestra.run.smithi146:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T18:14:51.195 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.y] 2024-09-17T18:14:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDaxulmWY5SHhAAxQNCoschRVAREnw7g4B9Fg== 2024-09-17T18:14:51.196 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.0] 2024-09-17T18:14:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDdxulmHIQvIxAACBDfynfZEjHG+9bJlOQBEQ== 2024-09-17T18:14:51.196 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.4] 2024-09-17T18:14:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDgxulmEz7vMxAAM5kcu5cNJaQjlc26rMoYCQ== 2024-09-17T18:14:51.196 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.8] 2024-09-17T18:14:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDkxulmaEccChAA8FXl2A+2oWBk8LAJEnVE7w== 2024-09-17T18:14:51.196 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.12] 2024-09-17T18:14:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDnxulmU0xEHBAAmqBtcwD85xJyhll75a4znQ== 2024-09-17T18:14:51.196 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.1] 2024-09-17T18:14:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDtxulm6flhIRAA3QgvgL1JTjxB1C2mIyXsEA== 2024-09-17T18:14:51.196 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.5] 2024-09-17T18:14:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDwxulm+rM+MhAAQRUJ/NNAqU/Bf2Rn0FVS4w== 2024-09-17T18:14:51.197 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.9] 2024-09-17T18:14:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQD0xulmNGDXBhAAdLgHvXxTXLkOABP8vwCrGA== 2024-09-17T18:14:51.201 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.13] 2024-09-17T18:14:51.201 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQD3xulmiCyVFxAAug8lVka9ZzKpfGB7OpNi1Q== 2024-09-17T18:14:51.201 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.2] 2024-09-17T18:14:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQD9xulmWDY9HRAA/GLsaCfbhdEqE+rKelFq8Q== 2024-09-17T18:14:51.202 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.6] 2024-09-17T18:14:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAAx+lmHJcZKhAAxLuNMFjvVssslKvckIfZjg== 2024-09-17T18:14:51.202 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.10] 2024-09-17T18:14:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQADx+lmdPKEOhAAPsGnHFoGrDretz2lHFq0FA== 2024-09-17T18:14:51.202 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.14] 2024-09-17T18:14:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAHx+lm/2eeDhAA3Xo7uncobQIRi/qZHUPNnQ== 2024-09-17T18:14:51.202 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.x] 2024-09-17T18:14:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDaxulm4HDtIBAAWgXZXELhyoInr03yWrP26A== 2024-09-17T18:14:51.202 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.3] 2024-09-17T18:14:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQANx+lmU9TwEhAAVLEGQKHxd1X6vvVBJ3hr9A== 2024-09-17T18:14:51.202 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.7] 2024-09-17T18:14:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAQx+lmJsyCIBAAZqHB2E2rAIu4YJ1c/Lyxlg== 2024-09-17T18:14:51.202 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.11] 2024-09-17T18:14:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQATx+lmqiwpMhAAVi6rYn/Y3FdhO/2dCuJuhg== 2024-09-17T18:14:51.203 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.15] 2024-09-17T18:14:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAXx+lmbtTTBxAA73Gq7Ku/XfZiS2ueX/QmVg== 2024-09-17T18:14:51.203 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-09-17T18:14:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDaxulmE4X1JhAAaE0mL1VE+Kj8FWwKASvLAw== 2024-09-17T18:14:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.y] 2024-09-17T18:14:51.205 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDaxulmWY5SHhAAxQNCoschRVAREnw7g4B9Fg== 2024-09-17T18:14:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.0] 2024-09-17T18:14:51.205 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDdxulmHIQvIxAACBDfynfZEjHG+9bJlOQBEQ== 2024-09-17T18:14:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.4] 2024-09-17T18:14:51.205 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDgxulmEz7vMxAAM5kcu5cNJaQjlc26rMoYCQ== 2024-09-17T18:14:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.8] 2024-09-17T18:14:51.206 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDkxulmaEccChAA8FXl2A+2oWBk8LAJEnVE7w== 2024-09-17T18:14:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.12] 2024-09-17T18:14:51.206 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDnxulmU0xEHBAAmqBtcwD85xJyhll75a4znQ== 2024-09-17T18:14:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.1] 2024-09-17T18:14:51.206 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDtxulm6flhIRAA3QgvgL1JTjxB1C2mIyXsEA== 2024-09-17T18:14:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.5] 2024-09-17T18:14:51.206 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDwxulm+rM+MhAAQRUJ/NNAqU/Bf2Rn0FVS4w== 2024-09-17T18:14:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.9] 2024-09-17T18:14:51.206 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQD0xulmNGDXBhAAdLgHvXxTXLkOABP8vwCrGA== 2024-09-17T18:14:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.13] 2024-09-17T18:14:51.206 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQD3xulmiCyVFxAAug8lVka9ZzKpfGB7OpNi1Q== 2024-09-17T18:14:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.2] 2024-09-17T18:14:51.206 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQD9xulmWDY9HRAA/GLsaCfbhdEqE+rKelFq8Q== 2024-09-17T18:14:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.6] 2024-09-17T18:14:51.207 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAAx+lmHJcZKhAAxLuNMFjvVssslKvckIfZjg== 2024-09-17T18:14:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.10] 2024-09-17T18:14:51.207 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQADx+lmdPKEOhAAPsGnHFoGrDretz2lHFq0FA== 2024-09-17T18:14:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.14] 2024-09-17T18:14:51.207 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAHx+lm/2eeDhAA3Xo7uncobQIRi/qZHUPNnQ== 2024-09-17T18:14:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.x] 2024-09-17T18:14:51.207 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDaxulm4HDtIBAAWgXZXELhyoInr03yWrP26A== 2024-09-17T18:14:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.3] 2024-09-17T18:14:51.207 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQANx+lmU9TwEhAAVLEGQKHxd1X6vvVBJ3hr9A== 2024-09-17T18:14:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.7] 2024-09-17T18:14:51.207 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAQx+lmJsyCIBAAZqHB2E2rAIu4YJ1c/Lyxlg== 2024-09-17T18:14:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.11] 2024-09-17T18:14:51.207 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQATx+lmqiwpMhAAVi6rYn/Y3FdhO/2dCuJuhg== 2024-09-17T18:14:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.15] 2024-09-17T18:14:51.208 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAXx+lmbtTTBxAA73Gq7Ku/XfZiS2ueX/QmVg== 2024-09-17T18:14:51.208 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T18:14:51.208 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDaxulmE4X1JhAAaE0mL1VE+Kj8FWwKASvLAw== 2024-09-17T18:14:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.y] 2024-09-17T18:14:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDaxulmWY5SHhAAxQNCoschRVAREnw7g4B9Fg== 2024-09-17T18:14:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2024-09-17T18:14:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDdxulmHIQvIxAACBDfynfZEjHG+9bJlOQBEQ== 2024-09-17T18:14:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.4] 2024-09-17T18:14:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDgxulmEz7vMxAAM5kcu5cNJaQjlc26rMoYCQ== 2024-09-17T18:14:51.208 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.8] 2024-09-17T18:14:51.208 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDkxulmaEccChAA8FXl2A+2oWBk8LAJEnVE7w== 2024-09-17T18:14:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.12] 2024-09-17T18:14:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDnxulmU0xEHBAAmqBtcwD85xJyhll75a4znQ== 2024-09-17T18:14:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2024-09-17T18:14:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDtxulm6flhIRAA3QgvgL1JTjxB1C2mIyXsEA== 2024-09-17T18:14:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.5] 2024-09-17T18:14:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDwxulm+rM+MhAAQRUJ/NNAqU/Bf2Rn0FVS4w== 2024-09-17T18:14:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.9] 2024-09-17T18:14:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQD0xulmNGDXBhAAdLgHvXxTXLkOABP8vwCrGA== 2024-09-17T18:14:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.13] 2024-09-17T18:14:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQD3xulmiCyVFxAAug8lVka9ZzKpfGB7OpNi1Q== 2024-09-17T18:14:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2024-09-17T18:14:51.209 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQD9xulmWDY9HRAA/GLsaCfbhdEqE+rKelFq8Q== 2024-09-17T18:14:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.6] 2024-09-17T18:14:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAAx+lmHJcZKhAAxLuNMFjvVssslKvckIfZjg== 2024-09-17T18:14:51.210 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.10] 2024-09-17T18:14:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQADx+lmdPKEOhAAPsGnHFoGrDretz2lHFq0FA== 2024-09-17T18:14:51.210 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.14] 2024-09-17T18:14:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAHx+lm/2eeDhAA3Xo7uncobQIRi/qZHUPNnQ== 2024-09-17T18:14:51.210 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2024-09-17T18:14:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDaxulm4HDtIBAAWgXZXELhyoInr03yWrP26A== 2024-09-17T18:14:51.210 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2024-09-17T18:14:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQANx+lmU9TwEhAAVLEGQKHxd1X6vvVBJ3hr9A== 2024-09-17T18:14:51.210 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.7] 2024-09-17T18:14:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAQx+lmJsyCIBAAZqHB2E2rAIu4YJ1c/Lyxlg== 2024-09-17T18:14:51.210 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.11] 2024-09-17T18:14:51.210 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQATx+lmqiwpMhAAVi6rYn/Y3FdhO/2dCuJuhg== 2024-09-17T18:14:51.210 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.15] 2024-09-17T18:14:51.211 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAXx+lmbtTTBxAA73Gq7Ku/XfZiS2ueX/QmVg== 2024-09-17T18:14:51.211 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-17T18:14:51.211 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDaxulmE4X1JhAAaE0mL1VE+Kj8FWwKASvLAw== 2024-09-17T18:14:51.211 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T18:14:51.247 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T18:14:51.250 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T18:14:51.297 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.299 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.338 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.385 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.387 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.422 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.464 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.471 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.506 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.548 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.550 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.590 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.631 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.634 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.675 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.717 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.720 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.722 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.798 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.803 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.806 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.882 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.887 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.890 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.965 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.971 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:51.974 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.046 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.055 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.058 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.129 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.139 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.147 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.208 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.223 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.230 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.289 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T18:14:52.307 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T18:14:52.310 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T18:14:52.375 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.377 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.398 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.459 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.463 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.482 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.543 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.547 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.566 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.626 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.633 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T18:14:52.713 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T18:14:52.716 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T18:14:52.718 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T18:14:52.799 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T18:14:52.799 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T18:14:52.811 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T18:14:52.904 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T18:14:52.914 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T18:14:52.928 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T18:14:53.020 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T18:14:53.031 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T18:14:53.046 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T18:14:53.141 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T18:14:53.152 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:14:53.154 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:14:53.157 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T18:14:53.198 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T18:14:53.199 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T18:14:53.199 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T18:14:53.203 INFO:tasks.ceph.mon.a:Started 2024-09-17T18:14:53.203 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T18:14:53.203 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T18:14:53.206 INFO:tasks.ceph.mon.b:Started 2024-09-17T18:14:53.206 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T18:14:53.206 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T18:14:53.244 INFO:tasks.ceph.mon.c:Started 2024-09-17T18:14:53.244 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T18:14:53.244 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T18:14:53.245 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T18:14:53.248 INFO:tasks.ceph.mgr.y:Started 2024-09-17T18:14:53.248 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T18:14:53.248 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T18:14:53.250 INFO:tasks.ceph.mgr.x:Started 2024-09-17T18:14:53.250 DEBUG:tasks.ceph:set 0 configs 2024-09-17T18:14:53.251 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T18:14:53.251 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T18:14:58.774 INFO:teuthology.orchestra.run.smithi087.stderr:adjusted tunables profile to default 2024-09-17T18:14:58.794 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T18:14:58.794 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T18:14:58.794 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:14:58.795 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T18:14:58.805 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:14:58.805 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T18:14:58.864 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:14:58.864 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2024-09-17T18:14:58.915 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T18:14:58.915 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2024-09-17T18:14:58.967 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:14:58.967 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T18:14:58.982 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:14:58.982 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T18:14:59.037 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:14:59.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2024-09-17T18:14:59.093 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-17T18:14:59.093 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2024-09-17T18:14:59.149 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:14:59.149 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T18:14:59.163 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:14:59.164 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T18:14:59.218 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:14:59.218 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2024-09-17T18:14:59.269 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T18:14:59.270 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2024-09-17T18:14:59.321 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:14:59.322 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T18:14:59.336 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:14:59.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T18:14:59.392 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:14:59.392 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2024-09-17T18:14:59.446 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T18:14:59.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2024-09-17T18:14:59.501 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 15f80e97-3ed0-4557-b1f4-7ffa88c188dd 0 2024-09-17T18:14:59.755 INFO:teuthology.orchestra.run.smithi154.stdout:0 2024-09-17T18:14:59.772 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new a9b255d0-e8d9-4d9a-9118-742dc2ac013f 1 2024-09-17T18:14:59.978 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-09-17T18:14:59.995 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 76ad6be0-c351-4265-893f-cec4a82ecd76 2 2024-09-17T18:15:00.200 INFO:teuthology.orchestra.run.smithi154.stdout:2 2024-09-17T18:15:00.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 325d4c94-b21d-48cd-8f47-446e6a8bcbcb 3 2024-09-17T18:15:00.427 INFO:teuthology.orchestra.run.smithi154.stdout:3 2024-09-17T18:15:00.444 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 58b12ec9-29f5-4fea-a835-594fe03cd376 4 2024-09-17T18:15:00.647 INFO:teuthology.orchestra.run.smithi154.stdout:4 2024-09-17T18:15:00.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 27d3075f-32f4-4032-b0d4-fb7604c8bfda 5 2024-09-17T18:15:00.861 INFO:teuthology.orchestra.run.smithi154.stdout:5 2024-09-17T18:15:00.877 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 4326073e-338d-47f1-9860-5e44455f49ff 6 2024-09-17T18:15:01.076 INFO:teuthology.orchestra.run.smithi154.stdout:6 2024-09-17T18:15:01.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 455a2636-b754-4e1f-8933-16cd3fc126fd 7 2024-09-17T18:15:01.280 INFO:teuthology.orchestra.run.smithi154.stdout:7 2024-09-17T18:15:01.302 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new e64c05c6-2dce-4abc-8693-3e06b69723b6 8 2024-09-17T18:15:01.475 INFO:tasks.ceph.mgr.y.smithi087.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-17T18:15:01.475 INFO:tasks.ceph.mgr.y.smithi087.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-17T18:15:01.475 INFO:tasks.ceph.mgr.y.smithi087.stderr: from numpy import show_config as show_numpy_config 2024-09-17T18:15:01.522 INFO:teuthology.orchestra.run.smithi154.stdout:8 2024-09-17T18:15:01.538 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 10bcf7b0-b22d-4a33-b090-b3c8083b6445 9 2024-09-17T18:15:01.638 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-17T18:15:01.639 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-17T18:15:01.639 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2024-09-17T18:15:01.727 INFO:teuthology.orchestra.run.smithi154.stdout:9 2024-09-17T18:15:01.743 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new a69d3d5e-353a-41aa-8b1c-fe7b0a68865f 10 2024-09-17T18:15:01.949 INFO:teuthology.orchestra.run.smithi154.stdout:10 2024-09-17T18:15:01.968 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 0a0e715b-1804-4e14-87e1-8c5de231b01d 11 2024-09-17T18:15:02.176 INFO:teuthology.orchestra.run.smithi154.stdout:11 2024-09-17T18:15:02.193 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new bdb1a692-4d6e-4a0c-a21f-db10b3af5025 12 2024-09-17T18:15:02.400 INFO:teuthology.orchestra.run.smithi154.stdout:12 2024-09-17T18:15:02.416 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 225fb253-25c2-4a10-a169-97971cb06e6c 13 2024-09-17T18:15:02.614 INFO:teuthology.orchestra.run.smithi154.stdout:13 2024-09-17T18:15:02.632 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 43d0e878-9725-4208-ab75-04407b592477 14 2024-09-17T18:15:02.837 INFO:teuthology.orchestra.run.smithi154.stdout:14 2024-09-17T18:15:02.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 1c97e00d-ee0d-4bed-953c-c99a67afe33e 15 2024-09-17T18:15:03.059 INFO:teuthology.orchestra.run.smithi154.stdout:15 2024-09-17T18:15:03.076 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T18:15:03.076 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T18:15:03.079 INFO:tasks.ceph.osd.0:Started 2024-09-17T18:15:03.079 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T18:15:03.079 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T18:15:03.082 INFO:tasks.ceph.osd.4:Started 2024-09-17T18:15:03.082 INFO:tasks.ceph.osd.8:Restarting daemon 2024-09-17T18:15:03.082 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2024-09-17T18:15:03.084 INFO:tasks.ceph.osd.8:Started 2024-09-17T18:15:03.085 INFO:tasks.ceph.osd.12:Restarting daemon 2024-09-17T18:15:03.085 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 12 2024-09-17T18:15:03.087 INFO:tasks.ceph.osd.12:Started 2024-09-17T18:15:03.087 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T18:15:03.087 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T18:15:03.090 INFO:tasks.ceph.osd.1:Started 2024-09-17T18:15:03.090 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T18:15:03.090 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T18:15:03.093 INFO:tasks.ceph.osd.5:Started 2024-09-17T18:15:03.096 INFO:tasks.ceph.osd.9:Restarting daemon 2024-09-17T18:15:03.096 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2024-09-17T18:15:03.099 INFO:tasks.ceph.osd.9:Started 2024-09-17T18:15:03.099 INFO:tasks.ceph.osd.13:Restarting daemon 2024-09-17T18:15:03.100 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 13 2024-09-17T18:15:03.102 INFO:tasks.ceph.osd.13:Started 2024-09-17T18:15:03.102 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T18:15:03.102 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T18:15:03.105 INFO:tasks.ceph.osd.2:Started 2024-09-17T18:15:03.106 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T18:15:03.106 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T18:15:03.109 INFO:tasks.ceph.osd.6:Started 2024-09-17T18:15:03.109 INFO:tasks.ceph.osd.10:Restarting daemon 2024-09-17T18:15:03.109 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2024-09-17T18:15:03.112 INFO:tasks.ceph.osd.10:Started 2024-09-17T18:15:03.112 INFO:tasks.ceph.osd.14:Restarting daemon 2024-09-17T18:15:03.113 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 14 2024-09-17T18:15:03.115 INFO:tasks.ceph.osd.14:Started 2024-09-17T18:15:03.116 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T18:15:03.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T18:15:03.119 INFO:tasks.ceph.osd.3:Started 2024-09-17T18:15:03.119 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T18:15:03.119 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T18:15:03.122 INFO:tasks.ceph.osd.7:Started 2024-09-17T18:15:03.122 INFO:tasks.ceph.osd.11:Restarting daemon 2024-09-17T18:15:03.122 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2024-09-17T18:15:03.125 INFO:tasks.ceph.osd.11:Started 2024-09-17T18:15:03.125 INFO:tasks.ceph.osd.15:Restarting daemon 2024-09-17T18:15:03.125 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 15 2024-09-17T18:15:03.127 INFO:tasks.ceph.osd.15:Started 2024-09-17T18:15:03.128 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T18:15:03.315 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:15:03.315 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":18,"fsid":"61bbf164-0ac7-4613-95ea-b1c3bf551ccb","created":"2024-09-17T18:14:58.620399+0000","modified":"2024-09-17T18:15:03.053866+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T18:15:03.053866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"15f80e97-3ed0-4557-b1f4-7ffa88c188dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a9b255d0-e8d9-4d9a-9118-742dc2ac013f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"76ad6be0-c351-4265-893f-cec4a82ecd76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"325d4c94-b21d-48cd-8f47-446e6a8bcbcb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"58b12ec9-29f5-4fea-a835-594fe03cd376","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"27d3075f-32f4-4032-b0d4-fb7604c8bfda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4326073e-338d-47f1-9860-5e44455f49ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"455a2636-b754-4e1f-8933-16cd3fc126fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"e64c05c6-2dce-4abc-8693-3e06b69723b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"10bcf7b0-b22d-4a33-b090-b3c8083b6445","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"a69d3d5e-353a-41aa-8b1c-fe7b0a68865f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"0a0e715b-1804-4e14-87e1-8c5de231b01d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"bdb1a692-4d6e-4a0c-a21f-db10b3af5025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"225fb253-25c2-4a10-a169-97971cb06e6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"43d0e878-9725-4208-ab75-04407b592477","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"1c97e00d-ee0d-4bed-953c-c99a67afe33e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T18:15:03.331 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T18:15:03.331 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T18:15:04.236 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:04.234+0000 7f38e49997c0 -1 Falling back to public interface 2024-09-17T18:15:04.275 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:04.274+0000 7fc740f367c0 -1 Falling back to public interface 2024-09-17T18:15:04.487 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:04.484+0000 7f161f6fa7c0 -1 Falling back to public interface 2024-09-17T18:15:04.499 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:04.498+0000 7f100438a7c0 -1 Falling back to public interface 2024-09-17T18:15:04.507 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-09-17T18:15:04.504+0000 7f11e1b58640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T18:15:04.509 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-09-17T18:15:04.504+0000 7f11e1b58640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T18:15:04.520 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:04.518+0000 7fe81fd727c0 -1 Falling back to public interface 2024-09-17T18:15:04.532 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:04.530+0000 7f58e18fa7c0 -1 Falling back to public interface 2024-09-17T18:15:04.544 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:04.542+0000 7efeff19b7c0 -1 Falling back to public interface 2024-09-17T18:15:04.556 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:04.552+0000 7f0209bf67c0 -1 Falling back to public interface 2024-09-17T18:15:04.680 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:04.676+0000 7fa0d7a557c0 -1 Falling back to public interface 2024-09-17T18:15:04.687 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:04.686+0000 7ffa86b6e7c0 -1 Falling back to public interface 2024-09-17T18:15:04.755 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:04.754+0000 7f94eb3c17c0 -1 Falling back to public interface 2024-09-17T18:15:04.763 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:04.760+0000 7f3a605757c0 -1 Falling back to public interface 2024-09-17T18:15:04.780 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:04.776+0000 7f7c37ed87c0 -1 Falling back to public interface 2024-09-17T18:15:04.792 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:04.788+0000 7fa282d247c0 -1 Falling back to public interface 2024-09-17T18:15:04.928 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:04.924+0000 7fb8170187c0 -1 Falling back to public interface 2024-09-17T18:15:04.941 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T18:15:04.968 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:04.964+0000 7f93d127c7c0 -1 Falling back to public interface 2024-09-17T18:15:05.247 INFO:teuthology.misc.health.smithi087.stdout: 2024-09-17T18:15:05.247 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":18,"fsid":"61bbf164-0ac7-4613-95ea-b1c3bf551ccb","created":"2024-09-17T18:14:58.620399+0000","modified":"2024-09-17T18:15:03.053866+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T18:15:03.053866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"15f80e97-3ed0-4557-b1f4-7ffa88c188dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a9b255d0-e8d9-4d9a-9118-742dc2ac013f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"76ad6be0-c351-4265-893f-cec4a82ecd76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"325d4c94-b21d-48cd-8f47-446e6a8bcbcb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"58b12ec9-29f5-4fea-a835-594fe03cd376","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"27d3075f-32f4-4032-b0d4-fb7604c8bfda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4326073e-338d-47f1-9860-5e44455f49ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"455a2636-b754-4e1f-8933-16cd3fc126fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"e64c05c6-2dce-4abc-8693-3e06b69723b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"10bcf7b0-b22d-4a33-b090-b3c8083b6445","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"a69d3d5e-353a-41aa-8b1c-fe7b0a68865f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"0a0e715b-1804-4e14-87e1-8c5de231b01d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"bdb1a692-4d6e-4a0c-a21f-db10b3af5025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"225fb253-25c2-4a10-a169-97971cb06e6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"43d0e878-9725-4208-ab75-04407b592477","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"1c97e00d-ee0d-4bed-953c-c99a67afe33e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T18:15:05.264 DEBUG:teuthology.misc:0 of 16 OSDs are up 2024-09-17T18:15:08.306 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:08.302+0000 7f38e49997c0 -1 osd.11 0 log_to_monitors true 2024-09-17T18:15:08.479 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:08.477+0000 7f100438a7c0 -1 osd.9 0 log_to_monitors true 2024-09-17T18:15:08.490 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:08.484+0000 7f161f6fa7c0 -1 osd.0 0 log_to_monitors true 2024-09-17T18:15:08.513 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:08.509+0000 7fc740f367c0 -1 osd.13 0 log_to_monitors true 2024-09-17T18:15:08.651 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:08.649+0000 7ffa86b6e7c0 -1 osd.1 0 log_to_monitors true 2024-09-17T18:15:08.781 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:08.776+0000 7f3a605757c0 -1 osd.8 0 log_to_monitors true 2024-09-17T18:15:08.796 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:08.792+0000 7fa282d247c0 -1 osd.10 0 log_to_monitors true 2024-09-17T18:15:08.811 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:08.808+0000 7f0209bf67c0 -1 osd.6 0 log_to_monitors true 2024-09-17T18:15:08.838 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:08.834+0000 7fe81fd727c0 -1 osd.7 0 log_to_monitors true 2024-09-17T18:15:08.846 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:08.842+0000 7f58e18fa7c0 -1 osd.3 0 log_to_monitors true 2024-09-17T18:15:08.933 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:08.928+0000 7fa0d7a557c0 -1 osd.12 0 log_to_monitors true 2024-09-17T18:15:08.947 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:08.945+0000 7f94eb3c17c0 -1 osd.5 0 log_to_monitors true 2024-09-17T18:15:08.999 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:08.996+0000 7f93d127c7c0 -1 osd.2 0 log_to_monitors true 2024-09-17T18:15:09.066 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:09.062+0000 7efeff19b7c0 -1 osd.15 0 log_to_monitors true 2024-09-17T18:15:09.194 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:09.192+0000 7fb8170187c0 -1 osd.4 0 log_to_monitors true 2024-09-17T18:15:09.291 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:09.288+0000 7f7c37ed87c0 -1 osd.14 0 log_to_monitors true 2024-09-17T18:15:09.524 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:09.521+0000 7f1000333640 -1 osd.9 0 waiting for initial osdmap 2024-09-17T18:15:09.547 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:09.545+0000 7f0ffc16d640 -1 osd.9 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:10.391 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:10.390+0000 7f38e1154640 -1 osd.11 0 waiting for initial osdmap 2024-09-17T18:15:10.423 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:10.422+0000 7f38d8774640 -1 osd.11 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:10.425 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:10.422+0000 7f38d437b640 -1 osd.11 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:10.446 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:10.440+0000 7f161b6a3640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T18:15:10.476 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:10.472+0000 7f16134d5640 -1 osd.0 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:10.500 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:10.496+0000 7f160f0dc640 -1 osd.0 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:10.531 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:10.528+0000 7fa0d39fe640 -1 osd.12 0 waiting for initial osdmap 2024-09-17T18:15:10.532 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:10.528+0000 7f3a5c51e640 -1 osd.8 0 waiting for initial osdmap 2024-09-17T18:15:10.532 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:10.529+0000 7fc73cedf640 -1 osd.13 0 waiting for initial osdmap 2024-09-17T18:15:10.538 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:10.537+0000 7f94e736a640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T18:15:10.539 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:10.536+0000 7fa27eccd640 -1 osd.10 0 waiting for initial osdmap 2024-09-17T18:15:10.539 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:10.536+0000 7f93cd225640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T18:15:10.559 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:10.556+0000 7f3a58358640 -1 osd.8 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:10.562 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:10.556+0000 7fa27ab07640 -1 osd.10 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:10.562 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:10.561+0000 7f94e31a4640 -1 osd.5 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:10.566 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:10.565+0000 7fc738d19640 -1 osd.13 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:10.566 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:10.564+0000 7fa0cf838640 -1 osd.12 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:10.574 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:10.568+0000 7f93c905f640 -1 osd.2 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:11.489 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:11.485+0000 7ffa82b17640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T18:15:11.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:11.521+0000 7ffa7a949640 -1 osd.1 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:11.523 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:11.520+0000 7fb8137d3640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T18:15:11.551 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:11.548+0000 7fb80adf3640 -1 osd.4 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:11.905 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:11.900+0000 7f7c33e81640 -1 osd.14 0 waiting for initial osdmap 2024-09-17T18:15:11.936 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:11.932+0000 7f7c2bcb3640 -1 osd.14 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:11.941 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:11.936+0000 7f02063b1640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T18:15:11.979 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:11.976+0000 7f01fd9d1640 -1 osd.6 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:12.317 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:12.314+0000 7f58dd8a3640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T18:15:12.344 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:12.342+0000 7f58d56d5640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:12.354 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:12.350+0000 7efefb144640 -1 osd.15 0 waiting for initial osdmap 2024-09-17T18:15:12.382 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:12.378+0000 7fe81bd1b640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T18:15:12.391 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:12.390+0000 7efef2f76640 -1 osd.15 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:12.407 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:12.406+0000 7fe813b4d640 -1 osd.7 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T18:15:12.873 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T18:15:13.184 INFO:teuthology.misc.health.smithi087.stdout: 2024-09-17T18:15:13.184 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":23,"fsid":"61bbf164-0ac7-4613-95ea-b1c3bf551ccb","created":"2024-09-17T18:14:58.620399+0000","modified":"2024-09-17T18:15:12.533086+0000","last_up_change":"2024-09-17T18:15:12.533086+0000","last_in_change":"2024-09-17T18:15:03.053866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T18:15:11.543279+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15f80e97-3ed0-4557-b1f4-7ffa88c188dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6803","nonce":2391985960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6805","nonce":2391985960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6809","nonce":2391985960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6807","nonce":2391985960}]},"public_addr":"172.21.15.87:6803/2391985960","cluster_addr":"172.21.15.87:6805/2391985960","heartbeat_back_addr":"172.21.15.87:6809/2391985960","heartbeat_front_addr":"172.21.15.87:6807/2391985960","state":["exists","up"]},{"osd":1,"uuid":"a9b255d0-e8d9-4d9a-9118-742dc2ac013f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6817","nonce":692679878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6819","nonce":692679878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6823","nonce":692679878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6821","nonce":692679878}]},"public_addr":"172.21.15.134:6817/692679878","cluster_addr":"172.21.15.134:6819/692679878","heartbeat_back_addr":"172.21.15.134:6823/692679878","heartbeat_front_addr":"172.21.15.134:6821/692679878","state":["exists","up"]},{"osd":2,"uuid":"76ad6be0-c351-4265-893f-cec4a82ecd76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6825","nonce":197002546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6827","nonce":197002546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6831","nonce":197002546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6829","nonce":197002546}]},"public_addr":"172.21.15.146:6825/197002546","cluster_addr":"172.21.15.146:6827/197002546","heartbeat_back_addr":"172.21.15.146:6831/197002546","heartbeat_front_addr":"172.21.15.146:6829/197002546","state":["exists","up"]},{"osd":3,"uuid":"325d4c94-b21d-48cd-8f47-446e6a8bcbcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6817","nonce":450535216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6819","nonce":450535216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6823","nonce":450535216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6821","nonce":450535216}]},"public_addr":"172.21.15.154:6817/450535216","cluster_addr":"172.21.15.154:6819/450535216","heartbeat_back_addr":"172.21.15.154:6823/450535216","heartbeat_front_addr":"172.21.15.154:6821/450535216","state":["exists","up"]},{"osd":4,"uuid":"58b12ec9-29f5-4fea-a835-594fe03cd376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6827","nonce":1911207814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6829","nonce":1911207814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6833","nonce":1911207814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6831","nonce":1911207814}]},"public_addr":"172.21.15.87:6827/1911207814","cluster_addr":"172.21.15.87:6829/1911207814","heartbeat_back_addr":"172.21.15.87:6833/1911207814","heartbeat_front_addr":"172.21.15.87:6831/1911207814","state":["exists","up"]},{"osd":5,"uuid":"27d3075f-32f4-4032-b0d4-fb7604c8bfda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6825","nonce":391215769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6827","nonce":391215769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6831","nonce":391215769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6829","nonce":391215769}]},"public_addr":"172.21.15.134:6825/391215769","cluster_addr":"172.21.15.134:6827/391215769","heartbeat_back_addr":"172.21.15.134:6831/391215769","heartbeat_front_addr":"172.21.15.134:6829/391215769","state":["exists","up"]},{"osd":6,"uuid":"4326073e-338d-47f1-9860-5e44455f49ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6801","nonce":1495925642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6803","nonce":1495925642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6807","nonce":1495925642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6805","nonce":1495925642}]},"public_addr":"172.21.15.146:6801/1495925642","cluster_addr":"172.21.15.146:6803/1495925642","heartbeat_back_addr":"172.21.15.146:6807/1495925642","heartbeat_front_addr":"172.21.15.146:6805/1495925642","state":["exists","up"]},{"osd":7,"uuid":"455a2636-b754-4e1f-8933-16cd3fc126fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6809","nonce":3979156181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6811","nonce":3979156181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6815","nonce":3979156181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6813","nonce":3979156181}]},"public_addr":"172.21.15.154:6809/3979156181","cluster_addr":"172.21.15.154:6811/3979156181","heartbeat_back_addr":"172.21.15.154:6815/3979156181","heartbeat_front_addr":"172.21.15.154:6813/3979156181","state":["exists","up"]},{"osd":8,"uuid":"e64c05c6-2dce-4abc-8693-3e06b69723b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6819","nonce":740946583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6821","nonce":740946583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6825","nonce":740946583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6823","nonce":740946583}]},"public_addr":"172.21.15.87:6819/740946583","cluster_addr":"172.21.15.87:6821/740946583","heartbeat_back_addr":"172.21.15.87:6825/740946583","heartbeat_front_addr":"172.21.15.87:6823/740946583","state":["exists","up"]},{"osd":9,"uuid":"10bcf7b0-b22d-4a33-b090-b3c8083b6445","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6809","nonce":2811218890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6811","nonce":2811218890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6815","nonce":2811218890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6813","nonce":2811218890}]},"public_addr":"172.21.15.134:6809/2811218890","cluster_addr":"172.21.15.134:6811/2811218890","heartbeat_back_addr":"172.21.15.134:6815/2811218890","heartbeat_front_addr":"172.21.15.134:6813/2811218890","state":["exists","up"]},{"osd":10,"uuid":"a69d3d5e-353a-41aa-8b1c-fe7b0a68865f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6817","nonce":1660646458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6819","nonce":1660646458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6823","nonce":1660646458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6821","nonce":1660646458}]},"public_addr":"172.21.15.146:6817/1660646458","cluster_addr":"172.21.15.146:6819/1660646458","heartbeat_back_addr":"172.21.15.146:6823/1660646458","heartbeat_front_addr":"172.21.15.146:6821/1660646458","state":["exists","up"]},{"osd":11,"uuid":"0a0e715b-1804-4e14-87e1-8c5de231b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6801","nonce":2080834051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6803","nonce":2080834051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6807","nonce":2080834051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6805","nonce":2080834051}]},"public_addr":"172.21.15.154:6801/2080834051","cluster_addr":"172.21.15.154:6803/2080834051","heartbeat_back_addr":"172.21.15.154:6807/2080834051","heartbeat_front_addr":"172.21.15.154:6805/2080834051","state":["exists","up"]},{"osd":12,"uuid":"bdb1a692-4d6e-4a0c-a21f-db10b3af5025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6811","nonce":249183944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6813","nonce":249183944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6817","nonce":249183944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6815","nonce":249183944}]},"public_addr":"172.21.15.87:6811/249183944","cluster_addr":"172.21.15.87:6813/249183944","heartbeat_back_addr":"172.21.15.87:6817/249183944","heartbeat_front_addr":"172.21.15.87:6815/249183944","state":["exists","up"]},{"osd":13,"uuid":"225fb253-25c2-4a10-a169-97971cb06e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6801","nonce":3397465529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6803","nonce":3397465529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6807","nonce":3397465529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6805","nonce":3397465529}]},"public_addr":"172.21.15.134:6801/3397465529","cluster_addr":"172.21.15.134:6803/3397465529","heartbeat_back_addr":"172.21.15.134:6807/3397465529","heartbeat_front_addr":"172.21.15.134:6805/3397465529","state":["exists","up"]},{"osd":14,"uuid":"43d0e878-9725-4208-ab75-04407b592477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6809","nonce":950976813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6811","nonce":950976813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6815","nonce":950976813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6813","nonce":950976813}]},"public_addr":"172.21.15.146:6809/950976813","cluster_addr":"172.21.15.146:6811/950976813","heartbeat_back_addr":"172.21.15.146:6815/950976813","heartbeat_front_addr":"172.21.15.146:6813/950976813","state":["exists","up"]},{"osd":15,"uuid":"1c97e00d-ee0d-4bed-953c-c99a67afe33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6825","nonce":3670919160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6827","nonce":3670919160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6831","nonce":3670919160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6829","nonce":3670919160}]},"public_addr":"172.21.15.154:6825/3670919160","cluster_addr":"172.21.15.154:6827/3670919160","heartbeat_back_addr":"172.21.15.154:6831/3670919160","heartbeat_front_addr":"172.21.15.154:6829/3670919160","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.473183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.620218+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.988470+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.996537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.785738+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.445477+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.801293+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.296968+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.903544+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.548371+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T18:15:13.202 DEBUG:teuthology.misc:16 of 16 OSDs are up 2024-09-17T18:15:13.202 INFO:tasks.ceph:Creating RBD pool 2024-09-17T18:15:13.202 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-17T18:15:13.558 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'rbd' created 2024-09-17T18:15:13.581 DEBUG:teuthology.orchestra.run.smithi087:> rbd --cluster ceph pool init rbd 2024-09-17T18:15:16.655 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T18:15:16.655 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T18:15:16.656 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T18:15:16.972 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:15:16.992 INFO:teuthology.orchestra.run.smithi087.stdout:[{"version":10,"timestamp":"2024-09-17T18:15:12.384924+0000","name":"","changes":[{"name":"osd.7/osd_mclock_max_capacity_iops_ssd","new_value":"4462.832531"}]}] 2024-09-17T18:15:16.992 INFO:tasks.ceph_manager:config epoch is 10 2024-09-17T18:15:16.993 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T18:15:16.993 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T18:15:16.993 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T18:15:17.349 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:15:17.366 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2738732850},{"type":"v1","addr":"172.21.15.87:6801","nonce":2738732850}]},"active_addr":"172.21.15.87:6801/2738732850","active_change":"2024-09-17T18:15:03.488440+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4104,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":2667074341}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":2078965061}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":4233757257}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":958830273}]}]} 2024-09-17T18:15:17.370 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T18:15:17.370 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T18:15:17.371 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T18:15:17.684 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:15:17.684 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"fsid":"61bbf164-0ac7-4613-95ea-b1c3bf551ccb","created":"2024-09-17T18:14:58.620399+0000","modified":"2024-09-17T18:15:16.582941+0000","last_up_change":"2024-09-17T18:15:12.533086+0000","last_in_change":"2024-09-17T18:15:03.053866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T18:15:11.543279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T18:15:13.520321+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15f80e97-3ed0-4557-b1f4-7ffa88c188dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6803","nonce":2391985960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6805","nonce":2391985960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6809","nonce":2391985960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6807","nonce":2391985960}]},"public_addr":"172.21.15.87:6803/2391985960","cluster_addr":"172.21.15.87:6805/2391985960","heartbeat_back_addr":"172.21.15.87:6809/2391985960","heartbeat_front_addr":"172.21.15.87:6807/2391985960","state":["exists","up"]},{"osd":1,"uuid":"a9b255d0-e8d9-4d9a-9118-742dc2ac013f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6817","nonce":692679878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6819","nonce":692679878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6823","nonce":692679878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6821","nonce":692679878}]},"public_addr":"172.21.15.134:6817/692679878","cluster_addr":"172.21.15.134:6819/692679878","heartbeat_back_addr":"172.21.15.134:6823/692679878","heartbeat_front_addr":"172.21.15.134:6821/692679878","state":["exists","up"]},{"osd":2,"uuid":"76ad6be0-c351-4265-893f-cec4a82ecd76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6825","nonce":197002546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6827","nonce":197002546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6831","nonce":197002546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6829","nonce":197002546}]},"public_addr":"172.21.15.146:6825/197002546","cluster_addr":"172.21.15.146:6827/197002546","heartbeat_back_addr":"172.21.15.146:6831/197002546","heartbeat_front_addr":"172.21.15.146:6829/197002546","state":["exists","up"]},{"osd":3,"uuid":"325d4c94-b21d-48cd-8f47-446e6a8bcbcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6817","nonce":450535216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6819","nonce":450535216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6823","nonce":450535216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6821","nonce":450535216}]},"public_addr":"172.21.15.154:6817/450535216","cluster_addr":"172.21.15.154:6819/450535216","heartbeat_back_addr":"172.21.15.154:6823/450535216","heartbeat_front_addr":"172.21.15.154:6821/450535216","state":["exists","up"]},{"osd":4,"uuid":"58b12ec9-29f5-4fea-a835-594fe03cd376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6827","nonce":1911207814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6829","nonce":1911207814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6833","nonce":1911207814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6831","nonce":1911207814}]},"public_addr":"172.21.15.87:6827/1911207814","cluster_addr":"172.21.15.87:6829/1911207814","heartbeat_back_addr":"172.21.15.87:6833/1911207814","heartbeat_front_addr":"172.21.15.87:6831/1911207814","state":["exists","up"]},{"osd":5,"uuid":"27d3075f-32f4-4032-b0d4-fb7604c8bfda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6825","nonce":391215769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6827","nonce":391215769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6831","nonce":391215769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6829","nonce":391215769}]},"public_addr":"172.21.15.134:6825/391215769","cluster_addr":"172.21.15.134:6827/391215769","heartbeat_back_addr":"172.21.15.134:6831/391215769","heartbeat_front_addr":"172.21.15.134:6829/391215769","state":["exists","up"]},{"osd":6,"uuid":"4326073e-338d-47f1-9860-5e44455f49ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6801","nonce":1495925642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6803","nonce":1495925642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6807","nonce":1495925642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6805","nonce":1495925642}]},"public_addr":"172.21.15.146:6801/1495925642","cluster_addr":"172.21.15.146:6803/1495925642","heartbeat_back_addr":"172.21.15.146:6807/1495925642","heartbeat_front_addr":"172.21.15.146:6805/1495925642","state":["exists","up"]},{"osd":7,"uuid":"455a2636-b754-4e1f-8933-16cd3fc126fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6809","nonce":3979156181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6811","nonce":3979156181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6815","nonce":3979156181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6813","nonce":3979156181}]},"public_addr":"172.21.15.154:6809/3979156181","cluster_addr":"172.21.15.154:6811/3979156181","heartbeat_back_addr":"172.21.15.154:6815/3979156181","heartbeat_front_addr":"172.21.15.154:6813/3979156181","state":["exists","up"]},{"osd":8,"uuid":"e64c05c6-2dce-4abc-8693-3e06b69723b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6819","nonce":740946583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6821","nonce":740946583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6825","nonce":740946583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6823","nonce":740946583}]},"public_addr":"172.21.15.87:6819/740946583","cluster_addr":"172.21.15.87:6821/740946583","heartbeat_back_addr":"172.21.15.87:6825/740946583","heartbeat_front_addr":"172.21.15.87:6823/740946583","state":["exists","up"]},{"osd":9,"uuid":"10bcf7b0-b22d-4a33-b090-b3c8083b6445","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6809","nonce":2811218890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6811","nonce":2811218890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6815","nonce":2811218890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6813","nonce":2811218890}]},"public_addr":"172.21.15.134:6809/2811218890","cluster_addr":"172.21.15.134:6811/2811218890","heartbeat_back_addr":"172.21.15.134:6815/2811218890","heartbeat_front_addr":"172.21.15.134:6813/2811218890","state":["exists","up"]},{"osd":10,"uuid":"a69d3d5e-353a-41aa-8b1c-fe7b0a68865f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6817","nonce":1660646458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6819","nonce":1660646458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6823","nonce":1660646458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6821","nonce":1660646458}]},"public_addr":"172.21.15.146:6817/1660646458","cluster_addr":"172.21.15.146:6819/1660646458","heartbeat_back_addr":"172.21.15.146:6823/1660646458","heartbeat_front_addr":"172.21.15.146:6821/1660646458","state":["exists","up"]},{"osd":11,"uuid":"0a0e715b-1804-4e14-87e1-8c5de231b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6801","nonce":2080834051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6803","nonce":2080834051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6807","nonce":2080834051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6805","nonce":2080834051}]},"public_addr":"172.21.15.154:6801/2080834051","cluster_addr":"172.21.15.154:6803/2080834051","heartbeat_back_addr":"172.21.15.154:6807/2080834051","heartbeat_front_addr":"172.21.15.154:6805/2080834051","state":["exists","up"]},{"osd":12,"uuid":"bdb1a692-4d6e-4a0c-a21f-db10b3af5025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6811","nonce":249183944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6813","nonce":249183944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6817","nonce":249183944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6815","nonce":249183944}]},"public_addr":"172.21.15.87:6811/249183944","cluster_addr":"172.21.15.87:6813/249183944","heartbeat_back_addr":"172.21.15.87:6817/249183944","heartbeat_front_addr":"172.21.15.87:6815/249183944","state":["exists","up"]},{"osd":13,"uuid":"225fb253-25c2-4a10-a169-97971cb06e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6801","nonce":3397465529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6803","nonce":3397465529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6807","nonce":3397465529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6805","nonce":3397465529}]},"public_addr":"172.21.15.134:6801/3397465529","cluster_addr":"172.21.15.134:6803/3397465529","heartbeat_back_addr":"172.21.15.134:6807/3397465529","heartbeat_front_addr":"172.21.15.134:6805/3397465529","state":["exists","up"]},{"osd":14,"uuid":"43d0e878-9725-4208-ab75-04407b592477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6809","nonce":950976813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6811","nonce":950976813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6815","nonce":950976813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6813","nonce":950976813}]},"public_addr":"172.21.15.146:6809/950976813","cluster_addr":"172.21.15.146:6811/950976813","heartbeat_back_addr":"172.21.15.146:6815/950976813","heartbeat_front_addr":"172.21.15.146:6813/950976813","state":["exists","up"]},{"osd":15,"uuid":"1c97e00d-ee0d-4bed-953c-c99a67afe33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6825","nonce":3670919160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6827","nonce":3670919160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6831","nonce":3670919160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6829","nonce":3670919160}]},"public_addr":"172.21.15.154:6825/3670919160","cluster_addr":"172.21.15.154:6827/3670919160","heartbeat_back_addr":"172.21.15.154:6831/3670919160","heartbeat_front_addr":"172.21.15.154:6829/3670919160","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.473183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.620218+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.988470+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.802332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:10.166944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.996537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.773040+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.794981+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.785738+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.445477+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.801293+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.296968+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.903544+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.548371+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:10.280958+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:10.079389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T18:15:17.704 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T18:15:17.704 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T18:15:17.984 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:15:17.985 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"fsid":"61bbf164-0ac7-4613-95ea-b1c3bf551ccb","created":"2024-09-17T18:14:58.620399+0000","modified":"2024-09-17T18:15:16.582941+0000","last_up_change":"2024-09-17T18:15:12.533086+0000","last_in_change":"2024-09-17T18:15:03.053866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T18:15:11.543279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T18:15:13.520321+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15f80e97-3ed0-4557-b1f4-7ffa88c188dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6803","nonce":2391985960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6805","nonce":2391985960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6809","nonce":2391985960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6807","nonce":2391985960}]},"public_addr":"172.21.15.87:6803/2391985960","cluster_addr":"172.21.15.87:6805/2391985960","heartbeat_back_addr":"172.21.15.87:6809/2391985960","heartbeat_front_addr":"172.21.15.87:6807/2391985960","state":["exists","up"]},{"osd":1,"uuid":"a9b255d0-e8d9-4d9a-9118-742dc2ac013f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6817","nonce":692679878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6819","nonce":692679878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6823","nonce":692679878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6821","nonce":692679878}]},"public_addr":"172.21.15.134:6817/692679878","cluster_addr":"172.21.15.134:6819/692679878","heartbeat_back_addr":"172.21.15.134:6823/692679878","heartbeat_front_addr":"172.21.15.134:6821/692679878","state":["exists","up"]},{"osd":2,"uuid":"76ad6be0-c351-4265-893f-cec4a82ecd76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6825","nonce":197002546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6827","nonce":197002546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6831","nonce":197002546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6829","nonce":197002546}]},"public_addr":"172.21.15.146:6825/197002546","cluster_addr":"172.21.15.146:6827/197002546","heartbeat_back_addr":"172.21.15.146:6831/197002546","heartbeat_front_addr":"172.21.15.146:6829/197002546","state":["exists","up"]},{"osd":3,"uuid":"325d4c94-b21d-48cd-8f47-446e6a8bcbcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6817","nonce":450535216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6819","nonce":450535216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6823","nonce":450535216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6821","nonce":450535216}]},"public_addr":"172.21.15.154:6817/450535216","cluster_addr":"172.21.15.154:6819/450535216","heartbeat_back_addr":"172.21.15.154:6823/450535216","heartbeat_front_addr":"172.21.15.154:6821/450535216","state":["exists","up"]},{"osd":4,"uuid":"58b12ec9-29f5-4fea-a835-594fe03cd376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6827","nonce":1911207814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6829","nonce":1911207814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6833","nonce":1911207814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6831","nonce":1911207814}]},"public_addr":"172.21.15.87:6827/1911207814","cluster_addr":"172.21.15.87:6829/1911207814","heartbeat_back_addr":"172.21.15.87:6833/1911207814","heartbeat_front_addr":"172.21.15.87:6831/1911207814","state":["exists","up"]},{"osd":5,"uuid":"27d3075f-32f4-4032-b0d4-fb7604c8bfda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6825","nonce":391215769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6827","nonce":391215769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6831","nonce":391215769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6829","nonce":391215769}]},"public_addr":"172.21.15.134:6825/391215769","cluster_addr":"172.21.15.134:6827/391215769","heartbeat_back_addr":"172.21.15.134:6831/391215769","heartbeat_front_addr":"172.21.15.134:6829/391215769","state":["exists","up"]},{"osd":6,"uuid":"4326073e-338d-47f1-9860-5e44455f49ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6801","nonce":1495925642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6803","nonce":1495925642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6807","nonce":1495925642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6805","nonce":1495925642}]},"public_addr":"172.21.15.146:6801/1495925642","cluster_addr":"172.21.15.146:6803/1495925642","heartbeat_back_addr":"172.21.15.146:6807/1495925642","heartbeat_front_addr":"172.21.15.146:6805/1495925642","state":["exists","up"]},{"osd":7,"uuid":"455a2636-b754-4e1f-8933-16cd3fc126fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6809","nonce":3979156181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6811","nonce":3979156181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6815","nonce":3979156181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6813","nonce":3979156181}]},"public_addr":"172.21.15.154:6809/3979156181","cluster_addr":"172.21.15.154:6811/3979156181","heartbeat_back_addr":"172.21.15.154:6815/3979156181","heartbeat_front_addr":"172.21.15.154:6813/3979156181","state":["exists","up"]},{"osd":8,"uuid":"e64c05c6-2dce-4abc-8693-3e06b69723b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6819","nonce":740946583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6821","nonce":740946583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6825","nonce":740946583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6823","nonce":740946583}]},"public_addr":"172.21.15.87:6819/740946583","cluster_addr":"172.21.15.87:6821/740946583","heartbeat_back_addr":"172.21.15.87:6825/740946583","heartbeat_front_addr":"172.21.15.87:6823/740946583","state":["exists","up"]},{"osd":9,"uuid":"10bcf7b0-b22d-4a33-b090-b3c8083b6445","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6809","nonce":2811218890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6811","nonce":2811218890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6815","nonce":2811218890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6813","nonce":2811218890}]},"public_addr":"172.21.15.134:6809/2811218890","cluster_addr":"172.21.15.134:6811/2811218890","heartbeat_back_addr":"172.21.15.134:6815/2811218890","heartbeat_front_addr":"172.21.15.134:6813/2811218890","state":["exists","up"]},{"osd":10,"uuid":"a69d3d5e-353a-41aa-8b1c-fe7b0a68865f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6817","nonce":1660646458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6819","nonce":1660646458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6823","nonce":1660646458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6821","nonce":1660646458}]},"public_addr":"172.21.15.146:6817/1660646458","cluster_addr":"172.21.15.146:6819/1660646458","heartbeat_back_addr":"172.21.15.146:6823/1660646458","heartbeat_front_addr":"172.21.15.146:6821/1660646458","state":["exists","up"]},{"osd":11,"uuid":"0a0e715b-1804-4e14-87e1-8c5de231b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6801","nonce":2080834051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6803","nonce":2080834051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6807","nonce":2080834051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6805","nonce":2080834051}]},"public_addr":"172.21.15.154:6801/2080834051","cluster_addr":"172.21.15.154:6803/2080834051","heartbeat_back_addr":"172.21.15.154:6807/2080834051","heartbeat_front_addr":"172.21.15.154:6805/2080834051","state":["exists","up"]},{"osd":12,"uuid":"bdb1a692-4d6e-4a0c-a21f-db10b3af5025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6811","nonce":249183944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6813","nonce":249183944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6817","nonce":249183944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6815","nonce":249183944}]},"public_addr":"172.21.15.87:6811/249183944","cluster_addr":"172.21.15.87:6813/249183944","heartbeat_back_addr":"172.21.15.87:6817/249183944","heartbeat_front_addr":"172.21.15.87:6815/249183944","state":["exists","up"]},{"osd":13,"uuid":"225fb253-25c2-4a10-a169-97971cb06e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6801","nonce":3397465529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6803","nonce":3397465529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6807","nonce":3397465529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6805","nonce":3397465529}]},"public_addr":"172.21.15.134:6801/3397465529","cluster_addr":"172.21.15.134:6803/3397465529","heartbeat_back_addr":"172.21.15.134:6807/3397465529","heartbeat_front_addr":"172.21.15.134:6805/3397465529","state":["exists","up"]},{"osd":14,"uuid":"43d0e878-9725-4208-ab75-04407b592477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6809","nonce":950976813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6811","nonce":950976813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6815","nonce":950976813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6813","nonce":950976813}]},"public_addr":"172.21.15.146:6809/950976813","cluster_addr":"172.21.15.146:6811/950976813","heartbeat_back_addr":"172.21.15.146:6815/950976813","heartbeat_front_addr":"172.21.15.146:6813/950976813","state":["exists","up"]},{"osd":15,"uuid":"1c97e00d-ee0d-4bed-953c-c99a67afe33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6825","nonce":3670919160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6827","nonce":3670919160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6831","nonce":3670919160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6829","nonce":3670919160}]},"public_addr":"172.21.15.154:6825/3670919160","cluster_addr":"172.21.15.154:6827/3670919160","heartbeat_back_addr":"172.21.15.154:6831/3670919160","heartbeat_front_addr":"172.21.15.154:6829/3670919160","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.473183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.620218+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.988470+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.802332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:10.166944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.996537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.773040+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.794981+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.785738+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.445477+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.801293+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.296968+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.903544+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.548371+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:10.280958+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:10.079389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T18:15:18.003 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T18:15:18.003 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T18:15:18.003 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T18:15:18.004 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T18:15:18.004 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T18:15:18.005 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T18:15:18.005 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T18:15:18.006 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T18:15:18.006 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-09-17T18:15:18.006 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-09-17T18:15:18.007 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2024-09-17T18:15:18.007 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2024-09-17T18:15:18.008 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2024-09-17T18:15:18.008 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2024-09-17T18:15:18.008 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2024-09-17T18:15:18.009 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2024-09-17T18:15:18.436 INFO:teuthology.orchestra.run.smithi087.stdout:94489280517 2024-09-17T18:15:18.436 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-09-17T18:15:18.465 INFO:teuthology.orchestra.run.smithi087.stdout:98784247812 2024-09-17T18:15:18.466 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T18:15:18.467 INFO:teuthology.orchestra.run.smithi087.stdout:98784247811 2024-09-17T18:15:18.467 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T18:15:18.468 INFO:teuthology.orchestra.run.smithi087.stdout:94489280516 2024-09-17T18:15:18.468 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-09-17T18:15:18.482 INFO:teuthology.orchestra.run.smithi087.stdout:90194313221 2024-09-17T18:15:18.482 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-09-17T18:15:18.503 INFO:teuthology.orchestra.run.smithi087.stdout:94489280515 2024-09-17T18:15:18.503 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T18:15:18.515 INFO:teuthology.orchestra.run.smithi087.stdout:94489280517 2024-09-17T18:15:18.515 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-09-17T18:15:18.516 INFO:teuthology.orchestra.run.smithi087.stdout:94489280515 2024-09-17T18:15:18.516 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T18:15:18.527 INFO:teuthology.orchestra.run.smithi087.stdout:90194313220 2024-09-17T18:15:18.528 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-09-17T18:15:18.538 INFO:teuthology.orchestra.run.smithi087.stdout:98784247812 2024-09-17T18:15:18.538 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-09-17T18:15:18.549 INFO:teuthology.orchestra.run.smithi087.stdout:90194313221 2024-09-17T18:15:18.549 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T18:15:18.572 INFO:teuthology.orchestra.run.smithi087.stdout:98784247810 2024-09-17T18:15:18.572 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T18:15:18.575 INFO:teuthology.orchestra.run.smithi087.stdout:98784247812 2024-09-17T18:15:18.575 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-09-17T18:15:18.608 INFO:teuthology.orchestra.run.smithi087.stdout:94489280515 2024-09-17T18:15:18.608 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-09-17T18:15:18.615 INFO:teuthology.orchestra.run.smithi087.stdout:94489280516 2024-09-17T18:15:18.616 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T18:15:18.651 INFO:teuthology.orchestra.run.smithi087.stdout:98784247813 2024-09-17T18:15:18.652 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T18:15:19.344 INFO:teuthology.orchestra.run.smithi087.stdout:94489280514 2024-09-17T18:15:19.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280514 for osd.10 2024-09-17T18:15:19.397 INFO:teuthology.orchestra.run.smithi087.stdout:98784247811 2024-09-17T18:15:19.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247812 got 98784247811 for osd.6 2024-09-17T18:15:19.454 INFO:teuthology.orchestra.run.smithi087.stdout:94489280515 2024-09-17T18:15:19.492 INFO:teuthology.orchestra.run.smithi087.stdout:90194313220 2024-09-17T18:15:19.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280515 for osd.12 2024-09-17T18:15:19.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.9 2024-09-17T18:15:19.562 INFO:teuthology.orchestra.run.smithi087.stdout:94489280513 2024-09-17T18:15:19.570 INFO:teuthology.orchestra.run.smithi087.stdout:94489280514 2024-09-17T18:15:19.578 INFO:teuthology.orchestra.run.smithi087.stdout:98784247810 2024-09-17T18:15:19.599 INFO:teuthology.orchestra.run.smithi087.stdout:94489280515 2024-09-17T18:15:19.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280514 for osd.1 2024-09-17T18:15:19.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280513 for osd.5 2024-09-17T18:15:19.613 INFO:teuthology.orchestra.run.smithi087.stdout:90194313221 2024-09-17T18:15:19.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247810 for osd.7 2024-09-17T18:15:19.628 INFO:teuthology.orchestra.run.smithi087.stdout:94489280515 2024-09-17T18:15:19.634 INFO:teuthology.orchestra.run.smithi087.stdout:98784247811 2024-09-17T18:15:19.635 INFO:teuthology.orchestra.run.smithi087.stdout:90194313220 2024-09-17T18:15:19.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.0 2024-09-17T18:15:19.648 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:19.651 INFO:teuthology.orchestra.run.smithi087.stdout:94489280516 2024-09-17T18:15:19.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280515 for osd.13 2024-09-17T18:15:19.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280515 for osd.8 2024-09-17T18:15:19.669 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:19.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.11 2024-09-17T18:15:19.672 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:19.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.2 2024-09-17T18:15:19.677 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:19.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247810 got 98784247811 for osd.3 2024-09-17T18:15:19.677 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:19.678 INFO:teuthology.orchestra.run.smithi087.stdout:98784247813 2024-09-17T18:15:19.688 INFO:teuthology.orchestra.run.smithi087.stdout:98784247813 2024-09-17T18:15:19.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247812 got 98784247813 for osd.14 2024-09-17T18:15:19.697 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:19.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247812 got 98784247813 for osd.15 2024-09-17T18:15:19.705 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:19.721 INFO:teuthology.orchestra.run.smithi087.stdout:98784247813 2024-09-17T18:15:19.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247813 got 98784247813 for osd.4 2024-09-17T18:15:19.738 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:20.398 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-09-17T18:15:20.435 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T18:15:20.494 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-09-17T18:15:20.541 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-09-17T18:15:20.613 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T18:15:20.613 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T18:15:20.628 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T18:15:20.658 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-09-17T18:15:20.802 INFO:teuthology.orchestra.run.smithi087.stdout:94489280516 2024-09-17T18:15:20.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.10 2024-09-17T18:15:20.828 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:20.880 INFO:teuthology.orchestra.run.smithi087.stdout:98784247813 2024-09-17T18:15:20.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247812 got 98784247813 for osd.6 2024-09-17T18:15:20.906 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:20.979 INFO:teuthology.orchestra.run.smithi087.stdout:94489280517 2024-09-17T18:15:21.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.12 2024-09-17T18:15:21.006 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:21.014 INFO:teuthology.orchestra.run.smithi087.stdout:94489280515 2024-09-17T18:15:21.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280515 for osd.5 2024-09-17T18:15:21.037 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:21.057 INFO:teuthology.orchestra.run.smithi087.stdout:90194313221 2024-09-17T18:15:21.058 INFO:teuthology.orchestra.run.smithi087.stdout:98784247812 2024-09-17T18:15:21.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247812 for osd.7 2024-09-17T18:15:21.078 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:21.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.9 2024-09-17T18:15:21.084 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:21.099 INFO:teuthology.orchestra.run.smithi087.stdout:94489280517 2024-09-17T18:15:21.113 INFO:teuthology.orchestra.run.smithi087.stdout:94489280516 2024-09-17T18:15:21.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.13 2024-09-17T18:15:21.116 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:21.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280516 for osd.1 2024-09-17T18:15:21.130 DEBUG:teuthology.parallel:result is None 2024-09-17T18:15:21.130 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T18:15:21.130 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:15:21.448 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:15:21.449 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:15:21.465 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-09-17T18:15:19.497649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":438044,"kb_used_data":5400,"kb_used_omap":24,"kb_used_meta":432103,"kb_avail":1509511396,"statfs":{"total":1546188226560,"available":1545739669504,"internally_reserved":0,"allocated":5529600,"data_stored":2822038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":442473553},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.619115+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:15:16.619115+0000","last_peered":"2024-09-17T18:15:16.619115+0000","last_clean":"2024-09-17T18:15:16.619115+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:15:16.619115+0000","last_undegraded":"2024-09-17T18:15:16.619115+0000","last_fullsized":"2024-09-17T18:15:16.619115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:17.193575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.502621+0000","last_change":"2024-09-17T18:15:17.502621+0000","last_active":"2024-09-17T18:15:17.502621+0000","last_peered":"2024-09-17T18:15:17.502621+0000","last_clean":"2024-09-17T18:15:17.502621+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:15:17.502621+0000","last_undegraded":"2024-09-17T18:15:17.502621+0000","last_fullsized":"2024-09-17T18:15:17.502621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.990534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.504087+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:15:17.504087+0000","last_peered":"2024-09-17T18:15:17.504087+0000","last_clean":"2024-09-17T18:15:17.504087+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:15:17.504087+0000","last_undegraded":"2024-09-17T18:15:17.504087+0000","last_fullsized":"2024-09-17T18:15:17.504087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:14.501281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.605178+0000","last_change":"2024-09-17T18:15:16.605178+0000","last_active":"2024-09-17T18:15:16.605178+0000","last_peered":"2024-09-17T18:15:16.605178+0000","last_clean":"2024-09-17T18:15:16.605178+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:15:16.605178+0000","last_undegraded":"2024-09-17T18:15:16.605178+0000","last_fullsized":"2024-09-17T18:15:16.605178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.627620+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:15:16.627620+0000","last_peered":"2024-09-17T18:15:16.627620+0000","last_clean":"2024-09-17T18:15:16.627620+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:15:16.627620+0000","last_undegraded":"2024-09-17T18:15:16.627620+0000","last_fullsized":"2024-09-17T18:15:16.627620+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:19.851941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.499886+0000","last_change":"2024-09-17T18:15:17.499886+0000","last_active":"2024-09-17T18:15:17.499886+0000","last_peered":"2024-09-17T18:15:17.499886+0000","last_clean":"2024-09-17T18:15:17.499886+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:15:17.499886+0000","last_undegraded":"2024-09-17T18:15:17.499886+0000","last_fullsized":"2024-09-17T18:15:17.499886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.366017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.989689+0000","last_change":"2024-09-17T18:15:16.990099+0000","last_active":"2024-09-17T18:15:16.989689+0000","last_peered":"2024-09-17T18:15:16.989689+0000","last_clean":"2024-09-17T18:15:16.989689+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:15:16.989689+0000","last_undegraded":"2024-09-17T18:15:16.989689+0000","last_fullsized":"2024-09-17T18:15:16.989689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.933228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"25'1","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.500047+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:15:17.500047+0000","last_peered":"2024-09-17T18:15:17.500047+0000","last_clean":"2024-09-17T18:15:17.500047+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:15:17.500047+0000","last_undegraded":"2024-09-17T18:15:17.500047+0000","last_fullsized":"2024-09-17T18:15:17.500047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"25'112","reported_seq":153,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.419261+0000","last_change":"2024-09-17T18:15:13.924291+0000","last_active":"2024-09-17T18:15:17.419261+0000","last_peered":"2024-09-17T18:15:17.419261+0000","last_clean":"2024-09-17T18:15:17.419261+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:15:17.419261+0000","last_undegraded":"2024-09-17T18:15:17.419261+0000","last_fullsized":"2024-09-17T18:15:17.419261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:15:12.533086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.379235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247813,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":811008,"data_stored":639187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247813,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,6,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":110278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,5,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":110278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,5,8,9,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[4,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,4,5,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247813,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,3,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247813,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":639187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[2,4,5,6,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,5,6,7,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:15:21.466 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:15:21.753 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:15:21.753 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:15:21.769 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2024-09-17T18:15:21.498124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":438044,"kb_used_data":5400,"kb_used_omap":24,"kb_used_meta":432103,"kb_avail":1509511396,"statfs":{"total":1546188226560,"available":1545739669504,"internally_reserved":0,"allocated":5529600,"data_stored":2822038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":442473553},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000475"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.619115+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:15:16.619115+0000","last_peered":"2024-09-17T18:15:16.619115+0000","last_clean":"2024-09-17T18:15:16.619115+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:15:16.619115+0000","last_undegraded":"2024-09-17T18:15:16.619115+0000","last_fullsized":"2024-09-17T18:15:16.619115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:17.193575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.502621+0000","last_change":"2024-09-17T18:15:17.502621+0000","last_active":"2024-09-17T18:15:17.502621+0000","last_peered":"2024-09-17T18:15:17.502621+0000","last_clean":"2024-09-17T18:15:17.502621+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:15:17.502621+0000","last_undegraded":"2024-09-17T18:15:17.502621+0000","last_fullsized":"2024-09-17T18:15:17.502621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.990534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.504087+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:15:17.504087+0000","last_peered":"2024-09-17T18:15:17.504087+0000","last_clean":"2024-09-17T18:15:17.504087+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:15:17.504087+0000","last_undegraded":"2024-09-17T18:15:17.504087+0000","last_fullsized":"2024-09-17T18:15:17.504087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:14.501281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.605178+0000","last_change":"2024-09-17T18:15:16.605178+0000","last_active":"2024-09-17T18:15:16.605178+0000","last_peered":"2024-09-17T18:15:16.605178+0000","last_clean":"2024-09-17T18:15:16.605178+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:15:16.605178+0000","last_undegraded":"2024-09-17T18:15:16.605178+0000","last_fullsized":"2024-09-17T18:15:16.605178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.627620+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:15:16.627620+0000","last_peered":"2024-09-17T18:15:16.627620+0000","last_clean":"2024-09-17T18:15:16.627620+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:15:16.627620+0000","last_undegraded":"2024-09-17T18:15:16.627620+0000","last_fullsized":"2024-09-17T18:15:16.627620+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:19.851941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.499886+0000","last_change":"2024-09-17T18:15:17.499886+0000","last_active":"2024-09-17T18:15:17.499886+0000","last_peered":"2024-09-17T18:15:17.499886+0000","last_clean":"2024-09-17T18:15:17.499886+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:15:17.499886+0000","last_undegraded":"2024-09-17T18:15:17.499886+0000","last_fullsized":"2024-09-17T18:15:17.499886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.366017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.989689+0000","last_change":"2024-09-17T18:15:16.990099+0000","last_active":"2024-09-17T18:15:16.989689+0000","last_peered":"2024-09-17T18:15:16.989689+0000","last_clean":"2024-09-17T18:15:16.989689+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:15:16.989689+0000","last_undegraded":"2024-09-17T18:15:16.989689+0000","last_fullsized":"2024-09-17T18:15:16.989689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.933228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"25'1","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.500047+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:15:17.500047+0000","last_peered":"2024-09-17T18:15:17.500047+0000","last_clean":"2024-09-17T18:15:17.500047+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:15:17.500047+0000","last_undegraded":"2024-09-17T18:15:17.500047+0000","last_fullsized":"2024-09-17T18:15:17.500047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"25'112","reported_seq":153,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.419261+0000","last_change":"2024-09-17T18:15:13.924291+0000","last_active":"2024-09-17T18:15:17.419261+0000","last_peered":"2024-09-17T18:15:17.419261+0000","last_clean":"2024-09-17T18:15:17.419261+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:15:17.419261+0000","last_undegraded":"2024-09-17T18:15:17.419261+0000","last_fullsized":"2024-09-17T18:15:17.419261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:15:12.533086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.379235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247813,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":811008,"data_stored":639187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247813,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,6,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":110278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,5,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":110278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,5,8,9,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[4,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,4,5,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247813,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,3,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247813,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":639187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[2,4,5,6,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,5,6,7,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:15:21.770 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T18:15:21.771 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T18:15:21.771 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T18:15:21.771 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T18:15:22.092 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:15:22.092 INFO:teuthology.orchestra.run.smithi087.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T18:15:22.109 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T18:15:22.110 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-17T18:15:22.120 INFO:tasks.thrashosds:config is {'aggressive_pg_num_changes': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-17T18:15:22.121 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-bharath10-testing-2024-09-17-1348'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath10-testing-2024-09-17-1348', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}} 2024-09-17T18:15:22.121 INFO:tasks.thrashosds:config is {'aggressive_pg_num_changes': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-17T18:15:22.121 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-17T18:15:22.121 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T18:15:22.121 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:15:22.400 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:15:22.401 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:15:22.416 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2024-09-17T18:15:21.498124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":438044,"kb_used_data":5400,"kb_used_omap":24,"kb_used_meta":432103,"kb_avail":1509511396,"statfs":{"total":1546188226560,"available":1545739669504,"internally_reserved":0,"allocated":5529600,"data_stored":2822038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":442473553},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000475"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.619115+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:15:16.619115+0000","last_peered":"2024-09-17T18:15:16.619115+0000","last_clean":"2024-09-17T18:15:16.619115+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:15:16.619115+0000","last_undegraded":"2024-09-17T18:15:16.619115+0000","last_fullsized":"2024-09-17T18:15:16.619115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:17.193575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.502621+0000","last_change":"2024-09-17T18:15:17.502621+0000","last_active":"2024-09-17T18:15:17.502621+0000","last_peered":"2024-09-17T18:15:17.502621+0000","last_clean":"2024-09-17T18:15:17.502621+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:15:17.502621+0000","last_undegraded":"2024-09-17T18:15:17.502621+0000","last_fullsized":"2024-09-17T18:15:17.502621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.990534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.504087+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:15:17.504087+0000","last_peered":"2024-09-17T18:15:17.504087+0000","last_clean":"2024-09-17T18:15:17.504087+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:15:17.504087+0000","last_undegraded":"2024-09-17T18:15:17.504087+0000","last_fullsized":"2024-09-17T18:15:17.504087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:14.501281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.605178+0000","last_change":"2024-09-17T18:15:16.605178+0000","last_active":"2024-09-17T18:15:16.605178+0000","last_peered":"2024-09-17T18:15:16.605178+0000","last_clean":"2024-09-17T18:15:16.605178+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:15:16.605178+0000","last_undegraded":"2024-09-17T18:15:16.605178+0000","last_fullsized":"2024-09-17T18:15:16.605178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.627620+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:15:16.627620+0000","last_peered":"2024-09-17T18:15:16.627620+0000","last_clean":"2024-09-17T18:15:16.627620+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:15:16.627620+0000","last_undegraded":"2024-09-17T18:15:16.627620+0000","last_fullsized":"2024-09-17T18:15:16.627620+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:19.851941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.499886+0000","last_change":"2024-09-17T18:15:17.499886+0000","last_active":"2024-09-17T18:15:17.499886+0000","last_peered":"2024-09-17T18:15:17.499886+0000","last_clean":"2024-09-17T18:15:17.499886+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:15:17.499886+0000","last_undegraded":"2024-09-17T18:15:17.499886+0000","last_fullsized":"2024-09-17T18:15:17.499886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.366017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.989689+0000","last_change":"2024-09-17T18:15:16.990099+0000","last_active":"2024-09-17T18:15:16.989689+0000","last_peered":"2024-09-17T18:15:16.989689+0000","last_clean":"2024-09-17T18:15:16.989689+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:15:16.989689+0000","last_undegraded":"2024-09-17T18:15:16.989689+0000","last_fullsized":"2024-09-17T18:15:16.989689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.933228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"25'1","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.500047+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:15:17.500047+0000","last_peered":"2024-09-17T18:15:17.500047+0000","last_clean":"2024-09-17T18:15:17.500047+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:15:17.500047+0000","last_undegraded":"2024-09-17T18:15:17.500047+0000","last_fullsized":"2024-09-17T18:15:17.500047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"25'112","reported_seq":153,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.419261+0000","last_change":"2024-09-17T18:15:13.924291+0000","last_active":"2024-09-17T18:15:17.419261+0000","last_peered":"2024-09-17T18:15:17.419261+0000","last_clean":"2024-09-17T18:15:17.419261+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:15:17.419261+0000","last_undegraded":"2024-09-17T18:15:17.419261+0000","last_fullsized":"2024-09-17T18:15:17.419261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:15:12.533086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.379235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247813,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":811008,"data_stored":639187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247813,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,6,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":110278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,5,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":110278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,5,8,9,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[4,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,4,5,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247813,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,3,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247813,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":639187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[2,4,5,6,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,5,6,7,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:15:22.418 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:15:22.697 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:15:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:15:22.714 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2024-09-17T18:15:21.498124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":438044,"kb_used_data":5400,"kb_used_omap":24,"kb_used_meta":432103,"kb_avail":1509511396,"statfs":{"total":1546188226560,"available":1545739669504,"internally_reserved":0,"allocated":5529600,"data_stored":2822038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":442473553},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000475"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.619115+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:15:16.619115+0000","last_peered":"2024-09-17T18:15:16.619115+0000","last_clean":"2024-09-17T18:15:16.619115+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:15:16.619115+0000","last_undegraded":"2024-09-17T18:15:16.619115+0000","last_fullsized":"2024-09-17T18:15:16.619115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:17.193575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.502621+0000","last_change":"2024-09-17T18:15:17.502621+0000","last_active":"2024-09-17T18:15:17.502621+0000","last_peered":"2024-09-17T18:15:17.502621+0000","last_clean":"2024-09-17T18:15:17.502621+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:15:17.502621+0000","last_undegraded":"2024-09-17T18:15:17.502621+0000","last_fullsized":"2024-09-17T18:15:17.502621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.990534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.504087+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:15:17.504087+0000","last_peered":"2024-09-17T18:15:17.504087+0000","last_clean":"2024-09-17T18:15:17.504087+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:15:17.504087+0000","last_undegraded":"2024-09-17T18:15:17.504087+0000","last_fullsized":"2024-09-17T18:15:17.504087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:14.501281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.605178+0000","last_change":"2024-09-17T18:15:16.605178+0000","last_active":"2024-09-17T18:15:16.605178+0000","last_peered":"2024-09-17T18:15:16.605178+0000","last_clean":"2024-09-17T18:15:16.605178+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:15:16.605178+0000","last_undegraded":"2024-09-17T18:15:16.605178+0000","last_fullsized":"2024-09-17T18:15:16.605178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.627620+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:15:16.627620+0000","last_peered":"2024-09-17T18:15:16.627620+0000","last_clean":"2024-09-17T18:15:16.627620+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:15:16.627620+0000","last_undegraded":"2024-09-17T18:15:16.627620+0000","last_fullsized":"2024-09-17T18:15:16.627620+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:19.851941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.499886+0000","last_change":"2024-09-17T18:15:17.499886+0000","last_active":"2024-09-17T18:15:17.499886+0000","last_peered":"2024-09-17T18:15:17.499886+0000","last_clean":"2024-09-17T18:15:17.499886+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:15:17.499886+0000","last_undegraded":"2024-09-17T18:15:17.499886+0000","last_fullsized":"2024-09-17T18:15:17.499886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.366017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:16.989689+0000","last_change":"2024-09-17T18:15:16.990099+0000","last_active":"2024-09-17T18:15:16.989689+0000","last_peered":"2024-09-17T18:15:16.989689+0000","last_clean":"2024-09-17T18:15:16.989689+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:15:16.989689+0000","last_undegraded":"2024-09-17T18:15:16.989689+0000","last_fullsized":"2024-09-17T18:15:16.989689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.933228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"25'1","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.500047+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:15:17.500047+0000","last_peered":"2024-09-17T18:15:17.500047+0000","last_clean":"2024-09-17T18:15:17.500047+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:15:17.500047+0000","last_undegraded":"2024-09-17T18:15:17.500047+0000","last_fullsized":"2024-09-17T18:15:17.500047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"25'112","reported_seq":153,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T18:15:17.419261+0000","last_change":"2024-09-17T18:15:13.924291+0000","last_active":"2024-09-17T18:15:17.419261+0000","last_peered":"2024-09-17T18:15:17.419261+0000","last_clean":"2024-09-17T18:15:17.419261+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:15:17.419261+0000","last_undegraded":"2024-09-17T18:15:17.419261+0000","last_fullsized":"2024-09-17T18:15:17.419261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:15:12.533086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.379235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247813,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":811008,"data_stored":639187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247813,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,6,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":110278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,5,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":110278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,5,8,9,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[4,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,4,5,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247813,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,3,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247813,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":639187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[2,4,5,6,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":110259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,5,6,7,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:15:22.715 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T18:15:22.715 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-17T18:15:23.004 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 27 2024-09-17T18:15:23.004 INFO:teuthology.orchestra.run.smithi087.stdout:fsid 61bbf164-0ac7-4613-95ea-b1c3bf551ccb 2024-09-17T18:15:23.004 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T18:14:58.620399+0000 2024-09-17T18:15:23.005 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T18:15:16.582941+0000 2024-09-17T18:15:23.005 INFO:teuthology.orchestra.run.smithi087.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-17T18:15:23.005 INFO:teuthology.orchestra.run.smithi087.stdout:crush_version 5 2024-09-17T18:15:23.005 INFO:teuthology.orchestra.run.smithi087.stdout:full_ratio 0.95 2024-09-17T18:15:23.005 INFO:teuthology.orchestra.run.smithi087.stdout:backfillfull_ratio 0.9 2024-09-17T18:15:23.005 INFO:teuthology.orchestra.run.smithi087.stdout:nearfull_ratio 0.85 2024-09-17T18:15:23.005 INFO:teuthology.orchestra.run.smithi087.stdout:require_min_compat_client luminous 2024-09-17T18:15:23.005 INFO:teuthology.orchestra.run.smithi087.stdout:min_compat_client jewel 2024-09-17T18:15:23.005 INFO:teuthology.orchestra.run.smithi087.stdout:require_osd_release squid 2024-09-17T18:15:23.005 INFO:teuthology.orchestra.run.smithi087.stdout:stretch_mode_enabled false 2024-09-17T18:15:23.005 INFO:teuthology.orchestra.run.smithi087.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 25 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 15.38 2024-09-17T18:15:23.005 INFO:teuthology.orchestra.run.smithi087.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 27 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 4.00 2024-09-17T18:15:23.006 INFO:teuthology.orchestra.run.smithi087.stdout: removed_snaps_queue [2~1] 2024-09-17T18:15:23.006 INFO:teuthology.orchestra.run.smithi087.stdout:max_osd 16 2024-09-17T18:15:23.006 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 up in weight 1 up_from 21 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6802/2391985960,v1:172.21.15.87:6803/2391985960] [v2:172.21.15.87:6804/2391985960,v1:172.21.15.87:6805/2391985960] exists,up 15f80e97-3ed0-4557-b1f4-7ffa88c188dd 2024-09-17T18:15:23.006 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6816/692679878,v1:172.21.15.134:6817/692679878] [v2:172.21.15.134:6818/692679878,v1:172.21.15.134:6819/692679878] exists,up a9b255d0-e8d9-4d9a-9118-742dc2ac013f 2024-09-17T18:15:23.006 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6824/197002546,v1:172.21.15.146:6825/197002546] [v2:172.21.15.146:6826/197002546,v1:172.21.15.146:6827/197002546] exists,up 76ad6be0-c351-4265-893f-cec4a82ecd76 2024-09-17T18:15:23.006 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6816/450535216,v1:172.21.15.154:6817/450535216] [v2:172.21.15.154:6818/450535216,v1:172.21.15.154:6819/450535216] exists,up 325d4c94-b21d-48cd-8f47-446e6a8bcbcb 2024-09-17T18:15:23.006 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6826/1911207814,v1:172.21.15.87:6827/1911207814] [v2:172.21.15.87:6828/1911207814,v1:172.21.15.87:6829/1911207814] exists,up 58b12ec9-29f5-4fea-a835-594fe03cd376 2024-09-17T18:15:23.006 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6824/391215769,v1:172.21.15.134:6825/391215769] [v2:172.21.15.134:6826/391215769,v1:172.21.15.134:6827/391215769] exists,up 27d3075f-32f4-4032-b0d4-fb7604c8bfda 2024-09-17T18:15:23.006 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6 up in weight 1 up_from 23 up_thru 23 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6800/1495925642,v1:172.21.15.146:6801/1495925642] [v2:172.21.15.146:6802/1495925642,v1:172.21.15.146:6803/1495925642] exists,up 4326073e-338d-47f1-9860-5e44455f49ff 2024-09-17T18:15:23.006 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6808/3979156181,v1:172.21.15.154:6809/3979156181] [v2:172.21.15.154:6810/3979156181,v1:172.21.15.154:6811/3979156181] exists,up 455a2636-b754-4e1f-8933-16cd3fc126fd 2024-09-17T18:15:23.006 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8 up in weight 1 up_from 22 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6818/740946583,v1:172.21.15.87:6819/740946583] [v2:172.21.15.87:6820/740946583,v1:172.21.15.87:6821/740946583] exists,up e64c05c6-2dce-4abc-8693-3e06b69723b6 2024-09-17T18:15:23.006 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9 up in weight 1 up_from 21 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6808/2811218890,v1:172.21.15.134:6809/2811218890] [v2:172.21.15.134:6810/2811218890,v1:172.21.15.134:6811/2811218890] exists,up 10bcf7b0-b22d-4a33-b090-b3c8083b6445 2024-09-17T18:15:23.007 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6816/1660646458,v1:172.21.15.146:6817/1660646458] [v2:172.21.15.146:6818/1660646458,v1:172.21.15.146:6819/1660646458] exists,up a69d3d5e-353a-41aa-8b1c-fe7b0a68865f 2024-09-17T18:15:23.007 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11 up in weight 1 up_from 21 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/2080834051,v1:172.21.15.154:6801/2080834051] [v2:172.21.15.154:6802/2080834051,v1:172.21.15.154:6803/2080834051] exists,up 0a0e715b-1804-4e14-87e1-8c5de231b01d 2024-09-17T18:15:23.007 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6810/249183944,v1:172.21.15.87:6811/249183944] [v2:172.21.15.87:6812/249183944,v1:172.21.15.87:6813/249183944] exists,up bdb1a692-4d6e-4a0c-a21f-db10b3af5025 2024-09-17T18:15:23.007 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13 up in weight 1 up_from 22 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/3397465529,v1:172.21.15.134:6801/3397465529] [v2:172.21.15.134:6802/3397465529,v1:172.21.15.134:6803/3397465529] exists,up 225fb253-25c2-4a10-a169-97971cb06e6c 2024-09-17T18:15:23.007 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6808/950976813,v1:172.21.15.146:6809/950976813] [v2:172.21.15.146:6810/950976813,v1:172.21.15.146:6811/950976813] exists,up 43d0e878-9725-4208-ab75-04407b592477 2024-09-17T18:15:23.007 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6824/3670919160,v1:172.21.15.154:6825/3670919160] [v2:172.21.15.154:6826/3670919160,v1:172.21.15.154:6827/3670919160] exists,up 1c97e00d-ee0d-4bed-953c-c99a67afe33e 2024-09-17T18:15:23.022 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 21 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6802/2391985960,v1:172.21.15.87:6803/2391985960] [v2:172.21.15.87:6804/2391985960,v1:172.21.15.87:6805/2391985960] exists,up 15f80e97-3ed0-4557-b1f4-7ffa88c188dd', 'osd.1 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6816/692679878,v1:172.21.15.134:6817/692679878] [v2:172.21.15.134:6818/692679878,v1:172.21.15.134:6819/692679878] exists,up a9b255d0-e8d9-4d9a-9118-742dc2ac013f', 'osd.2 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6824/197002546,v1:172.21.15.146:6825/197002546] [v2:172.21.15.146:6826/197002546,v1:172.21.15.146:6827/197002546] exists,up 76ad6be0-c351-4265-893f-cec4a82ecd76', 'osd.3 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6816/450535216,v1:172.21.15.154:6817/450535216] [v2:172.21.15.154:6818/450535216,v1:172.21.15.154:6819/450535216] exists,up 325d4c94-b21d-48cd-8f47-446e6a8bcbcb', 'osd.4 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6826/1911207814,v1:172.21.15.87:6827/1911207814] [v2:172.21.15.87:6828/1911207814,v1:172.21.15.87:6829/1911207814] exists,up 58b12ec9-29f5-4fea-a835-594fe03cd376', 'osd.5 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6824/391215769,v1:172.21.15.134:6825/391215769] [v2:172.21.15.134:6826/391215769,v1:172.21.15.134:6827/391215769] exists,up 27d3075f-32f4-4032-b0d4-fb7604c8bfda', 'osd.6 up in weight 1 up_from 23 up_thru 23 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6800/1495925642,v1:172.21.15.146:6801/1495925642] [v2:172.21.15.146:6802/1495925642,v1:172.21.15.146:6803/1495925642] exists,up 4326073e-338d-47f1-9860-5e44455f49ff', 'osd.7 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6808/3979156181,v1:172.21.15.154:6809/3979156181] [v2:172.21.15.154:6810/3979156181,v1:172.21.15.154:6811/3979156181] exists,up 455a2636-b754-4e1f-8933-16cd3fc126fd', 'osd.8 up in weight 1 up_from 22 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6818/740946583,v1:172.21.15.87:6819/740946583] [v2:172.21.15.87:6820/740946583,v1:172.21.15.87:6821/740946583] exists,up e64c05c6-2dce-4abc-8693-3e06b69723b6', 'osd.9 up in weight 1 up_from 21 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6808/2811218890,v1:172.21.15.134:6809/2811218890] [v2:172.21.15.134:6810/2811218890,v1:172.21.15.134:6811/2811218890] exists,up 10bcf7b0-b22d-4a33-b090-b3c8083b6445', 'osd.10 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6816/1660646458,v1:172.21.15.146:6817/1660646458] [v2:172.21.15.146:6818/1660646458,v1:172.21.15.146:6819/1660646458] exists,up a69d3d5e-353a-41aa-8b1c-fe7b0a68865f', 'osd.11 up in weight 1 up_from 21 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/2080834051,v1:172.21.15.154:6801/2080834051] [v2:172.21.15.154:6802/2080834051,v1:172.21.15.154:6803/2080834051] exists,up 0a0e715b-1804-4e14-87e1-8c5de231b01d', 'osd.12 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6810/249183944,v1:172.21.15.87:6811/249183944] [v2:172.21.15.87:6812/249183944,v1:172.21.15.87:6813/249183944] exists,up bdb1a692-4d6e-4a0c-a21f-db10b3af5025', 'osd.13 up in weight 1 up_from 22 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/3397465529,v1:172.21.15.134:6801/3397465529] [v2:172.21.15.134:6802/3397465529,v1:172.21.15.134:6803/3397465529] exists,up 225fb253-25c2-4a10-a169-97971cb06e6c', 'osd.14 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6808/950976813,v1:172.21.15.146:6809/950976813] [v2:172.21.15.146:6810/950976813,v1:172.21.15.146:6811/950976813] exists,up 43d0e878-9725-4208-ab75-04407b592477', 'osd.15 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6824/3670919160,v1:172.21.15.154:6825/3670919160] [v2:172.21.15.154:6826/3670919160,v1:172.21.15.154:6827/3670919160] exists,up 1c97e00d-ee0d-4bed-953c-c99a67afe33e'] 2024-09-17T18:15:23.023 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-17T18:15:23.142 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:23.143 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mon.a", 2024-09-17T18:15:23.143 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster": "ceph", 2024-09-17T18:15:23.143 INFO:teuthology.orchestra.run.smithi087.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-17T18:15:23.143 INFO:teuthology.orchestra.run.smithi087.stdout: "admin_socket_mode": "", 2024-09-17T18:15:23.143 INFO:teuthology.orchestra.run.smithi087.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-17T18:15:23.143 INFO:teuthology.orchestra.run.smithi087.stdout: "auth_client_required": "cephx, none", 2024-09-17T18:15:23.143 INFO:teuthology.orchestra.run.smithi087.stdout: "auth_cluster_required": "cephx", 2024-09-17T18:15:23.143 INFO:teuthology.orchestra.run.smithi087.stdout: "auth_debug": "true", 2024-09-17T18:15:23.143 INFO:teuthology.orchestra.run.smithi087.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-17T18:15:23.143 INFO:teuthology.orchestra.run.smithi087.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-17T18:15:23.143 INFO:teuthology.orchestra.run.smithi087.stdout: "auth_service_required": "cephx", 2024-09-17T18:15:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-17T18:15:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: "auth_supported": "cephx", 2024-09-17T18:15:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_aio": "true", 2024-09-17T18:15:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-17T18:15:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_aio_poll_ms": "250", 2024-09-17T18:15:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_aio_reap_max": "16", 2024-09-17T18:15:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_async_discard_threads": "0", 2024-09-17T18:15:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_block_size": "4096", 2024-09-17T18:15:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_debug_aio": "false", 2024-09-17T18:15:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-17T18:15:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-17T18:15:23.144 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_debug_inflight_ios": "false", 2024-09-17T18:15:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_enable_discard": "false", 2024-09-17T18:15:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_flock_retry": "3", 2024-09-17T18:15:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-17T18:15:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_inject_crash": "0", 2024-09-17T18:15:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-17T18:15:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_ioring": "false", 2024-09-17T18:15:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_ioring_hipri": "false", 2024-09-17T18:15:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-17T18:15:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-17T18:15:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-17T18:15:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-17T18:15:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-17T18:15:23.145 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-17T18:15:23.146 INFO:teuthology.orchestra.run.smithi087.stdout: "bdev_type": "", 2024-09-17T18:15:23.146 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_alloc_size": "1048576", 2024-09-17T18:15:23.146 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_allocator": "hybrid", 2024-09-17T18:15:23.146 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_buffered_io": "true", 2024-09-17T18:15:23.146 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_check_for_zeros": "false", 2024-09-17T18:15:23.146 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-17T18:15:23.146 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-17T18:15:23.146 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_compact_log_sync": "false", 2024-09-17T18:15:23.146 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-17T18:15:23.146 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-17T18:15:23.146 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-17T18:15:23.146 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-17T18:15:23.147 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_max_log_runway": "4194304", 2024-09-17T18:15:23.147 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_max_prefetch": "1048576", 2024-09-17T18:15:23.147 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_min_flush_size": "524288", 2024-09-17T18:15:23.147 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_min_log_runway": "1048576", 2024-09-17T18:15:23.147 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_replay_recovery": "false", 2024-09-17T18:15:23.147 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-17T18:15:23.147 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-17T18:15:23.147 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_sync_write": "false", 2024-09-17T18:15:23.147 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-17T18:15:23.147 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-17T18:15:23.147 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-17T18:15:23.147 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_allocation_from_file": "true", 2024-09-17T18:15:23.148 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_allocator": "hybrid", 2024-09-17T18:15:23.148 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_async_db_compaction": "true", 2024-09-17T18:15:23.148 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-17T18:15:23.148 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-17T18:15:23.148 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-17T18:15:23.148 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-17T18:15:23.148 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_bdev_label_multi": "true", 2024-09-17T18:15:23.148 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-17T18:15:23.148 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-17T18:15:23.148 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-17T18:15:23.148 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-17T18:15:23.148 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-17T18:15:23.149 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_block_create": "true", 2024-09-17T18:15:23.149 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_block_db_create": "false", 2024-09-17T18:15:23.149 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_block_db_path": "", 2024-09-17T18:15:23.149 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_block_db_size": "0", 2024-09-17T18:15:23.149 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_block_path": "", 2024-09-17T18:15:23.149 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_block_preallocate_file": "false", 2024-09-17T18:15:23.149 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_block_size": "107374182400", 2024-09-17T18:15:23.149 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_block_wal_create": "false", 2024-09-17T18:15:23.149 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_block_wal_path": "", 2024-09-17T18:15:23.149 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_block_wal_size": "100663296", 2024-09-17T18:15:23.149 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_bluefs": "true", 2024-09-17T18:15:23.149 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-17T18:15:23.149 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-17T18:15:23.150 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-17T18:15:23.150 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-17T18:15:23.150 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-17T18:15:23.150 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T18:15:23.150 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T18:15:23.150 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-17T18:15:23.150 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T18:15:23.150 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_autotune": "true", 2024-09-17T18:15:23.150 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-17T18:15:23.150 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-17T18:15:23.150 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-17T18:15:23.150 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-17T18:15:23.150 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_size": "0", 2024-09-17T18:15:23.151 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-17T18:15:23.151 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-17T18:15:23.151 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-17T18:15:23.151 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-17T18:15:23.151 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_type": "2q", 2024-09-17T18:15:23.151 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-17T18:15:23.151 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_clone_cow": "true", 2024-09-17T18:15:23.151 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-17T18:15:23.151 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-17T18:15:23.151 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-17T18:15:23.151 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-17T18:15:23.151 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-17T18:15:23.152 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-17T18:15:23.152 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-17T18:15:23.152 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_compression_mode": "none", 2024-09-17T18:15:23.152 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-17T18:15:23.152 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_csum_type": "crc32c", 2024-09-17T18:15:23.152 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-17T18:15:23.152 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-17T18:15:23.152 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_freelist": "false", 2024-09-17T18:15:23.152 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-17T18:15:23.152 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-17T18:15:23.152 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-17T18:15:23.152 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-17T18:15:23.152 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-17T18:15:23.153 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-17T18:15:23.153 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-17T18:15:23.153 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-17T18:15:23.153 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-17T18:15:23.153 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-17T18:15:23.153 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-17T18:15:23.153 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-17T18:15:23.153 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_small_allocations": "0", 2024-09-17T18:15:23.153 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-17T18:15:23.153 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_default_buffered_read": "true", 2024-09-17T18:15:23.153 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_default_buffered_write": "false", 2024-09-17T18:15:23.153 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-17T18:15:23.154 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-17T18:15:23.154 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-17T18:15:23.154 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-17T18:15:23.154 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-17T18:15:23.154 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-17T18:15:23.154 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-17T18:15:23.154 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-17T18:15:23.154 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-17T18:15:23.154 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fail_eio": "false", 2024-09-17T18:15:23.154 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-17T18:15:23.154 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-17T18:15:23.154 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-17T18:15:23.154 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-17T18:15:23.155 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-17T18:15:23.155 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-17T18:15:23.155 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_on_mount": "false", 2024-09-17T18:15:23.155 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-17T18:15:23.155 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_on_umount": "false", 2024-09-17T18:15:23.155 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-17T18:15:23.155 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-17T18:15:23.155 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-17T18:15:23.155 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-17T18:15:23.155 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-17T18:15:23.155 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-17T18:15:23.155 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-17T18:15:23.155 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-17T18:15:23.156 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_ignore_data_csum": "false", 2024-09-17T18:15:23.156 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-17T18:15:23.156 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-17T18:15:23.156 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-17T18:15:23.156 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-17T18:15:23.156 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_log_op_age": "5.000000", 2024-09-17T18:15:23.156 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_max_alloc_size": "0", 2024-09-17T18:15:23.156 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_max_blob_size": "0", 2024-09-17T18:15:23.156 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-17T18:15:23.156 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-17T18:15:23.156 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-17T18:15:23.156 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_max_deferred_txc": "32", 2024-09-17T18:15:23.156 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_min_alloc_size": "0", 2024-09-17T18:15:23.157 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-17T18:15:23.157 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-17T18:15:23.157 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_nid_prealloc": "1024", 2024-09-17T18:15:23.157 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-17T18:15:23.157 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-17T18:15:23.157 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-17T18:15:23.157 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-17T18:15:23.157 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_retry_disk_reads": "3", 2024-09-17T18:15:23.157 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_rocksdb_cf": "true", 2024-09-17T18:15:23.157 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-17T18:15:23.157 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-17T18:15:23.157 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-17T18:15:23.158 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-17T18:15:23.158 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-17T18:15:23.158 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-17T18:15:23.158 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-17T18:15:23.158 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-17T18:15:23.158 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_spdk_mem": "512", 2024-09-17T18:15:23.158 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-17T18:15:23.158 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-17T18:15:23.158 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-17T18:15:23.158 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-17T18:15:23.158 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-17T18:15:23.158 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-17T18:15:23.158 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-17T18:15:23.159 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_tracing": "false", 2024-09-17T18:15:23.159 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-17T18:15:23.159 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-17T18:15:23.159 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-17T18:15:23.159 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-17T18:15:23.159 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-17T18:15:23.159 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-17T18:15:23.159 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-17T18:15:23.159 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-17T18:15:23.159 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-17T18:15:23.159 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_write_v2": "false", 2024-09-17T18:15:23.159 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_write_v2_random": "false", 2024-09-17T18:15:23.160 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_zero_block_detection": "false", 2024-09-17T18:15:23.160 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-17T18:15:23.160 INFO:teuthology.orchestra.run.smithi087.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-17T18:15:23.160 INFO:teuthology.orchestra.run.smithi087.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-17T18:15:23.160 INFO:teuthology.orchestra.run.smithi087.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-17T18:15:23.160 INFO:teuthology.orchestra.run.smithi087.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-17T18:15:23.160 INFO:teuthology.orchestra.run.smithi087.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-17T18:15:23.160 INFO:teuthology.orchestra.run.smithi087.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-17T18:15:23.160 INFO:teuthology.orchestra.run.smithi087.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-17T18:15:23.160 INFO:teuthology.orchestra.run.smithi087.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-17T18:15:23.160 INFO:teuthology.orchestra.run.smithi087.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-17T18:15:23.160 INFO:teuthology.orchestra.run.smithi087.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-17T18:15:23.160 INFO:teuthology.orchestra.run.smithi087.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-17T18:15:23.161 INFO:teuthology.orchestra.run.smithi087.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-17T18:15:23.161 INFO:teuthology.orchestra.run.smithi087.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-17T18:15:23.161 INFO:teuthology.orchestra.run.smithi087.stdout: "cephx_cluster_require_signatures": "false", 2024-09-17T18:15:23.161 INFO:teuthology.orchestra.run.smithi087.stdout: "cephx_cluster_require_version": "2", 2024-09-17T18:15:23.161 INFO:teuthology.orchestra.run.smithi087.stdout: "cephx_require_signatures": "false", 2024-09-17T18:15:23.161 INFO:teuthology.orchestra.run.smithi087.stdout: "cephx_require_version": "2", 2024-09-17T18:15:23.161 INFO:teuthology.orchestra.run.smithi087.stdout: "cephx_service_require_signatures": "false", 2024-09-17T18:15:23.161 INFO:teuthology.orchestra.run.smithi087.stdout: "cephx_service_require_version": "2", 2024-09-17T18:15:23.161 INFO:teuthology.orchestra.run.smithi087.stdout: "cephx_sign_messages": "true", 2024-09-17T18:15:23.161 INFO:teuthology.orchestra.run.smithi087.stdout: "chdir": "", 2024-09-17T18:15:23.161 INFO:teuthology.orchestra.run.smithi087.stdout: "client_acl_type": "", 2024-09-17T18:15:23.161 INFO:teuthology.orchestra.run.smithi087.stdout: "client_asio_thread_count": "2", 2024-09-17T18:15:23.161 INFO:teuthology.orchestra.run.smithi087.stdout: "client_cache_mid": "0.750000", 2024-09-17T18:15:23.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_cache_size": "16384", 2024-09-17T18:15:23.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_caps_release_delay": "5", 2024-09-17T18:15:23.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_check_pool_perm": "true", 2024-09-17T18:15:23.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-17T18:15:23.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_debug_force_sync_read": "false", 2024-09-17T18:15:23.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_debug_getattr_caps": "false", 2024-09-17T18:15:23.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_debug_inject_features": "", 2024-09-17T18:15:23.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_debug_inject_tick_delay": "0", 2024-09-17T18:15:23.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-17T18:15:23.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_die_on_failed_remount": "false", 2024-09-17T18:15:23.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_dirsize_rbytes": "true", 2024-09-17T18:15:23.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_force_lazyio": "false", 2024-09-17T18:15:23.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_fs": "", 2024-09-17T18:15:23.163 INFO:teuthology.orchestra.run.smithi087.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-17T18:15:23.163 INFO:teuthology.orchestra.run.smithi087.stdout: "client_inject_release_failure": "false", 2024-09-17T18:15:23.163 INFO:teuthology.orchestra.run.smithi087.stdout: "client_max_inline_size": "4096", 2024-09-17T18:15:23.163 INFO:teuthology.orchestra.run.smithi087.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-17T18:15:23.163 INFO:teuthology.orchestra.run.smithi087.stdout: "client_mds_namespace": "", 2024-09-17T18:15:23.163 INFO:teuthology.orchestra.run.smithi087.stdout: "client_metadata": "", 2024-09-17T18:15:23.163 INFO:teuthology.orchestra.run.smithi087.stdout: "client_mount_gid": "-1", 2024-09-17T18:15:23.163 INFO:teuthology.orchestra.run.smithi087.stdout: "client_mount_timeout": "300", 2024-09-17T18:15:23.163 INFO:teuthology.orchestra.run.smithi087.stdout: "client_mount_uid": "-1", 2024-09-17T18:15:23.163 INFO:teuthology.orchestra.run.smithi087.stdout: "client_mountpoint": "/", 2024-09-17T18:15:23.163 INFO:teuthology.orchestra.run.smithi087.stdout: "client_notify_timeout": "10", 2024-09-17T18:15:23.163 INFO:teuthology.orchestra.run.smithi087.stdout: "client_oc": "true", 2024-09-17T18:15:23.163 INFO:teuthology.orchestra.run.smithi087.stdout: "client_oc_max_dirty": "104857600", 2024-09-17T18:15:23.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-17T18:15:23.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_oc_max_objects": "1000", 2024-09-17T18:15:23.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_oc_size": "209715200", 2024-09-17T18:15:23.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_oc_target_dirty": "8388608", 2024-09-17T18:15:23.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_permissions": "true", 2024-09-17T18:15:23.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_quota": "true", 2024-09-17T18:15:23.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_quota_df": "true", 2024-09-17T18:15:23.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_readahead_max_bytes": "0", 2024-09-17T18:15:23.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_readahead_max_periods": "4", 2024-09-17T18:15:23.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_readahead_min": "131072", 2024-09-17T18:15:23.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_reconnect_stale": "false", 2024-09-17T18:15:23.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_shutdown_timeout": "30", 2024-09-17T18:15:23.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_snapdir": ".snap", 2024-09-17T18:15:23.165 INFO:teuthology.orchestra.run.smithi087.stdout: "client_tick_interval": "1", 2024-09-17T18:15:23.165 INFO:teuthology.orchestra.run.smithi087.stdout: "client_trace": "", 2024-09-17T18:15:23.165 INFO:teuthology.orchestra.run.smithi087.stdout: "client_try_dentry_invalidate": "false", 2024-09-17T18:15:23.165 INFO:teuthology.orchestra.run.smithi087.stdout: "client_use_faked_inos": "false", 2024-09-17T18:15:23.165 INFO:teuthology.orchestra.run.smithi087.stdout: "client_use_random_mds": "false", 2024-09-17T18:15:23.165 INFO:teuthology.orchestra.run.smithi087.stdout: "clog_to_graylog": "false", 2024-09-17T18:15:23.165 INFO:teuthology.orchestra.run.smithi087.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-17T18:15:23.165 INFO:teuthology.orchestra.run.smithi087.stdout: "clog_to_graylog_port": "12201", 2024-09-17T18:15:23.165 INFO:teuthology.orchestra.run.smithi087.stdout: "clog_to_monitors": "default=true", 2024-09-17T18:15:23.165 INFO:teuthology.orchestra.run.smithi087.stdout: "clog_to_syslog": "false", 2024-09-17T18:15:23.165 INFO:teuthology.orchestra.run.smithi087.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-17T18:15:23.165 INFO:teuthology.orchestra.run.smithi087.stdout: "clog_to_syslog_level": "info", 2024-09-17T18:15:23.165 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "-", 2024-09-17T18:15:23.166 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_network": "", 2024-09-17T18:15:23.166 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_network_interface": "", 2024-09-17T18:15:23.166 INFO:teuthology.orchestra.run.smithi087.stdout: "compressor_zlib_isal": "false", 2024-09-17T18:15:23.166 INFO:teuthology.orchestra.run.smithi087.stdout: "compressor_zlib_level": "5", 2024-09-17T18:15:23.166 INFO:teuthology.orchestra.run.smithi087.stdout: "compressor_zlib_winsize": "-15", 2024-09-17T18:15:23.166 INFO:teuthology.orchestra.run.smithi087.stdout: "compressor_zstd_level": "1", 2024-09-17T18:15:23.166 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-17T18:15:23.166 INFO:teuthology.orchestra.run.smithi087.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-17T18:15:23.166 INFO:teuthology.orchestra.run.smithi087.stdout: "crimson_alien_op_num_threads": "6", 2024-09-17T18:15:23.166 INFO:teuthology.orchestra.run.smithi087.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-17T18:15:23.166 INFO:teuthology.orchestra.run.smithi087.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-17T18:15:23.166 INFO:teuthology.orchestra.run.smithi087.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-17T18:15:23.166 INFO:teuthology.orchestra.run.smithi087.stdout: "crimson_osd_stat_interval": "0", 2024-09-17T18:15:23.166 INFO:teuthology.orchestra.run.smithi087.stdout: "crimson_seastar_cpu_cores": "", 2024-09-17T18:15:23.167 INFO:teuthology.orchestra.run.smithi087.stdout: "crimson_seastar_num_threads": "0", 2024-09-17T18:15:23.167 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_location": "", 2024-09-17T18:15:23.167 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_location_hook": "", 2024-09-17T18:15:23.167 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_location_hook_timeout": "10", 2024-09-17T18:15:23.167 INFO:teuthology.orchestra.run.smithi087.stdout: "daemonize": "false", 2024-09-17T18:15:23.167 INFO:teuthology.orchestra.run.smithi087.stdout: "daos_pool": "tank", 2024-09-17T18:15:23.167 INFO:teuthology.orchestra.run.smithi087.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-17T18:15:23.167 INFO:teuthology.orchestra.run.smithi087.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-17T18:15:23.167 INFO:teuthology.orchestra.run.smithi087.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-17T18:15:23.167 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_alienstore": "0/5", 2024-09-17T18:15:23.167 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_allow_any_pool_priority": "false", 2024-09-17T18:15:23.167 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_asok": "1/5", 2024-09-17T18:15:23.167 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_asok_assert_abort": "false", 2024-09-17T18:15:23.168 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_asserts_on_shutdown": "true", 2024-09-17T18:15:23.168 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_auth": "20/20", 2024-09-17T18:15:23.168 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_bdev": "1/3", 2024-09-17T18:15:23.168 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_bluefs": "1/5", 2024-09-17T18:15:23.168 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_bluestore": "1/5", 2024-09-17T18:15:23.168 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_buffer": "0/1", 2024-09-17T18:15:23.168 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_ceph_dedup": "0/5", 2024-09-17T18:15:23.168 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_ceph_exporter": "1/5", 2024-09-17T18:15:23.168 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_cephfs_mirror": "0/5", 2024-09-17T18:15:23.168 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_cephsqlite": "0/5", 2024-09-17T18:15:23.168 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_client": "0/5", 2024-09-17T18:15:23.168 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_compressor": "1/5", 2024-09-17T18:15:23.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_context": "0/1", 2024-09-17T18:15:23.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_crimson_interrupt": "0/5", 2024-09-17T18:15:23.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_crush": "1/1", 2024-09-17T18:15:23.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_crypto": "1/5", 2024-09-17T18:15:23.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_cyanstore": "0/5", 2024-09-17T18:15:23.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_deliberately_leak_memory": "false", 2024-09-17T18:15:23.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_disable_randomized_ping": "false", 2024-09-17T18:15:23.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_dpdk": "1/5", 2024-09-17T18:15:23.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_eventtrace": "1/5", 2024-09-17T18:15:23.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_filer": "0/1", 2024-09-17T18:15:23.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_filestore": "1/3", 2024-09-17T18:15:23.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_finisher": "1/1", 2024-09-17T18:15:23.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_fuse": "1/5", 2024-09-17T18:15:23.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_heartbeat_testing_span": "0", 2024-09-17T18:15:23.170 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_heartbeatmap": "1/5", 2024-09-17T18:15:23.170 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-17T18:15:23.170 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_javaclient": "1/5", 2024-09-17T18:15:23.170 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_journal": "1/3", 2024-09-17T18:15:23.170 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_journaler": "0/5", 2024-09-17T18:15:23.170 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_kstore": "1/5", 2024-09-17T18:15:23.170 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_lockdep": "0/1", 2024-09-17T18:15:23.170 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_mclock": "1/5", 2024-09-17T18:15:23.170 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_mds": "1/5", 2024-09-17T18:15:23.170 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_mds_balancer": "1/5", 2024-09-17T18:15:23.170 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_mds_locker": "1/5", 2024-09-17T18:15:23.170 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_mds_log": "1/5", 2024-09-17T18:15:23.170 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_mds_log_expire": "1/5", 2024-09-17T18:15:23.171 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_mds_migrator": "1/5", 2024-09-17T18:15:23.171 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_mds_quiesce": "3/5", 2024-09-17T18:15:23.171 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_memstore": "1/5", 2024-09-17T18:15:23.171 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_mgr": "2/5", 2024-09-17T18:15:23.171 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_mgrc": "1/5", 2024-09-17T18:15:23.171 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_mon": "20/20", 2024-09-17T18:15:23.171 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_monc": "0/10", 2024-09-17T18:15:23.171 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_ms": "1/1", 2024-09-17T18:15:23.171 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_none": "0/5", 2024-09-17T18:15:23.171 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_objclass": "0/5", 2024-09-17T18:15:23.171 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_objectcacher": "0/5", 2024-09-17T18:15:23.171 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_objecter": "0/1", 2024-09-17T18:15:23.171 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_optracker": "0/5", 2024-09-17T18:15:23.172 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_osd": "1/5", 2024-09-17T18:15:23.172 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_paxos": "20/20", 2024-09-17T18:15:23.172 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_perfcounter": "1/5", 2024-09-17T18:15:23.172 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_prioritycache": "1/5", 2024-09-17T18:15:23.172 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_rados": "0/5", 2024-09-17T18:15:23.172 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_rbd": "0/5", 2024-09-17T18:15:23.172 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_rbd_mirror": "0/5", 2024-09-17T18:15:23.172 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_rbd_pwl": "0/5", 2024-09-17T18:15:23.172 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_rbd_replay": "0/5", 2024-09-17T18:15:23.172 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_refs": "0/0", 2024-09-17T18:15:23.172 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_reserver": "1/1", 2024-09-17T18:15:23.172 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_rgw": "1/5", 2024-09-17T18:15:23.172 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_rgw_access": "1/5", 2024-09-17T18:15:23.173 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_rgw_datacache": "1/5", 2024-09-17T18:15:23.173 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_rgw_dbstore": "1/5", 2024-09-17T18:15:23.173 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_rgw_flight": "1/5", 2024-09-17T18:15:23.173 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-17T18:15:23.173 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_rgw_notification": "1/5", 2024-09-17T18:15:23.173 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_rgw_sync": "1/5", 2024-09-17T18:15:23.173 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_rocksdb": "4/5", 2024-09-17T18:15:23.173 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_seastore": "0/5", 2024-09-17T18:15:23.173 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_seastore_backref": "0/5", 2024-09-17T18:15:23.173 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_seastore_cache": "0/5", 2024-09-17T18:15:23.173 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_seastore_cleaner": "0/5", 2024-09-17T18:15:23.173 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_seastore_device": "0/5", 2024-09-17T18:15:23.173 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_seastore_epm": "0/5", 2024-09-17T18:15:23.174 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-17T18:15:23.174 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_seastore_journal": "0/5", 2024-09-17T18:15:23.174 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_seastore_lba": "0/5", 2024-09-17T18:15:23.174 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_seastore_odata": "0/5", 2024-09-17T18:15:23.174 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_seastore_omap": "0/5", 2024-09-17T18:15:23.174 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_seastore_onode": "0/5", 2024-09-17T18:15:23.176 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_seastore_t": "0/5", 2024-09-17T18:15:23.176 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_seastore_tm": "0/5", 2024-09-17T18:15:23.176 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_striper": "0/1", 2024-09-17T18:15:23.176 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_test": "0/5", 2024-09-17T18:15:23.176 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_throttle": "1/1", 2024-09-17T18:15:23.176 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_timer": "0/1", 2024-09-17T18:15:23.177 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_tp": "0/5", 2024-09-17T18:15:23.177 INFO:teuthology.orchestra.run.smithi087.stdout: "debug_trace": "1/5", 2024-09-17T18:15:23.177 INFO:teuthology.orchestra.run.smithi087.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-17T18:15:23.177 INFO:teuthology.orchestra.run.smithi087.stdout: "device_failure_prediction_mode": "none", 2024-09-17T18:15:23.177 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-17T18:15:23.177 INFO:teuthology.orchestra.run.smithi087.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-17T18:15:23.177 INFO:teuthology.orchestra.run.smithi087.stdout: "err_to_graylog": "false", 2024-09-17T18:15:23.177 INFO:teuthology.orchestra.run.smithi087.stdout: "err_to_journald": "false", 2024-09-17T18:15:23.177 INFO:teuthology.orchestra.run.smithi087.stdout: "err_to_stderr": "true", 2024-09-17T18:15:23.177 INFO:teuthology.orchestra.run.smithi087.stdout: "err_to_syslog": "false", 2024-09-17T18:15:23.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event_tracing": "false", 2024-09-17T18:15:23.177 INFO:teuthology.orchestra.run.smithi087.stdout: "exporter_addr": "0.0.0.0", 2024-09-17T18:15:23.177 INFO:teuthology.orchestra.run.smithi087.stdout: "exporter_cert_file": "", 2024-09-17T18:15:23.178 INFO:teuthology.orchestra.run.smithi087.stdout: "exporter_http_port": "9926", 2024-09-17T18:15:23.178 INFO:teuthology.orchestra.run.smithi087.stdout: "exporter_key_file": "", 2024-09-17T18:15:23.178 INFO:teuthology.orchestra.run.smithi087.stdout: "exporter_prio_limit": "5", 2024-09-17T18:15:23.178 INFO:teuthology.orchestra.run.smithi087.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-17T18:15:23.178 INFO:teuthology.orchestra.run.smithi087.stdout: "exporter_sort_metrics": "true", 2024-09-17T18:15:23.178 INFO:teuthology.orchestra.run.smithi087.stdout: "exporter_stats_period": "5", 2024-09-17T18:15:23.178 INFO:teuthology.orchestra.run.smithi087.stdout: "fake_statfs_for_testing": "0", 2024-09-17T18:15:23.178 INFO:teuthology.orchestra.run.smithi087.stdout: "fatal_signal_handlers": "true", 2024-09-17T18:15:23.178 INFO:teuthology.orchestra.run.smithi087.stdout: "filer_max_purge_ops": "10", 2024-09-17T18:15:23.178 INFO:teuthology.orchestra.run.smithi087.stdout: "filer_max_truncate_ops": "128", 2024-09-17T18:15:23.178 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_apply_finisher_threads": "1", 2024-09-17T18:15:23.178 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_blackhole": "false", 2024-09-17T18:15:23.178 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_btrfs_clone_range": "true", 2024-09-17T18:15:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_btrfs_snap": "true", 2024-09-17T18:15:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_caller_concurrency": "10", 2024-09-17T18:15:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_collect_device_partition_information": "true", 2024-09-17T18:15:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_commit_timeout": "600.000000", 2024-09-17T18:15:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_debug_inject_read_err": "false", 2024-09-17T18:15:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_debug_omap_check": "false", 2024-09-17T18:15:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_debug_verify_split": "false", 2024-09-17T18:15:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_dump_file": "", 2024-09-17T18:15:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-17T18:15:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-17T18:15:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_fadvise": "true", 2024-09-17T18:15:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_fail_eio": "true", 2024-09-17T18:15:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_fd_cache_shards": "16", 2024-09-17T18:15:23.180 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_fd_cache_size": "128", 2024-09-17T18:15:23.180 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_fiemap": "false", 2024-09-17T18:15:23.180 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_fiemap_threshold": "4096", 2024-09-17T18:15:23.180 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-17T18:15:23.180 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-17T18:15:23.180 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_inject_stall": "0", 2024-09-17T18:15:23.180 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_journal_parallel": "false", 2024-09-17T18:15:23.180 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_journal_trailing": "false", 2024-09-17T18:15:23.180 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_journal_writeahead": "false", 2024-09-17T18:15:23.180 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_kill_at": "0", 2024-09-17T18:15:23.180 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-17T18:15:23.180 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-17T18:15:23.181 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-17T18:15:23.181 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-17T18:15:23.181 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-17T18:15:23.181 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_max_inline_xattrs": "0", 2024-09-17T18:15:23.181 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-17T18:15:23.181 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-17T18:15:23.181 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-17T18:15:23.181 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-17T18:15:23.181 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_max_xattr_value_size": "0", 2024-09-17T18:15:23.181 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-17T18:15:23.181 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-17T18:15:23.181 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-17T18:15:23.181 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_merge_threshold": "-10", 2024-09-17T18:15:23.182 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-17T18:15:23.182 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_odsync_write": "false", 2024-09-17T18:15:23.182 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_omap_backend": "rocksdb", 2024-09-17T18:15:23.182 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_omap_backend_path": "", 2024-09-17T18:15:23.182 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-17T18:15:23.182 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-17T18:15:23.182 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-17T18:15:23.182 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_op_thread_timeout": "60", 2024-09-17T18:15:23.182 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_op_threads": "2", 2024-09-17T18:15:23.182 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_punch_hole": "false", 2024-09-17T18:15:23.182 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-17T18:15:23.182 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-17T18:15:23.183 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-17T18:15:23.183 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-17T18:15:23.183 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-17T18:15:23.183 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-17T18:15:23.183 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-17T18:15:23.183 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-17T18:15:23.183 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-17T18:15:23.183 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_queue_max_ops": "50", 2024-09-17T18:15:23.183 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-17T18:15:23.183 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_seek_data_hole": "false", 2024-09-17T18:15:23.183 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_sloppy_crc": "false", 2024-09-17T18:15:23.183 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-17T18:15:23.183 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_splice": "false", 2024-09-17T18:15:23.183 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_split_multiple": "2", 2024-09-17T18:15:23.184 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_split_rand_factor": "20", 2024-09-17T18:15:23.184 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_update_to": "1000", 2024-09-17T18:15:23.184 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-17T18:15:23.184 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-17T18:15:23.184 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-17T18:15:23.184 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-17T18:15:23.184 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-17T18:15:23.184 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-17T18:15:23.184 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_wbthrottle_enable": "true", 2024-09-17T18:15:23.184 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-17T18:15:23.184 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-17T18:15:23.184 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-17T18:15:23.185 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-17T18:15:23.185 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-17T18:15:23.185 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-17T18:15:23.185 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_xfs_extsize": "false", 2024-09-17T18:15:23.185 INFO:teuthology.orchestra.run.smithi087.stdout: "filestore_zfs_snap": "false", 2024-09-17T18:15:23.185 INFO:teuthology.orchestra.run.smithi087.stdout: "fio_dir": "/tmp/fio", 2024-09-17T18:15:23.185 INFO:teuthology.orchestra.run.smithi087.stdout: "fsid": "61bbf164-0ac7-4613-95ea-b1c3bf551ccb", 2024-09-17T18:15:23.185 INFO:teuthology.orchestra.run.smithi087.stdout: "fuse_allow_other": "true", 2024-09-17T18:15:23.185 INFO:teuthology.orchestra.run.smithi087.stdout: "fuse_atomic_o_trunc": "true", 2024-09-17T18:15:23.185 INFO:teuthology.orchestra.run.smithi087.stdout: "fuse_big_writes": "true", 2024-09-17T18:15:23.185 INFO:teuthology.orchestra.run.smithi087.stdout: "fuse_debug": "false", 2024-09-17T18:15:23.185 INFO:teuthology.orchestra.run.smithi087.stdout: "fuse_default_permissions": "false", 2024-09-17T18:15:23.185 INFO:teuthology.orchestra.run.smithi087.stdout: "fuse_disable_pagecache": "false", 2024-09-17T18:15:23.186 INFO:teuthology.orchestra.run.smithi087.stdout: "fuse_max_write": "0", 2024-09-17T18:15:23.186 INFO:teuthology.orchestra.run.smithi087.stdout: "fuse_multithreaded": "true", 2024-09-17T18:15:23.186 INFO:teuthology.orchestra.run.smithi087.stdout: "fuse_require_active_mds": "true", 2024-09-17T18:15:23.186 INFO:teuthology.orchestra.run.smithi087.stdout: "fuse_set_user_groups": "true", 2024-09-17T18:15:23.186 INFO:teuthology.orchestra.run.smithi087.stdout: "fuse_splice_move": "true", 2024-09-17T18:15:23.186 INFO:teuthology.orchestra.run.smithi087.stdout: "fuse_splice_read": "true", 2024-09-17T18:15:23.186 INFO:teuthology.orchestra.run.smithi087.stdout: "fuse_splice_write": "true", 2024-09-17T18:15:23.186 INFO:teuthology.orchestra.run.smithi087.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-17T18:15:23.186 INFO:teuthology.orchestra.run.smithi087.stdout: "fuse_use_invalidate_cb": "true", 2024-09-17T18:15:23.186 INFO:teuthology.orchestra.run.smithi087.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-17T18:15:23.186 INFO:teuthology.orchestra.run.smithi087.stdout: "gss_target_name": "ceph", 2024-09-17T18:15:23.186 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_file": "", 2024-09-17T18:15:23.186 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_inject_failure": "0", 2024-09-17T18:15:23.186 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_interval": "5", 2024-09-17T18:15:23.187 INFO:teuthology.orchestra.run.smithi087.stdout: "host": "smithi087", 2024-09-17T18:15:23.187 INFO:teuthology.orchestra.run.smithi087.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-17T18:15:23.187 INFO:teuthology.orchestra.run.smithi087.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-17T18:15:23.187 INFO:teuthology.orchestra.run.smithi087.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-17T18:15:23.187 INFO:teuthology.orchestra.run.smithi087.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-17T18:15:23.187 INFO:teuthology.orchestra.run.smithi087.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-17T18:15:23.187 INFO:teuthology.orchestra.run.smithi087.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-17T18:15:23.187 INFO:teuthology.orchestra.run.smithi087.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-17T18:15:23.187 INFO:teuthology.orchestra.run.smithi087.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-17T18:15:23.187 INFO:teuthology.orchestra.run.smithi087.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-17T18:15:23.187 INFO:teuthology.orchestra.run.smithi087.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-17T18:15:23.187 INFO:teuthology.orchestra.run.smithi087.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-17T18:15:23.188 INFO:teuthology.orchestra.run.smithi087.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-17T18:15:23.188 INFO:teuthology.orchestra.run.smithi087.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-17T18:15:23.188 INFO:teuthology.orchestra.run.smithi087.stdout: "inject_early_sigterm": "false", 2024-09-17T18:15:23.188 INFO:teuthology.orchestra.run.smithi087.stdout: "jaeger_agent_port": "6799", 2024-09-17T18:15:23.188 INFO:teuthology.orchestra.run.smithi087.stdout: "jaeger_tracing_enable": "false", 2024-09-17T18:15:23.188 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_aio": "true", 2024-09-17T18:15:23.188 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_align_min_size": "65536", 2024-09-17T18:15:23.188 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_block_align": "true", 2024-09-17T18:15:23.188 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_block_size": "4096", 2024-09-17T18:15:23.188 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_dio": "true", 2024-09-17T18:15:23.188 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_discard": "false", 2024-09-17T18:15:23.188 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_force_aio": "false", 2024-09-17T18:15:23.189 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_ignore_corruption": "false", 2024-09-17T18:15:23.189 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_max_write_bytes": "10485760", 2024-09-17T18:15:23.189 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_max_write_entries": "100", 2024-09-17T18:15:23.189 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_replay_from": "0", 2024-09-17T18:15:23.189 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-17T18:15:23.189 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-17T18:15:23.189 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-17T18:15:23.189 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-17T18:15:23.189 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_write_header_frequency": "0", 2024-09-17T18:15:23.189 INFO:teuthology.orchestra.run.smithi087.stdout: "journal_zero_on_create": "false", 2024-09-17T18:15:23.189 INFO:teuthology.orchestra.run.smithi087.stdout: "journaler_prefetch_periods": "10", 2024-09-17T18:15:23.189 INFO:teuthology.orchestra.run.smithi087.stdout: "journaler_prezero_periods": "5", 2024-09-17T18:15:23.189 INFO:teuthology.orchestra.run.smithi087.stdout: "journaler_write_head_interval": "15", 2024-09-17T18:15:23.190 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "", 2024-09-17T18:15:23.190 INFO:teuthology.orchestra.run.smithi087.stdout: "keyfile": "", 2024-09-17T18:15:23.190 INFO:teuthology.orchestra.run.smithi087.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-17T18:15:23.190 INFO:teuthology.orchestra.run.smithi087.stdout: "kstore_backend": "rocksdb", 2024-09-17T18:15:23.190 INFO:teuthology.orchestra.run.smithi087.stdout: "kstore_default_stripe_size": "65536", 2024-09-17T18:15:23.190 INFO:teuthology.orchestra.run.smithi087.stdout: "kstore_fsck_on_mount": "false", 2024-09-17T18:15:23.190 INFO:teuthology.orchestra.run.smithi087.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-17T18:15:23.190 INFO:teuthology.orchestra.run.smithi087.stdout: "kstore_max_bytes": "67108864", 2024-09-17T18:15:23.190 INFO:teuthology.orchestra.run.smithi087.stdout: "kstore_max_ops": "512", 2024-09-17T18:15:23.190 INFO:teuthology.orchestra.run.smithi087.stdout: "kstore_nid_prealloc": "1024", 2024-09-17T18:15:23.190 INFO:teuthology.orchestra.run.smithi087.stdout: "kstore_onode_map_size": "1024", 2024-09-17T18:15:23.190 INFO:teuthology.orchestra.run.smithi087.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-17T18:15:23.191 INFO:teuthology.orchestra.run.smithi087.stdout: "kstore_sync_submit_transaction": "false", 2024-09-17T18:15:23.191 INFO:teuthology.orchestra.run.smithi087.stdout: "kstore_sync_transaction": "false", 2024-09-17T18:15:23.191 INFO:teuthology.orchestra.run.smithi087.stdout: "librados_thread_count": "2", 2024-09-17T18:15:23.191 INFO:teuthology.orchestra.run.smithi087.stdout: "lockdep": "false", 2024-09-17T18:15:23.191 INFO:teuthology.orchestra.run.smithi087.stdout: "lockdep_force_backtrace": "false", 2024-09-17T18:15:23.191 INFO:teuthology.orchestra.run.smithi087.stdout: "log_coarse_timestamps": "true", 2024-09-17T18:15:23.191 INFO:teuthology.orchestra.run.smithi087.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-17T18:15:23.191 INFO:teuthology.orchestra.run.smithi087.stdout: "log_flush_on_exit": "false", 2024-09-17T18:15:23.191 INFO:teuthology.orchestra.run.smithi087.stdout: "log_graylog_host": "127.0.0.1", 2024-09-17T18:15:23.191 INFO:teuthology.orchestra.run.smithi087.stdout: "log_graylog_port": "12201", 2024-09-17T18:15:23.191 INFO:teuthology.orchestra.run.smithi087.stdout: "log_max_new": "1000", 2024-09-17T18:15:23.191 INFO:teuthology.orchestra.run.smithi087.stdout: "log_max_recent": "10000", 2024-09-17T18:15:23.191 INFO:teuthology.orchestra.run.smithi087.stdout: "log_stderr_prefix": "", 2024-09-17T18:15:23.192 INFO:teuthology.orchestra.run.smithi087.stdout: "log_stop_at_utilization": "0.970000", 2024-09-17T18:15:23.192 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": "true", 2024-09-17T18:15:23.192 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_graylog": "false", 2024-09-17T18:15:23.192 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_journald": "false", 2024-09-17T18:15:23.192 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_stderr": "false", 2024-09-17T18:15:23.192 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_syslog": "false", 2024-09-17T18:15:23.192 INFO:teuthology.orchestra.run.smithi087.stdout: "max_rotating_auth_attempts": "10", 2024-09-17T18:15:23.192 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-17T18:15:23.192 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_action_on_write_error": "1", 2024-09-17T18:15:23.192 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_alternate_name_max": "8192", 2024-09-17T18:15:23.192 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_asio_thread_count": "2", 2024-09-17T18:15:23.192 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_export_pin": "true", 2024-09-17T18:15:23.192 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_fragment_dirs": "true", 2024-09-17T18:15:23.193 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-17T18:15:23.193 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_fragment_interval": "5", 2024-09-17T18:15:23.193 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-17T18:15:23.193 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-17T18:15:23.193 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_interval": "10", 2024-09-17T18:15:23.193 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_max": "-1", 2024-09-17T18:15:23.193 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_max_until": "-1", 2024-09-17T18:15:23.193 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_merge_size": "50", 2024-09-17T18:15:23.193 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_midchunk": "0.300000", 2024-09-17T18:15:23.193 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-17T18:15:23.193 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_min_start": "0.200000", 2024-09-17T18:15:23.193 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_minchunk": "0.001000", 2024-09-17T18:15:23.193 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_mode": "0", 2024-09-17T18:15:23.193 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_need_max": "1.200000", 2024-09-17T18:15:23.194 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_need_min": "0.800000", 2024-09-17T18:15:23.194 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_overload_epochs": "2", 2024-09-17T18:15:23.194 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-17T18:15:23.194 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-17T18:15:23.194 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_split_bits": "3", 2024-09-17T18:15:23.194 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-17T18:15:23.194 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_split_size": "10000", 2024-09-17T18:15:23.194 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-17T18:15:23.194 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_target_decay": "10.000000", 2024-09-17T18:15:23.194 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-17T18:15:23.194 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_beacon_grace": "15.000000", 2024-09-17T18:15:23.194 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_beacon_interval": "4.000000", 2024-09-17T18:15:23.194 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-17T18:15:23.195 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-17T18:15:23.195 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache_mid": "0.700000", 2024-09-17T18:15:23.195 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-17T18:15:23.195 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache_quiesce_delay": "0", 2024-09-17T18:15:23.195 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-17T18:15:23.195 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-17T18:15:23.195 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-17T18:15:23.195 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache_release_free_interval": "10", 2024-09-17T18:15:23.195 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache_reservation": "0.050000", 2024-09-17T18:15:23.195 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-17T18:15:23.195 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache_trim_interval": "1", 2024-09-17T18:15:23.195 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache_trim_threshold": "262144", 2024-09-17T18:15:23.195 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-17T18:15:23.196 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-17T18:15:23.196 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-17T18:15:23.196 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_client_prealloc_inos": "1000", 2024-09-17T18:15:23.196 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-17T18:15:23.196 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_connect_bootstrapping": "false", 2024-09-17T18:15:23.196 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_damage_table_max_entries": "10000", 2024-09-17T18:15:23.196 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-17T18:15:23.196 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_debug_auth_pins": "false", 2024-09-17T18:15:23.196 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_debug_frag": "false", 2024-09-17T18:15:23.196 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_debug_scatterstat": "false", 2024-09-17T18:15:23.196 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_debug_subtrees": "false", 2024-09-17T18:15:23.196 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_decay_halflife": "5.000000", 2024-09-17T18:15:23.196 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_default_dir_hash": "2", 2024-09-17T18:15:23.197 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_defer_session_stale": "true", 2024-09-17T18:15:23.197 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_deny_all_reconnect": "false", 2024-09-17T18:15:23.197 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_dir_keys_per_op": "16384", 2024-09-17T18:15:23.197 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_dir_max_commit_size": "10", 2024-09-17T18:15:23.197 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_dir_max_entries": "0", 2024-09-17T18:15:23.197 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_dir_prefetch": "true", 2024-09-17T18:15:23.197 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-17T18:15:23.197 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-17T18:15:23.197 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_dump_cache_on_map": "false", 2024-09-17T18:15:23.197 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-17T18:15:23.197 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-17T18:15:23.197 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_early_reply": "true", 2024-09-17T18:15:23.197 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_enable_op_tracker": "true", 2024-09-17T18:15:23.198 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_enforce_unique_name": "true", 2024-09-17T18:15:23.198 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-17T18:15:23.198 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-17T18:15:23.198 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_export_ephemeral_random": "true", 2024-09-17T18:15:23.198 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-17T18:15:23.198 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-17T18:15:23.198 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-17T18:15:23.198 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-17T18:15:23.198 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-17T18:15:23.198 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-17T18:15:23.198 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-17T18:15:23.198 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-17T18:15:23.198 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_health_summarize_threshold": "10", 2024-09-17T18:15:23.199 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-17T18:15:23.199 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-17T18:15:23.199 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_inject_health_dummy": "false", 2024-09-17T18:15:23.199 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-17T18:15:23.199 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_inject_migrator_session_race": "false", 2024-09-17T18:15:23.199 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-17T18:15:23.199 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-17T18:15:23.199 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-17T18:15:23.199 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_join_fs": "", 2024-09-17T18:15:23.199 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_journal_format": "1", 2024-09-17T18:15:23.199 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-17T18:15:23.199 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_kill_create_at": "0", 2024-09-17T18:15:23.199 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_kill_dirfrag_at": "0", 2024-09-17T18:15:23.199 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_kill_export_at": "0", 2024-09-17T18:15:23.200 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_kill_import_at": "0", 2024-09-17T18:15:23.200 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_kill_journal_at": "0", 2024-09-17T18:15:23.200 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_kill_journal_expire_at": "0", 2024-09-17T18:15:23.200 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_kill_journal_replay_at": "0", 2024-09-17T18:15:23.200 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_kill_link_at": "0", 2024-09-17T18:15:23.200 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_kill_mdstable_at": "0", 2024-09-17T18:15:23.200 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_kill_openc_at": "0", 2024-09-17T18:15:23.200 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_kill_rename_at": "0", 2024-09-17T18:15:23.200 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_kill_shutdown_at": "0", 2024-09-17T18:15:23.200 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log_event_large_threshold": "524288", 2024-09-17T18:15:23.200 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log_events_per_segment": "1024", 2024-09-17T18:15:23.200 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-17T18:15:23.200 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log_max_events": "-1", 2024-09-17T18:15:23.201 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log_max_segments": "128", 2024-09-17T18:15:23.201 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log_pause": "false", 2024-09-17T18:15:23.201 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log_segment_size": "0", 2024-09-17T18:15:23.201 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-17T18:15:23.201 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-17T18:15:23.201 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-17T18:15:23.201 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log_trim_threshold": "128", 2024-09-17T18:15:23.201 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-17T18:15:23.201 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log_warn_factor": "2.000000", 2024-09-17T18:15:23.201 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_max_caps_per_client": "1048576", 2024-09-17T18:15:23.201 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_max_completed_flushes": "100000", 2024-09-17T18:15:23.201 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_max_completed_requests": "100000", 2024-09-17T18:15:23.201 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_max_export_size": "20971520", 2024-09-17T18:15:23.202 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_max_file_recover": "32", 2024-09-17T18:15:23.202 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_max_purge_files": "64", 2024-09-17T18:15:23.202 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_max_purge_ops": "8192", 2024-09-17T18:15:23.202 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-17T18:15:23.202 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-17T18:15:23.202 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_max_snaps_per_dir": "100", 2024-09-17T18:15:23.202 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_metrics_update_interval": "2", 2024-09-17T18:15:23.202 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_min_caps_per_client": "100", 2024-09-17T18:15:23.202 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_min_caps_working_set": "10000", 2024-09-17T18:15:23.202 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-17T18:15:23.202 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_numa_node": "-1", 2024-09-17T18:15:23.202 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-17T18:15:23.202 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_op_complaint_time": "30.000000", 2024-09-17T18:15:23.203 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_op_history_duration": "600", 2024-09-17T18:15:23.203 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_op_history_size": "20", 2024-09-17T18:15:23.203 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_op_history_slow_op_size": "20", 2024-09-17T18:15:23.203 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-17T18:15:23.203 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_op_log_threshold": "5", 2024-09-17T18:15:23.203 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_ping_grace": "15", 2024-09-17T18:15:23.203 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_ping_interval": "5", 2024-09-17T18:15:23.203 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-17T18:15:23.203 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-17T18:15:23.203 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_recall_max_caps": "30000", 2024-09-17T18:15:23.203 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-17T18:15:23.203 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-17T18:15:23.203 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-17T18:15:23.205 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_recall_warning_threshold": "262144", 2024-09-17T18:15:23.205 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-17T18:15:23.205 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_replay_interval": "1.000000", 2024-09-17T18:15:23.205 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-17T18:15:23.205 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-17T18:15:23.205 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_root_ino_gid": "0", 2024-09-17T18:15:23.205 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_root_ino_uid": "0", 2024-09-17T18:15:23.205 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-17T18:15:23.205 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_scrub_stats_review_period": "1", 2024-09-17T18:15:23.205 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-17T18:15:23.205 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-17T18:15:23.206 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-17T18:15:23.206 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-17T18:15:23.206 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-17T18:15:23.206 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-17T18:15:23.206 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-17T18:15:23.206 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-17T18:15:23.206 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-17T18:15:23.206 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-17T18:15:23.206 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-17T18:15:23.206 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_shutdown_check": "0", 2024-09-17T18:15:23.206 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_skip_ino": "0", 2024-09-17T18:15:23.206 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-17T18:15:23.206 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_snap_max_uid": "4294967294", 2024-09-17T18:15:23.206 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_snap_min_uid": "0", 2024-09-17T18:15:23.207 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_snap_rstat": "false", 2024-09-17T18:15:23.207 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_standby_replay_damaged": "false", 2024-09-17T18:15:23.207 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_symlink_recovery": "true", 2024-09-17T18:15:23.207 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-17T18:15:23.207 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_thrash_exports": "0", 2024-09-17T18:15:23.207 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_thrash_fragments": "0", 2024-09-17T18:15:23.207 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_tick_interval": "5.000000", 2024-09-17T18:15:23.207 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_valgrind_exit": "false", 2024-09-17T18:15:23.207 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_verify_backtrace": "1", 2024-09-17T18:15:23.207 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_verify_scatter": "false", 2024-09-17T18:15:23.207 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-17T18:15:23.207 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_wipe_sessions": "false", 2024-09-17T18:15:23.208 INFO:teuthology.orchestra.run.smithi087.stdout: "mempool_debug": "false", 2024-09-17T18:15:23.208 INFO:teuthology.orchestra.run.smithi087.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-17T18:15:23.208 INFO:teuthology.orchestra.run.smithi087.stdout: "memstore_device_bytes": "1073741824", 2024-09-17T18:15:23.208 INFO:teuthology.orchestra.run.smithi087.stdout: "memstore_page_set": "false", 2024-09-17T18:15:23.208 INFO:teuthology.orchestra.run.smithi087.stdout: "memstore_page_size": "65536", 2024-09-17T18:15:23.208 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_client_bytes": "134217728", 2024-09-17T18:15:23.208 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_client_messages": "512", 2024-09-17T18:15:23.208 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-17T18:15:23.208 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-17T18:15:23.208 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-17T18:15:23.208 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-17T18:15:23.208 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_disabled_modules": "", 2024-09-17T18:15:23.208 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_enable_op_tracker": "true", 2024-09-17T18:15:23.209 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-17T18:15:23.209 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_max_pg_creating": "1024", 2024-09-17T18:15:23.209 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_max_pg_num_change": "128", 2024-09-17T18:15:23.209 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_mds_bytes": "134217728", 2024-09-17T18:15:23.209 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_mds_messages": "128", 2024-09-17T18:15:23.209 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-17T18:15:23.209 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_mon_bytes": "134217728", 2024-09-17T18:15:23.209 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_mon_messages": "128", 2024-09-17T18:15:23.209 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-17T18:15:23.210 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-17T18:15:23.210 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_op_history_duration": "600", 2024-09-17T18:15:23.210 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_op_history_size": "20", 2024-09-17T18:15:23.210 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-17T18:15:23.210 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-17T18:15:23.210 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_op_log_threshold": "5", 2024-09-17T18:15:23.210 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_osd_bytes": "536870912", 2024-09-17T18:15:23.210 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_osd_messages": "8192", 2024-09-17T18:15:23.210 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_pool": "true", 2024-09-17T18:15:23.210 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-17T18:15:23.211 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_standby_modules": "true", 2024-09-17T18:15:23.211 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_stats_period": "5", 2024-09-17T18:15:23.211 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_stats_threshold": "5", 2024-09-17T18:15:23.211 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_tick_period": "2", 2024-09-17T18:15:23.211 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-17T18:15:23.211 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-17T18:15:23.211 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_allow_pool_delete": "true", 2024-09-17T18:15:23.211 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_allow_pool_size_one": "true", 2024-09-17T18:15:23.211 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_auth_validate_all_caps": "true", 2024-09-17T18:15:23.211 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-17T18:15:23.211 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-17T18:15:23.211 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_client_bytes": "104857600", 2024-09-17T18:15:23.211 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_client_directed_command_retry": "5", 2024-09-17T18:15:23.212 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-17T18:15:23.212 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-17T18:15:23.212 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-17T18:15:23.212 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-17T18:15:23.212 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_client_hunt_parallel": "3", 2024-09-17T18:15:23.212 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_client_log_interval": "1.000000", 2024-09-17T18:15:23.212 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-17T18:15:23.212 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_client_ping_interval": "10.000000", 2024-09-17T18:15:23.212 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-17T18:15:23.212 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_client_target_rank": "-1", 2024-09-17T18:15:23.212 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-17T18:15:23.212 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-17T18:15:23.212 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-17T18:15:23.213 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_cluster_log_level": "debug", 2024-09-17T18:15:23.213 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_cluster_log_to_file": "true", 2024-09-17T18:15:23.213 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-17T18:15:23.213 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-17T18:15:23.213 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-17T18:15:23.213 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_cluster_log_to_journald": "false", 2024-09-17T18:15:23.213 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-17T18:15:23.213 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-17T18:15:23.213 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-17T18:15:23.213 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_compact_on_bootstrap": "false", 2024-09-17T18:15:23.213 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_compact_on_start": "false", 2024-09-17T18:15:23.213 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_compact_on_trim": "true", 2024-09-17T18:15:23.213 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-17T18:15:23.214 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-17T18:15:23.214 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-17T18:15:23.214 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_cpu_threads": "4", 2024-09-17T18:15:23.214 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_crush_min_required_version": "hammer", 2024-09-17T18:15:23.214 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_daemon_bytes": "419430400", 2024-09-17T18:15:23.214 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-17T18:15:23.214 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_data_avail_crit": "5", 2024-09-17T18:15:23.214 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_data_avail_warn": "5", 2024-09-17T18:15:23.214 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_data_size_warn": "16106127360", 2024-09-17T18:15:23.214 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-17T18:15:23.214 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-17T18:15:23.214 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_debug_dump_json": "false", 2024-09-17T18:15:23.214 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-17T18:15:23.215 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_debug_dump_transactions": "false", 2024-09-17T18:15:23.215 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_debug_extra_checks": "false", 2024-09-17T18:15:23.215 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-17T18:15:23.215 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-17T18:15:23.215 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_debug_no_require_reef": "false", 2024-09-17T18:15:23.215 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_debug_no_require_squid": "false", 2024-09-17T18:15:23.215 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-17T18:15:23.215 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-17T18:15:23.215 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-17T18:15:23.215 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_down_mkfs_grace": "120", 2024-09-17T18:15:23.215 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_down_uptime_grace": "60", 2024-09-17T18:15:23.215 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_election_default_strategy": "1", 2024-09-17T18:15:23.215 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_election_timeout": "5.000000", 2024-09-17T18:15:23.216 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-17T18:15:23.216 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_elector_ping_divisor": "2", 2024-09-17T18:15:23.216 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-17T18:15:23.216 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_enable_op_tracker": "true", 2024-09-17T18:15:23.216 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_fake_pool_delete": "false", 2024-09-17T18:15:23.216 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_force_quorum_join": "false", 2024-09-17T18:15:23.216 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-17T18:15:23.216 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_globalid_prealloc": "10000", 2024-09-17T18:15:23.216 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_health_detail_to_clog": "false", 2024-09-17T18:15:23.216 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_health_log_update_period": "5", 2024-09-17T18:15:23.216 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_health_max_detail": "50", 2024-09-17T18:15:23.216 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_health_to_clog": "true", 2024-09-17T18:15:23.216 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_health_to_clog_interval": "600", 2024-09-17T18:15:23.217 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-17T18:15:23.217 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_host": "172.21.15.87,172.21.15.134,172.21.15.146", 2024-09-17T18:15:23.217 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_host_override": "", 2024-09-17T18:15:23.217 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_initial_members": "", 2024-09-17T18:15:23.217 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-17T18:15:23.217 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-17T18:15:23.217 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-17T18:15:23.217 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-17T18:15:23.217 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-17T18:15:23.217 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_lease": "5.000000", 2024-09-17T18:15:23.217 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-17T18:15:23.217 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-17T18:15:23.218 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_log_full_interval": "50", 2024-09-17T18:15:23.218 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_log_max": "10000", 2024-09-17T18:15:23.218 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_log_max_summary": "50", 2024-09-17T18:15:23.218 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-17T18:15:23.218 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_max_log_epochs": "500", 2024-09-17T18:15:23.218 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-17T18:15:23.218 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-17T18:15:23.218 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-17T18:15:23.218 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_max_osd": "10000", 2024-09-17T18:15:23.218 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_max_pg_per_osd": "10000", 2024-09-17T18:15:23.218 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_max_pool_pg_num": "65536", 2024-09-17T18:15:23.219 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-17T18:15:23.219 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-17T18:15:23.219 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_mds_force_trim_to": "0", 2024-09-17T18:15:23.219 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_mds_skip_sanity": "false", 2024-09-17T18:15:23.219 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_memory_autotune": "true", 2024-09-17T18:15:23.219 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_memory_target": "2147483648", 2024-09-17T18:15:23.219 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_mgr_beacon_grace": "30", 2024-09-17T18:15:23.219 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-17T18:15:23.219 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_mgr_digest_period": "5", 2024-09-17T18:15:23.219 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_mgr_inactive_grace": "60", 2024-09-17T18:15:23.219 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-17T18:15:23.219 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-17T18:15:23.219 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_min_osdmap_epochs": "500", 2024-09-17T18:15:23.220 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-17T18:15:23.220 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-17T18:15:23.220 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_op_complaint_time": "30", 2024-09-17T18:15:23.220 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_op_history_duration": "600", 2024-09-17T18:15:23.220 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_op_history_size": "20", 2024-09-17T18:15:23.220 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_op_history_slow_op_size": "20", 2024-09-17T18:15:23.220 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-17T18:15:23.220 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_op_log_threshold": "5", 2024-09-17T18:15:23.220 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-17T18:15:23.220 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-17T18:15:23.220 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-17T18:15:23.220 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_auto_mark_in": "false", 2024-09-17T18:15:23.220 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-17T18:15:23.221 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-17T18:15:23.221 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-17T18:15:23.221 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_cache_size": "500", 2024-09-17T18:15:23.221 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-17T18:15:23.221 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-17T18:15:23.221 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-17T18:15:23.221 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_down_out_interval": "600", 2024-09-17T18:15:23.221 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-17T18:15:23.221 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-17T18:15:23.221 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_force_trim_to": "0", 2024-09-17T18:15:23.221 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-17T18:15:23.221 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-17T18:15:23.221 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-17T18:15:23.222 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-17T18:15:23.222 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-17T18:15:23.222 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-17T18:15:23.222 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-17T18:15:23.222 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_min_down_reporters": "2", 2024-09-17T18:15:23.222 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-17T18:15:23.222 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-17T18:15:23.222 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-17T18:15:23.222 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-17T18:15:23.222 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-17T18:15:23.222 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-17T18:15:23.222 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_report_timeout": "900", 2024-09-17T18:15:23.222 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-17T18:15:23.223 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-17T18:15:23.223 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-17T18:15:23.223 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-17T18:15:23.223 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-17T18:15:23.223 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-17T18:15:23.223 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-17T18:15:23.223 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-17T18:15:23.223 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-17T18:15:23.223 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_pg_stuck_threshold": "60", 2024-09-17T18:15:23.223 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-17T18:15:23.223 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-17T18:15:23.223 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-17T18:15:23.224 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-17T18:15:23.224 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-17T18:15:23.224 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-17T18:15:23.224 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_probe_timeout": "2.000000", 2024-09-17T18:15:23.224 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_reweight_max_change": "0.050000", 2024-09-17T18:15:23.224 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_reweight_max_osds": "4", 2024-09-17T18:15:23.224 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-17T18:15:23.224 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-17T18:15:23.224 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-17T18:15:23.224 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-17T18:15:23.224 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-17T18:15:23.224 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_scrub_interval": "300", 2024-09-17T18:15:23.224 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_scrub_max_keys": "100", 2024-09-17T18:15:23.225 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_scrub_timeout": "300", 2024-09-17T18:15:23.225 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_session_timeout": "300", 2024-09-17T18:15:23.225 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_smart_report_timeout": "5", 2024-09-17T18:15:23.225 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_stat_smooth_intervals": "6", 2024-09-17T18:15:23.225 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-17T18:15:23.225 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_stretch_pool_min_size": "2", 2024-09-17T18:15:23.225 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_stretch_pool_size": "4", 2024-09-17T18:15:23.225 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-17T18:15:23.225 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-17T18:15:23.225 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_sync_debug": "false", 2024-09-17T18:15:23.225 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-17T18:15:23.225 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-17T18:15:23.225 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_sync_provider_kill_at": "0", 2024-09-17T18:15:23.225 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_sync_requester_kill_at": "0", 2024-09-17T18:15:23.226 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_sync_timeout": "60.000000", 2024-09-17T18:15:23.226 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_target_pg_per_osd": "100", 2024-09-17T18:15:23.226 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_tick_interval": "5", 2024-09-17T18:15:23.226 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_timecheck_interval": "300.000000", 2024-09-17T18:15:23.226 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-17T18:15:23.226 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_use_min_delay_socket": "false", 2024-09-17T18:15:23.226 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_older_version_delay": "604800", 2024-09-17T18:15:23.226 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-17T18:15:23.226 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-17T18:15:23.226 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-17T18:15:23.226 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-17T18:15:23.226 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-17T18:15:23.227 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-17T18:15:23.227 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-17T18:15:23.227 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_misplaced": "false", 2024-09-17T18:15:23.227 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-17T18:15:23.227 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_older_version": "true", 2024-09-17T18:15:23.227 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-17T18:15:23.227 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-17T18:15:23.227 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-17T18:15:23.227 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-17T18:15:23.227 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-17T18:15:23.227 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-17T18:15:23.227 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-17T18:15:23.227 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-17T18:15:23.228 INFO:teuthology.orchestra.run.smithi087.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-17T18:15:23.228 INFO:teuthology.orchestra.run.smithi087.stdout: "monmap": "", 2024-09-17T18:15:23.228 INFO:teuthology.orchestra.run.smithi087.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-17T18:15:23.228 INFO:teuthology.orchestra.run.smithi087.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-17T18:15:23.228 INFO:teuthology.orchestra.run.smithi087.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-17T18:15:23.228 INFO:teuthology.orchestra.run.smithi087.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-17T18:15:23.228 INFO:teuthology.orchestra.run.smithi087.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-17T18:15:23.228 INFO:teuthology.orchestra.run.smithi087.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-17T18:15:23.228 INFO:teuthology.orchestra.run.smithi087.stdout: "motr_tracing_enabled": "false", 2024-09-17T18:15:23.228 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_op_threads": "3", 2024-09-17T18:15:23.228 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-17T18:15:23.228 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_cm": "false", 2024-09-17T18:15:23.229 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_device_name": "", 2024-09-17T18:15:23.229 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_dscp": "96", 2024-09-17T18:15:23.229 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-17T18:15:23.229 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-17T18:15:23.229 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_local_gid": "", 2024-09-17T18:15:23.229 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-17T18:15:23.229 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_port_num": "1", 2024-09-17T18:15:23.229 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-17T18:15:23.229 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-17T18:15:23.229 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-17T18:15:23.229 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-17T18:15:23.229 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_sl": "3", 2024-09-17T18:15:23.229 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_support_srq": "true", 2024-09-17T18:15:23.230 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_rdma_type": "ib", 2024-09-17T18:15:23.230 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_async_reap_threshold": "5", 2024-09-17T18:15:23.230 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_bind_before_connect": "false", 2024-09-17T18:15:23.230 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_bind_ipv4": "true", 2024-09-17T18:15:23.230 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_bind_ipv6": "false", 2024-09-17T18:15:23.230 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_bind_msgr1": "true", 2024-09-17T18:15:23.230 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_bind_msgr2": "true", 2024-09-17T18:15:23.230 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_bind_port_max": "7568", 2024-09-17T18:15:23.230 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_bind_port_min": "6800", 2024-09-17T18:15:23.230 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-17T18:15:23.230 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_bind_retry_count": "3", 2024-09-17T18:15:23.230 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_bind_retry_delay": "5", 2024-09-17T18:15:23.230 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_blackhole_client": "false", 2024-09-17T18:15:23.231 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_blackhole_mds": "false", 2024-09-17T18:15:23.231 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_blackhole_mgr": "false", 2024-09-17T18:15:23.231 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_blackhole_mon": "false", 2024-09-17T18:15:23.231 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_blackhole_osd": "false", 2024-09-17T18:15:23.231 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_client_mode": "crc secure", 2024-09-17T18:15:23.231 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-17T18:15:23.231 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_cluster_mode": "crc secure", 2024-09-17T18:15:23.231 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_cluster_type": "", 2024-09-17T18:15:23.231 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_compress_secure": "false", 2024-09-17T18:15:23.231 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_connection_idle_timeout": "900", 2024-09-17T18:15:23.231 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_connection_ready_timeout": "10", 2024-09-17T18:15:23.231 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_crc_data": "true", 2024-09-17T18:15:23.231 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_crc_header": "true", 2024-09-17T18:15:23.232 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_die_on_bad_msg": "false", 2024-09-17T18:15:23.232 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_die_on_bug": "true", 2024-09-17T18:15:23.232 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_die_on_old_message": "true", 2024-09-17T18:15:23.232 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_die_on_skipped_message": "false", 2024-09-17T18:15:23.232 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-17T18:15:23.232 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-17T18:15:23.232 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dpdk_coremask": "0xF", 2024-09-17T18:15:23.232 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-17T18:15:23.232 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-17T18:15:23.232 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dpdk_enable_tso": "true", 2024-09-17T18:15:23.232 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-17T18:15:23.232 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-17T18:15:23.233 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dpdk_hugepages": "", 2024-09-17T18:15:23.233 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-17T18:15:23.233 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-17T18:15:23.233 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dpdk_lro": "true", 2024-09-17T18:15:23.233 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dpdk_memory_channel": "4", 2024-09-17T18:15:23.233 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-17T18:15:23.233 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dpdk_pmd": "", 2024-09-17T18:15:23.233 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dpdk_port_id": "0", 2024-09-17T18:15:23.233 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-17T18:15:23.233 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-17T18:15:23.233 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_dump_on_send": "false", 2024-09-17T18:15:23.233 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_initial_backoff": "0.200000", 2024-09-17T18:15:23.233 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_inject_delay_max": "1.000000", 2024-09-17T18:15:23.234 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-17T18:15:23.234 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_inject_delay_type": "", 2024-09-17T18:15:23.234 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-17T18:15:23.234 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_inject_network_congestion": "0", 2024-09-17T18:15:23.234 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_inject_socket_failures": "2500", 2024-09-17T18:15:23.234 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_learn_addr_from_peer": "true", 2024-09-17T18:15:23.234 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_max_accept_failures": "4", 2024-09-17T18:15:23.234 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_max_backoff": "15.000000", 2024-09-17T18:15:23.234 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_mon_client_mode": "secure crc", 2024-09-17T18:15:23.234 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-17T18:15:23.234 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_mon_service_mode": "secure crc", 2024-09-17T18:15:23.234 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_osd_compress_min_size": "1024", 2024-09-17T18:15:23.234 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_osd_compress_mode": "none", 2024-09-17T18:15:23.234 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-17T18:15:23.235 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-17T18:15:23.235 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_pq_min_cost": "65536", 2024-09-17T18:15:23.235 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_public_type": "", 2024-09-17T18:15:23.235 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_service_mode": "crc secure", 2024-09-17T18:15:23.235 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_tcp_listen_backlog": "512", 2024-09-17T18:15:23.235 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_tcp_nodelay": "true", 2024-09-17T18:15:23.235 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-17T18:15:23.235 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_tcp_rcvbuf": "0", 2024-09-17T18:15:23.235 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-17T18:15:23.235 INFO:teuthology.orchestra.run.smithi087.stdout: "ms_type": "async+posix", 2024-09-17T18:15:23.235 INFO:teuthology.orchestra.run.smithi087.stdout: "no_config_file": "false", 2024-09-17T18:15:23.235 INFO:teuthology.orchestra.run.smithi087.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-17T18:15:23.235 INFO:teuthology.orchestra.run.smithi087.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-17T18:15:23.236 INFO:teuthology.orchestra.run.smithi087.stdout: "objecter_completion_locks_per_session": "32", 2024-09-17T18:15:23.236 INFO:teuthology.orchestra.run.smithi087.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-17T18:15:23.236 INFO:teuthology.orchestra.run.smithi087.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-17T18:15:23.236 INFO:teuthology.orchestra.run.smithi087.stdout: "objecter_inflight_ops": "1024", 2024-09-17T18:15:23.236 INFO:teuthology.orchestra.run.smithi087.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-17T18:15:23.236 INFO:teuthology.orchestra.run.smithi087.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-17T18:15:23.236 INFO:teuthology.orchestra.run.smithi087.stdout: "objecter_tick_interval": "5.000000", 2024-09-17T18:15:23.236 INFO:teuthology.orchestra.run.smithi087.stdout: "objecter_timeout": "10.000000", 2024-09-17T18:15:23.236 INFO:teuthology.orchestra.run.smithi087.stdout: "objectstore_blackhole": "false", 2024-09-17T18:15:23.236 INFO:teuthology.orchestra.run.smithi087.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-17T18:15:23.236 INFO:teuthology.orchestra.run.smithi087.stdout: "openssl_engine_opts": "", 2024-09-17T18:15:23.236 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_agent_delay_time": "5.000000", 2024-09-17T18:15:23.236 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_agent_hist_halflife": "1000", 2024-09-17T18:15:23.237 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_agent_max_low_ops": "2", 2024-09-17T18:15:23.237 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_agent_max_ops": "4", 2024-09-17T18:15:23.237 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-17T18:15:23.237 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-17T18:15:23.237 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_agent_slop": "0.020000", 2024-09-17T18:15:23.237 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-17T18:15:23.237 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-17T18:15:23.237 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_asio_thread_count": "2", 2024-09-17T18:15:23.237 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_async_recovery_min_cost": "100", 2024-09-17T18:15:23.237 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-17T18:15:23.237 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-17T18:15:23.237 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_backfill_scan_max": "512", 2024-09-17T18:15:23.237 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_backfill_scan_min": "64", 2024-09-17T18:15:23.238 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_backoff_on_degraded": "false", 2024-09-17T18:15:23.238 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_backoff_on_peering": "false", 2024-09-17T18:15:23.238 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_backoff_on_unfound": "true", 2024-09-17T18:15:23.238 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_beacon_report_interval": "300", 2024-09-17T18:15:23.238 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bench_duration": "30", 2024-09-17T18:15:23.238 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-17T18:15:23.238 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bench_max_block_size": "67108864", 2024-09-17T18:15:23.238 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-17T18:15:23.238 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_blkin_trace_all": "false", 2024-09-17T18:15:23.238 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-17T18:15:23.238 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-17T18:15:23.238 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-17T18:15:23.238 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-17T18:15:23.239 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_check_for_log_corruption": "false", 2024-09-17T18:15:23.239 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-17T18:15:23.239 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-17T18:15:23.239 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-17T18:15:23.239 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-17T18:15:23.239 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_class_update_on_start": "true", 2024-09-17T18:15:23.239 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_client_message_cap": "256", 2024-09-17T18:15:23.239 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_client_message_size_cap": "524288000", 2024-09-17T18:15:23.239 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_client_op_priority": "63", 2024-09-17T18:15:23.239 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_client_watch_timeout": "30", 2024-09-17T18:15:23.239 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_command_max_records": "256", 2024-09-17T18:15:23.239 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_compact_on_start": "false", 2024-09-17T18:15:23.239 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-17T18:15:23.240 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-17T18:15:23.240 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-17T18:15:23.240 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_crush_update_on_start": "true", 2024-09-17T18:15:23.240 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_crush_update_weight_set": "true", 2024-09-17T18:15:23.240 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-17T18:15:23.240 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-17T18:15:23.240 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-17T18:15:23.240 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-17T18:15:23.240 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-17T18:15:23.240 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_feed_pullee": "-1", 2024-09-17T18:15:23.240 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-17T18:15:23.240 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-17T18:15:23.240 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-17T18:15:23.241 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_misdirected_ops": "false", 2024-09-17T18:15:23.241 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_no_acting_change": "false", 2024-09-17T18:15:23.241 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_no_purge_strays": "false", 2024-09-17T18:15:23.241 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_op_order": "false", 2024-09-17T18:15:23.241 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-17T18:15:23.241 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-17T18:15:23.241 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-17T18:15:23.241 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-17T18:15:23.241 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_shutdown": "false", 2024-09-17T18:15:23.241 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-17T18:15:23.241 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-17T18:15:23.241 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_trim_objects": "false", 2024-09-17T18:15:23.241 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-17T18:15:23.242 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-17T18:15:23.242 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_verify_snaps": "false", 2024-09-17T18:15:23.242 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-17T18:15:23.242 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-17T18:15:23.242 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_deep_scrub_keys": "1024", 2024-09-17T18:15:23.242 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-17T18:15:23.242 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-17T18:15:23.242 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-17T18:15:23.242 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_deep_scrub_stride": "524288", 2024-09-17T18:15:23.242 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-17T18:15:23.242 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-17T18:15:23.242 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_default_notify_timeout": "30", 2024-09-17T18:15:23.242 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_delete_sleep": "0.000000", 2024-09-17T18:15:23.243 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-17T18:15:23.243 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-17T18:15:23.243 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-17T18:15:23.243 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_discard_disconnected_ops": "true", 2024-09-17T18:15:23.243 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_ec_partial_reads": "true", 2024-09-17T18:15:23.243 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_enable_op_tracker": "true", 2024-09-17T18:15:23.243 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-17T18:15:23.243 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-17T18:15:23.243 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-17T18:15:23.243 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-17T18:15:23.243 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_fast_info": "true", 2024-09-17T18:15:23.243 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_fast_shutdown": "true", 2024-09-17T18:15:23.243 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-17T18:15:23.244 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-17T18:15:23.244 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-17T18:15:23.244 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-17T18:15:23.244 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-17T18:15:23.244 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_function_tracing": "false", 2024-09-17T18:15:23.244 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_heartbeat_grace": "20", 2024-09-17T18:15:23.244 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_heartbeat_interval": "6", 2024-09-17T18:15:23.244 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-17T18:15:23.244 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_heartbeat_min_peers": "10", 2024-09-17T18:15:23.244 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_heartbeat_min_size": "2000", 2024-09-17T18:15:23.244 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_heartbeat_stale": "600", 2024-09-17T18:15:23.244 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-17T18:15:23.244 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_hit_set_max_size": "100000", 2024-09-17T18:15:23.245 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_hit_set_min_size": "1000", 2024-09-17T18:15:23.245 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-17T18:15:23.245 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-17T18:15:23.245 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-17T18:15:23.245 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-17T18:15:23.245 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-17T18:15:23.245 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-17T18:15:23.245 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_journal_size": "5120", 2024-09-17T18:15:23.245 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_kill_backfill_at": "0", 2024-09-17T18:15:23.245 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-17T18:15:23.245 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_map_cache_size": "50", 2024-09-17T18:15:23.245 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_map_dedup": "true", 2024-09-17T18:15:23.245 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_map_message_max": "40", 2024-09-17T18:15:23.246 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-17T18:15:23.246 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_map_share_max_epochs": "40", 2024-09-17T18:15:23.246 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_attr_name_len": "100", 2024-09-17T18:15:23.246 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_attr_size": "0", 2024-09-17T18:15:23.246 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_backfills": "1", 2024-09-17T18:15:23.246 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_markdown_count": "5", 2024-09-17T18:15:23.246 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_markdown_period": "600", 2024-09-17T18:15:23.246 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_object_name_len": "2048", 2024-09-17T18:15:23.246 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_object_namespace_len": "256", 2024-09-17T18:15:23.246 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_object_size": "134217728", 2024-09-17T18:15:23.246 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-17T18:15:23.246 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-17T18:15:23.246 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_pg_blocked_by": "16", 2024-09-17T18:15:23.247 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_pg_log_entries": "10000", 2024-09-17T18:15:23.247 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-17T18:15:23.247 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_pgls": "1024", 2024-09-17T18:15:23.247 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_push_cost": "8388608", 2024-09-17T18:15:23.247 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_push_objects": "10", 2024-09-17T18:15:23.247 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_scrubs": "3", 2024-09-17T18:15:23.247 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-17T18:15:23.247 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_trimming_pgs": "2", 2024-09-17T18:15:23.247 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_write_op_reply_len": "64", 2024-09-17T18:15:23.247 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_max_write_size": "90", 2024-09-17T18:15:23.247 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-17T18:15:23.247 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-17T18:15:23.247 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-17T18:15:23.248 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-17T18:15:23.248 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-17T18:15:23.248 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-17T18:15:23.248 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-17T18:15:23.248 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-17T18:15:23.248 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_profile": "balanced", 2024-09-17T18:15:23.248 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-17T18:15:23.248 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-17T18:15:23.248 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-17T18:15:23.248 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-17T18:15:23.248 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-17T18:15:23.248 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-17T18:15:23.248 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-17T18:15:23.249 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-17T18:15:23.249 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-17T18:15:23.249 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-17T18:15:23.249 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-17T18:15:23.249 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_memory_base": "805306368", 2024-09-17T18:15:23.249 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_memory_cache_min": "134217728", 2024-09-17T18:15:23.249 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-17T18:15:23.249 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-17T18:15:23.249 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_memory_target": "4294967296", 2024-09-17T18:15:23.249 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_memory_target_autotune": "false", 2024-09-17T18:15:23.249 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-17T18:15:23.249 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_min_pg_log_entries": "250", 2024-09-17T18:15:23.249 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_min_recovery_priority": "0", 2024-09-17T18:15:23.250 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-17T18:15:23.250 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-17T18:15:23.250 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mon_report_interval": "5", 2024-09-17T18:15:23.250 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-17T18:15:23.250 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-17T18:15:23.250 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_num_cache_shards": "32", 2024-09-17T18:15:23.250 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_num_op_tracker_shard": "32", 2024-09-17T18:15:23.250 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_numa_auto_affinity": "true", 2024-09-17T18:15:23.250 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_numa_node": "-1", 2024-09-17T18:15:23.250 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_numa_prefer_iface": "true", 2024-09-17T18:15:23.250 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-17T18:15:23.250 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_objecter_finishers": "1", 2024-09-17T18:15:23.250 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_objectstore": "bluestore", 2024-09-17T18:15:23.251 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_objectstore_fuse": "false", 2024-09-17T18:15:23.251 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-17T18:15:23.251 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_objectstore_tracing": "false", 2024-09-17T18:15:23.251 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_complaint_time": "30.000000", 2024-09-17T18:15:23.251 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_history_duration": "600", 2024-09-17T18:15:23.251 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_history_size": "20", 2024-09-17T18:15:23.251 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_history_slow_op_size": "20", 2024-09-17T18:15:23.251 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-17T18:15:23.251 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_log_threshold": "5", 2024-09-17T18:15:23.251 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_num_shards": "0", 2024-09-17T18:15:23.251 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_num_shards_hdd": "5", 2024-09-17T18:15:23.251 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_num_shards_ssd": "8", 2024-09-17T18:15:23.251 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-17T18:15:23.251 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-17T18:15:23.252 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-17T18:15:23.252 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-17T18:15:23.252 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_pq_min_cost": "65536", 2024-09-17T18:15:23.252 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-17T18:15:23.252 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_queue_cut_off": "high", 2024-09-17T18:15:23.252 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-17T18:15:23.252 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_op_thread_timeout": "15", 2024-09-17T18:15:23.252 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_open_classes_on_start": "true", 2024-09-17T18:15:23.252 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_os_flags": "0", 2024-09-17T18:15:23.252 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_peering_op_priority": "255", 2024-09-17T18:15:23.252 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pg_delete_cost": "1048576", 2024-09-17T18:15:23.252 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pg_delete_priority": "5", 2024-09-17T18:15:23.253 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-17T18:15:23.253 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-17T18:15:23.253 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-17T18:15:23.253 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pg_log_trim_max": "10000", 2024-09-17T18:15:23.253 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pg_log_trim_min": "100", 2024-09-17T18:15:23.253 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-17T18:15:23.253 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-17T18:15:23.253 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-17T18:15:23.253 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-17T18:15:23.253 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-17T18:15:23.253 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-17T18:15:23.253 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-17T18:15:23.253 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-17T18:15:23.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-17T18:15:23.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-17T18:15:23.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_crimson": "false", 2024-09-17T18:15:23.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-17T18:15:23.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-17T18:15:23.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-17T18:15:23.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-17T18:15:23.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-17T18:15:23.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-17T18:15:23.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-17T18:15:23.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-17T18:15:23.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_flags": "0", 2024-09-17T18:15:23.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-17T18:15:23.255 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_min_size": "0", 2024-09-17T18:15:23.255 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-17T18:15:23.255 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_pg_num": "32", 2024-09-17T18:15:23.255 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_pgp_num": "0", 2024-09-17T18:15:23.255 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-17T18:15:23.255 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_read_ratio": "70", 2024-09-17T18:15:23.255 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_size": "2", 2024-09-17T18:15:23.255 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_default_type": "replicated", 2024-09-17T18:15:23.255 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-17T18:15:23.255 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-17T18:15:23.255 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_push_per_object_cost": "1000", 2024-09-17T18:15:23.255 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-17T18:15:23.255 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recover_clone_overlap": "true", 2024-09-17T18:15:23.256 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-17T18:15:23.256 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_cost": "20971520", 2024-09-17T18:15:23.256 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-17T18:15:23.256 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_max_active": "10", 2024-09-17T18:15:23.256 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-17T18:15:23.256 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-17T18:15:23.256 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-17T18:15:23.256 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-17T18:15:23.256 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_max_single_start": "10", 2024-09-17T18:15:23.256 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_op_priority": "3", 2024-09-17T18:15:23.256 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-17T18:15:23.256 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_priority": "5", 2024-09-17T18:15:23.256 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-17T18:15:23.257 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_sleep": "0.000000", 2024-09-17T18:15:23.257 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-17T18:15:23.257 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-17T18:15:23.257 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-17T18:15:23.257 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_repair_during_recovery": "false", 2024-09-17T18:15:23.257 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_requested_scrub_priority": "120", 2024-09-17T18:15:23.257 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-17T18:15:23.257 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-17T18:15:23.257 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_auto_repair": "false", 2024-09-17T18:15:23.257 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-17T18:15:23.257 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-17T18:15:23.257 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_begin_hour": "0", 2024-09-17T18:15:23.257 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_begin_week_day": "0", 2024-09-17T18:15:23.258 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_chunk_max": "15", 2024-09-17T18:15:23.258 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_chunk_min": "5", 2024-09-17T18:15:23.258 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_cost": "52428800", 2024-09-17T18:15:23.258 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-17T18:15:23.258 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_during_recovery": "false", 2024-09-17T18:15:23.258 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_end_hour": "0", 2024-09-17T18:15:23.258 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_end_week_day": "0", 2024-09-17T18:15:23.258 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_event_cost": "4096", 2024-09-17T18:15:23.258 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-17T18:15:23.258 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-17T18:15:23.258 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_invalid_stats": "true", 2024-09-17T18:15:23.258 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-17T18:15:23.258 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-17T18:15:23.259 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_max_preemptions": "5", 2024-09-17T18:15:23.259 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-17T18:15:23.259 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_priority": "5", 2024-09-17T18:15:23.259 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_retry_after_noscrub": "60", 2024-09-17T18:15:23.259 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_retry_delay": "30", 2024-09-17T18:15:23.259 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_retry_new_interval": "10", 2024-09-17T18:15:23.259 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_retry_pg_state": "60", 2024-09-17T18:15:23.259 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_retry_trimming": "10", 2024-09-17T18:15:23.259 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_scrub_sleep": "0.000000", 2024-09-17T18:15:23.259 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-17T18:15:23.259 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-17T18:15:23.259 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-17T18:15:23.259 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-17T18:15:23.260 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_skip_data_digest": "false", 2024-09-17T18:15:23.260 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_smart_report_timeout": "5", 2024-09-17T18:15:23.260 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_snap_trim_cost": "1048576", 2024-09-17T18:15:23.260 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_snap_trim_priority": "5", 2024-09-17T18:15:23.260 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-17T18:15:23.260 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-17T18:15:23.260 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-17T18:15:23.260 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-17T18:15:23.260 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-17T18:15:23.260 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-17T18:15:23.260 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-17T18:15:23.260 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_target_transaction_size": "30", 2024-09-17T18:15:23.260 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-17T18:15:23.261 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-17T18:15:23.261 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-17T18:15:23.261 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-17T18:15:23.261 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-17T18:15:23.261 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-17T18:15:23.261 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-17T18:15:23.261 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-17T18:15:23.261 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-17T18:15:23.261 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-17T18:15:23.261 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_tracing": "false", 2024-09-17T18:15:23.261 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_use_stale_snap": "false", 2024-09-17T18:15:23.261 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T18:15:23.261 INFO:teuthology.orchestra.run.smithi087.stdout: "osdc_blkin_trace_all": "false", 2024-09-17T18:15:23.262 INFO:teuthology.orchestra.run.smithi087.stdout: "paxos_kill_at": "0", 2024-09-17T18:15:23.262 INFO:teuthology.orchestra.run.smithi087.stdout: "paxos_max_join_drift": "10", 2024-09-17T18:15:23.262 INFO:teuthology.orchestra.run.smithi087.stdout: "paxos_min": "500", 2024-09-17T18:15:23.262 INFO:teuthology.orchestra.run.smithi087.stdout: "paxos_min_wait": "0.050000", 2024-09-17T18:15:23.262 INFO:teuthology.orchestra.run.smithi087.stdout: "paxos_propose_interval": "1.000000", 2024-09-17T18:15:23.262 INFO:teuthology.orchestra.run.smithi087.stdout: "paxos_service_trim_max": "500", 2024-09-17T18:15:23.262 INFO:teuthology.orchestra.run.smithi087.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-17T18:15:23.262 INFO:teuthology.orchestra.run.smithi087.stdout: "paxos_service_trim_min": "250", 2024-09-17T18:15:23.262 INFO:teuthology.orchestra.run.smithi087.stdout: "paxos_stash_full_interval": "25", 2024-09-17T18:15:23.262 INFO:teuthology.orchestra.run.smithi087.stdout: "paxos_trim_max": "500", 2024-09-17T18:15:23.262 INFO:teuthology.orchestra.run.smithi087.stdout: "paxos_trim_min": "250", 2024-09-17T18:15:23.262 INFO:teuthology.orchestra.run.smithi087.stdout: "perf": "true", 2024-09-17T18:15:23.262 INFO:teuthology.orchestra.run.smithi087.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-17T18:15:23.263 INFO:teuthology.orchestra.run.smithi087.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-17T18:15:23.263 INFO:teuthology.orchestra.run.smithi087.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-17T18:15:23.263 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "-", 2024-09-17T18:15:23.263 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrv": "", 2024-09-17T18:15:23.263 INFO:teuthology.orchestra.run.smithi087.stdout: "public_bind_addr": "-", 2024-09-17T18:15:23.263 INFO:teuthology.orchestra.run.smithi087.stdout: "public_network": "", 2024-09-17T18:15:23.263 INFO:teuthology.orchestra.run.smithi087.stdout: "public_network_interface": "", 2024-09-17T18:15:23.263 INFO:teuthology.orchestra.run.smithi087.stdout: "qat_compressor_busy_polling": "false", 2024-09-17T18:15:23.263 INFO:teuthology.orchestra.run.smithi087.stdout: "qat_compressor_enabled": "false", 2024-09-17T18:15:23.263 INFO:teuthology.orchestra.run.smithi087.stdout: "qat_compressor_session_max_number": "256", 2024-09-17T18:15:23.263 INFO:teuthology.orchestra.run.smithi087.stdout: "rados_mon_op_timeout": "0", 2024-09-17T18:15:23.263 INFO:teuthology.orchestra.run.smithi087.stdout: "rados_osd_op_timeout": "0", 2024-09-17T18:15:23.263 INFO:teuthology.orchestra.run.smithi087.stdout: "rados_tracing": "false", 2024-09-17T18:15:23.264 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_atime_update_interval": "60", 2024-09-17T18:15:23.264 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-17T18:15:23.264 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_balance_parent_reads": "false", 2024-09-17T18:15:23.264 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_balance_snap_reads": "false", 2024-09-17T18:15:23.264 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_blkin_trace_all": "false", 2024-09-17T18:15:23.264 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-17T18:15:23.264 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-17T18:15:23.264 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_cache": "true", 2024-09-17T18:15:23.264 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-17T18:15:23.264 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-17T18:15:23.264 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-17T18:15:23.264 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-17T18:15:23.264 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_cache_policy": "writearound", 2024-09-17T18:15:23.265 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_cache_size": "33554432", 2024-09-17T18:15:23.265 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-17T18:15:23.265 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-17T18:15:23.265 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_clone_copy_on_read": "false", 2024-09-17T18:15:23.265 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_compression_hint": "none", 2024-09-17T18:15:23.265 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_concurrent_management_ops": "10", 2024-09-17T18:15:23.265 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-17T18:15:23.265 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_default_clone_format": "auto", 2024-09-17T18:15:23.265 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_default_data_pool": "", 2024-09-17T18:15:23.265 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_default_features": "61", 2024-09-17T18:15:23.265 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_default_format": "2", 2024-09-17T18:15:23.265 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_default_map_options": "", 2024-09-17T18:15:23.265 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_default_order": "22", 2024-09-17T18:15:23.266 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_default_pool": "rbd", 2024-09-17T18:15:23.266 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-17T18:15:23.266 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_default_stripe_count": "0", 2024-09-17T18:15:23.266 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_default_stripe_unit": "0", 2024-09-17T18:15:23.266 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-17T18:15:23.266 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-17T18:15:23.266 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-17T18:15:23.266 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_enable_alloc_hint": "true", 2024-09-17T18:15:23.266 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-17T18:15:23.266 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_io_scheduler": "simple", 2024-09-17T18:15:23.266 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-17T18:15:23.266 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-17T18:15:23.266 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-17T18:15:23.267 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-17T18:15:23.267 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-17T18:15:23.267 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-17T18:15:23.267 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-17T18:15:23.267 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-17T18:15:23.267 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-17T18:15:23.267 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_journal_order": "24", 2024-09-17T18:15:23.267 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_journal_pool": "", 2024-09-17T18:15:23.267 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_journal_splay_width": "4", 2024-09-17T18:15:23.267 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_localize_parent_reads": "false", 2024-09-17T18:15:23.267 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_localize_snap_reads": "false", 2024-09-17T18:15:23.267 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-17T18:15:23.267 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-17T18:15:23.268 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-17T18:15:23.268 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-17T18:15:23.268 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-17T18:15:23.268 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-17T18:15:23.268 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-17T18:15:23.268 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-17T18:15:23.268 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-17T18:15:23.268 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-17T18:15:23.268 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-17T18:15:23.268 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-17T18:15:23.268 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-17T18:15:23.268 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-17T18:15:23.268 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-17T18:15:23.269 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-17T18:15:23.269 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-17T18:15:23.269 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-17T18:15:23.269 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-17T18:15:23.269 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-17T18:15:23.269 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-17T18:15:23.269 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-17T18:15:23.269 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-17T18:15:23.269 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-17T18:15:23.269 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-17T18:15:23.269 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-17T18:15:23.269 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-17T18:15:23.269 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-17T18:15:23.270 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-17T18:15:23.270 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-17T18:15:23.270 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-17T18:15:23.270 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_mtime_update_interval": "60", 2024-09-17T18:15:23.270 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_non_blocking_aio": "true", 2024-09-17T18:15:23.270 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_op_thread_timeout": "60", 2024-09-17T18:15:23.270 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_op_threads": "1", 2024-09-17T18:15:23.270 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_parent_cache_enabled": "false", 2024-09-17T18:15:23.270 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-17T18:15:23.270 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-17T18:15:23.270 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-17T18:15:23.270 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_plugins": "", 2024-09-17T18:15:23.270 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_bps_burst": "0", 2024-09-17T18:15:23.271 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-17T18:15:23.271 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_bps_limit": "0", 2024-09-17T18:15:23.271 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_exclude_ops": "0", 2024-09-17T18:15:23.271 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_iops_burst": "0", 2024-09-17T18:15:23.271 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-17T18:15:23.271 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_iops_limit": "0", 2024-09-17T18:15:23.271 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-17T18:15:23.271 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-17T18:15:23.271 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-17T18:15:23.271 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-17T18:15:23.271 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-17T18:15:23.271 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-17T18:15:23.271 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-17T18:15:23.271 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-17T18:15:23.272 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-17T18:15:23.272 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-17T18:15:23.272 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-17T18:15:23.272 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-17T18:15:23.272 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-17T18:15:23.272 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-17T18:15:23.272 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_read_from_replica_policy": "default", 2024-09-17T18:15:23.272 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-17T18:15:23.272 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-17T18:15:23.272 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-17T18:15:23.272 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-17T18:15:23.272 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_skip_partial_discard": "true", 2024-09-17T18:15:23.273 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-17T18:15:23.273 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_tracing": "false", 2024-09-17T18:15:23.273 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_validate_names": "true", 2024-09-17T18:15:23.273 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_validate_pool": "true", 2024-09-17T18:15:23.273 INFO:teuthology.orchestra.run.smithi087.stdout: "restapi_base_url": "", 2024-09-17T18:15:23.273 INFO:teuthology.orchestra.run.smithi087.stdout: "restapi_log_level": "", 2024-09-17T18:15:23.273 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-17T18:15:23.273 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-17T18:15:23.273 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_acl_grants_max_num": "100", 2024-09-17T18:15:23.273 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_admin_entry": "admin", 2024-09-17T18:15:23.273 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-17T18:15:23.273 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_asio_assert_yielding": "false", 2024-09-17T18:15:23.273 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_backend_store": "rados", 2024-09-17T18:15:23.274 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_barbican_url": "", 2024-09-17T18:15:23.274 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_beast_enable_async": "true", 2024-09-17T18:15:23.274 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_bucket_counters_cache": "false", 2024-09-17T18:15:23.274 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-17T18:15:23.274 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-17T18:15:23.274 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-17T18:15:23.274 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-17T18:15:23.274 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-17T18:15:23.274 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-17T18:15:23.274 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-17T18:15:23.274 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-17T18:15:23.274 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_cache_enabled": "true", 2024-09-17T18:15:23.274 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_cache_expiry_interval": "900", 2024-09-17T18:15:23.275 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_cache_lru_size": "25000", 2024-09-17T18:15:23.275 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_config_store": "rados", 2024-09-17T18:15:23.275 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_content_length_compat": "false", 2024-09-17T18:15:23.275 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_copy_obj_progress": "true", 2024-09-17T18:15:23.275 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-17T18:15:23.275 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_cors_rules_max_num": "100", 2024-09-17T18:15:23.275 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_cross_domain_policy": "", 2024-09-17T18:15:23.275 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-17T18:15:23.275 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_kmip_addr": "", 2024-09-17T18:15:23.275 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-17T18:15:23.275 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-17T18:15:23.275 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-17T18:15:23.275 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-17T18:15:23.276 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_kmip_password": "", 2024-09-17T18:15:23.276 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-17T18:15:23.276 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_kmip_username": "", 2024-09-17T18:15:23.276 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_require_ssl": "true", 2024-09-17T18:15:23.276 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-17T18:15:23.276 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-17T18:15:23.276 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-17T18:15:23.276 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-17T18:15:23.276 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-17T18:15:23.276 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-17T18:15:23.276 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-17T18:15:23.276 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-17T18:15:23.276 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-17T18:15:23.277 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-17T18:15:23.277 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-17T18:15:23.277 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-17T18:15:23.277 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-17T18:15:23.277 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-17T18:15:23.277 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-17T18:15:23.277 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_vault_addr": "", 2024-09-17T18:15:23.277 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_vault_auth": "token", 2024-09-17T18:15:23.277 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_vault_namespace": "", 2024-09-17T18:15:23.277 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_vault_prefix": "", 2024-09-17T18:15:23.277 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-17T18:15:23.277 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-17T18:15:23.277 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-17T18:15:23.278 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-17T18:15:23.278 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_vault_token_file": "", 2024-09-17T18:15:23.278 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-17T18:15:23.278 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_curl_buffersize": "524288", 2024-09-17T18:15:23.278 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-17T18:15:23.278 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_curl_low_speed_time": "300", 2024-09-17T18:15:23.278 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-17T18:15:23.278 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-17T18:15:23.278 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-17T18:15:23.278 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-17T18:15:23.278 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-17T18:15:23.278 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-17T18:15:23.278 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-17T18:15:23.278 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-17T18:15:23.279 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-17T18:15:23.279 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-17T18:15:23.279 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-17T18:15:23.279 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-17T18:15:23.279 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-17T18:15:23.279 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-17T18:15:23.279 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-17T18:15:23.279 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-17T18:15:23.279 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-17T18:15:23.279 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-17T18:15:23.279 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-17T18:15:23.279 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_data_log_changes_size": "1000", 2024-09-17T18:15:23.279 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_data_log_num_shards": "128", 2024-09-17T18:15:23.280 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-17T18:15:23.280 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_data_log_window": "30", 2024-09-17T18:15:23.280 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-17T18:15:23.280 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-17T18:15:23.280 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-17T18:15:23.280 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-17T18:15:23.280 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-17T18:15:23.280 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-17T18:15:23.280 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-17T18:15:23.280 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-17T18:15:23.280 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-17T18:15:23.280 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-17T18:15:23.280 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-17T18:15:23.281 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-17T18:15:23.281 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-17T18:15:23.281 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_disable_s3select": "false", 2024-09-17T18:15:23.281 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-17T18:15:23.281 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-17T18:15:23.281 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-17T18:15:23.281 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-17T18:15:23.281 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-17T18:15:23.281 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-17T18:15:23.281 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-17T18:15:23.281 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-17T18:15:23.281 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-17T18:15:23.281 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-17T18:15:23.282 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-17T18:15:23.282 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-17T18:15:23.282 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dns_name": "", 2024-09-17T18:15:23.282 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dns_s3website_name": "", 2024-09-17T18:15:23.282 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dynamic_resharding": "true", 2024-09-17T18:15:23.282 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-17T18:15:23.282 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-17T18:15:23.282 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-17T18:15:23.282 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_enable_gc_threads": "true", 2024-09-17T18:15:23.282 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_enable_lc_threads": "true", 2024-09-17T18:15:23.282 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_enable_mdsearch": "true", 2024-09-17T18:15:23.282 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_enable_ops_log": "false", 2024-09-17T18:15:23.282 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_enable_quota_threads": "true", 2024-09-17T18:15:23.283 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_enable_static_website": "false", 2024-09-17T18:15:23.283 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_enable_usage_log": "false", 2024-09-17T18:15:23.283 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_enforce_swift_acls": "true", 2024-09-17T18:15:23.283 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_exit_timeout_secs": "120", 2024-09-17T18:15:23.283 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_expose_bucket": "false", 2024-09-17T18:15:23.283 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_extended_http_attrs": "", 2024-09-17T18:15:23.283 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_filter": "none", 2024-09-17T18:15:23.283 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-17T18:15:23.283 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_frontends": "beast port=7480", 2024-09-17T18:15:23.283 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-17T18:15:23.283 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_gc_max_deferred": "50", 2024-09-17T18:15:23.283 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-17T18:15:23.283 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_gc_max_objs": "32", 2024-09-17T18:15:23.284 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-17T18:15:23.284 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-17T18:15:23.284 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-17T18:15:23.284 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-17T18:15:23.284 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_gc_processor_period": "3600", 2024-09-17T18:15:23.284 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-17T18:15:23.284 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-17T18:15:23.284 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-17T18:15:23.284 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-17T18:15:23.284 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_init_timeout": "300", 2024-09-17T18:15:23.284 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-17T18:15:23.284 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-17T18:15:23.284 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_kafka_connection_idle": "300", 2024-09-17T18:15:23.285 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-17T18:15:23.285 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-17T18:15:23.285 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-17T18:15:23.285 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-17T18:15:23.285 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-17T18:15:23.285 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_admin_domain": "", 2024-09-17T18:15:23.285 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_admin_password": "", 2024-09-17T18:15:23.285 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_admin_password_path": "", 2024-09-17T18:15:23.285 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_admin_project": "", 2024-09-17T18:15:23.285 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_admin_tenant": "", 2024-09-17T18:15:23.285 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_admin_token": "", 2024-09-17T18:15:23.285 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_admin_token_path": "", 2024-09-17T18:15:23.285 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_admin_user": "", 2024-09-17T18:15:23.286 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_barbican_domain": "", 2024-09-17T18:15:23.286 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_barbican_password": "", 2024-09-17T18:15:23.286 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_barbican_project": "", 2024-09-17T18:15:23.286 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-17T18:15:23.286 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_barbican_user": "", 2024-09-17T18:15:23.286 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-17T18:15:23.286 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-17T18:15:23.286 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-17T18:15:23.286 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-17T18:15:23.286 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-17T18:15:23.286 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_url": "", 2024-09-17T18:15:23.286 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-17T18:15:23.287 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_lc_debug_interval": "-1", 2024-09-17T18:15:23.287 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_lc_lock_max_time": "90", 2024-09-17T18:15:23.287 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_lc_max_objs": "32", 2024-09-17T18:15:23.287 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_lc_max_rules": "1000", 2024-09-17T18:15:23.287 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_lc_max_worker": "3", 2024-09-17T18:15:23.287 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-17T18:15:23.287 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_lc_thread_delay": "0", 2024-09-17T18:15:23.287 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-17T18:15:23.287 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_ldap_dnattr": "uid", 2024-09-17T18:15:23.287 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-17T18:15:23.287 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_ldap_searchfilter": "", 2024-09-17T18:15:23.287 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-17T18:15:23.287 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_ldap_uri": "", 2024-09-17T18:15:23.287 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-17T18:15:23.288 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-17T18:15:23.288 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-17T18:15:23.288 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-17T18:15:23.288 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_log_http_headers": "", 2024-09-17T18:15:23.288 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-17T18:15:23.288 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-17T18:15:23.288 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_log_object_name_utc": "false", 2024-09-17T18:15:23.288 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-17T18:15:23.288 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-17T18:15:23.288 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_max_attr_name_len": "0", 2024-09-17T18:15:23.288 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_max_attr_size": "0", 2024-09-17T18:15:23.288 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-17T18:15:23.289 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_max_chunk_size": "4194304", 2024-09-17T18:15:23.289 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-17T18:15:23.289 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-17T18:15:23.289 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-17T18:15:23.289 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_max_listing_results": "5000", 2024-09-17T18:15:23.289 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_max_notify_retries": "10", 2024-09-17T18:15:23.289 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-17T18:15:23.289 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_max_put_param_size": "1048576", 2024-09-17T18:15:23.289 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_max_put_size": "5368709120", 2024-09-17T18:15:23.289 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_max_slo_entries": "1000", 2024-09-17T18:15:23.289 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_md_log_max_shards": "64", 2024-09-17T18:15:23.289 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-17T18:15:23.289 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-17T18:15:23.290 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-17T18:15:23.290 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-17T18:15:23.290 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_mp_lock_max_time": "600", 2024-09-17T18:15:23.290 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-17T18:15:23.290 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-17T18:15:23.290 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-17T18:15:23.290 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-17T18:15:23.290 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-17T18:15:23.290 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-17T18:15:23.290 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-17T18:15:23.290 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-17T18:15:23.290 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_nfs_max_gc": "300", 2024-09-17T18:15:23.290 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-17T18:15:23.291 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-17T18:15:23.291 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-17T18:15:23.291 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-17T18:15:23.291 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-17T18:15:23.291 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-17T18:15:23.291 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-17T18:15:23.291 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_num_async_rados_threads": "32", 2024-09-17T18:15:23.291 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_num_control_oids": "8", 2024-09-17T18:15:23.291 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_numa_node": "-1", 2024-09-17T18:15:23.291 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-17T18:15:23.291 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-17T18:15:23.291 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_objexp_chunk_size": "100", 2024-09-17T18:15:23.291 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_objexp_gc_interval": "600", 2024-09-17T18:15:23.292 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-17T18:15:23.292 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-17T18:15:23.292 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-17T18:15:23.292 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_op_thread_timeout": "600", 2024-09-17T18:15:23.292 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_op_tracing": "false", 2024-09-17T18:15:23.292 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_opa_token": "", 2024-09-17T18:15:23.292 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_opa_url": "", 2024-09-17T18:15:23.292 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_opa_verify_ssl": "true", 2024-09-17T18:15:23.292 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-17T18:15:23.292 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-17T18:15:23.292 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_ops_log_rados": "false", 2024-09-17T18:15:23.292 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_ops_log_socket_path": "", 2024-09-17T18:15:23.292 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-17T18:15:23.293 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-17T18:15:23.293 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-17T18:15:23.293 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_period_push_interval": "2.000000", 2024-09-17T18:15:23.293 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-17T18:15:23.293 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-17T18:15:23.293 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-17T18:15:23.293 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-17T18:15:23.293 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_posix_cache_lanes": "3", 2024-09-17T18:15:23.293 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-17T18:15:23.293 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-17T18:15:23.293 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_posix_cache_partitions": "3", 2024-09-17T18:15:23.293 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-17T18:15:23.293 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_print_continue": "true", 2024-09-17T18:15:23.294 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-17T18:15:23.294 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-17T18:15:23.294 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-17T18:15:23.294 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-17T18:15:23.294 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-17T18:15:23.294 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_rados_tracing": "false", 2024-09-17T18:15:23.294 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_realm": "", 2024-09-17T18:15:23.294 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_realm_id": "", 2024-09-17T18:15:23.294 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-17T18:15:23.294 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_region": "", 2024-09-17T18:15:23.294 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-17T18:15:23.294 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-17T18:15:23.294 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-17T18:15:23.295 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-17T18:15:23.295 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_request_uri": "", 2024-09-17T18:15:23.295 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_reshard_batch_size": "64", 2024-09-17T18:15:23.295 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-17T18:15:23.295 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-17T18:15:23.295 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_reshard_max_aio": "128", 2024-09-17T18:15:23.295 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_reshard_num_logs": "16", 2024-09-17T18:15:23.295 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-17T18:15:23.295 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-17T18:15:23.295 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_reshard_thread_interval": "600", 2024-09-17T18:15:23.295 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-17T18:15:23.295 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_resolve_cname": "false", 2024-09-17T18:15:23.295 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-17T18:15:23.295 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_run_sync_thread": "true", 2024-09-17T18:15:23.296 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-17T18:15:23.296 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-17T18:15:23.296 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-17T18:15:23.296 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-17T18:15:23.296 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-17T18:15:23.296 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-17T18:15:23.296 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-17T18:15:23.296 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-17T18:15:23.296 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-17T18:15:23.296 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_scheduler_type": "throttler", 2024-09-17T18:15:23.296 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_script_uri": "", 2024-09-17T18:15:23.296 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_service_provider_name": "", 2024-09-17T18:15:23.296 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-17T18:15:23.297 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sts_client_id": "", 2024-09-17T18:15:23.297 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sts_client_secret": "", 2024-09-17T18:15:23.297 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sts_entry": "sts", 2024-09-17T18:15:23.297 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sts_key": "sts", 2024-09-17T18:15:23.297 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-17T18:15:23.297 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sts_min_session_duration": "900", 2024-09-17T18:15:23.297 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sts_token_introspection_url": "", 2024-09-17T18:15:23.297 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_swift_account_in_url": "false", 2024-09-17T18:15:23.297 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_swift_auth_entry": "auth", 2024-09-17T18:15:23.297 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_swift_auth_url": "", 2024-09-17T18:15:23.297 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_swift_custom_header": "", 2024-09-17T18:15:23.297 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-17T18:15:23.297 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_swift_need_stats": "true", 2024-09-17T18:15:23.298 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_swift_tenant_name": "", 2024-09-17T18:15:23.298 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_swift_token_expiration": "86400", 2024-09-17T18:15:23.298 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_swift_url": "", 2024-09-17T18:15:23.298 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_swift_url_prefix": "swift", 2024-09-17T18:15:23.298 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-17T18:15:23.298 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-17T18:15:23.298 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-17T18:15:23.298 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sync_lease_period": "120", 2024-09-17T18:15:23.298 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-17T18:15:23.298 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-17T18:15:23.298 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-17T18:15:23.298 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-17T18:15:23.298 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-17T18:15:23.299 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-17T18:15:23.299 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-17T18:15:23.299 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-17T18:15:23.299 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-17T18:15:23.299 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_thread_pool_size": "512", 2024-09-17T18:15:23.299 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-17T18:15:23.299 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-17T18:15:23.299 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-17T18:15:23.299 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-17T18:15:23.299 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_torrent_comment": "", 2024-09-17T18:15:23.299 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_torrent_createby": "", 2024-09-17T18:15:23.299 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_torrent_encoding": "", 2024-09-17T18:15:23.299 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_torrent_flag": "false", 2024-09-17T18:15:23.300 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-17T18:15:23.300 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_torrent_origin": "", 2024-09-17T18:15:23.300 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-17T18:15:23.300 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_torrent_tracker": "", 2024-09-17T18:15:23.300 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_trust_forwarded_https": "false", 2024-09-17T18:15:23.300 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-17T18:15:23.300 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-17T18:15:23.300 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_usage_max_shards": "32", 2024-09-17T18:15:23.300 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_usage_max_user_shards": "1", 2024-09-17T18:15:23.300 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_use_opa_authz": "false", 2024-09-17T18:15:23.300 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_user_counters_cache": "false", 2024-09-17T18:15:23.300 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-17T18:15:23.300 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-17T18:15:23.301 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-17T18:15:23.301 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_user_max_buckets": "1000", 2024-09-17T18:15:23.301 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_user_policies_max_num": "100", 2024-09-17T18:15:23.301 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-17T18:15:23.301 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-17T18:15:23.301 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-17T18:15:23.301 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-17T18:15:23.301 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_user_unique_email": "true", 2024-09-17T18:15:23.301 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_verify_ssl": "true", 2024-09-17T18:15:23.301 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-17T18:15:23.301 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_zone": "", 2024-09-17T18:15:23.301 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_zone_id": "", 2024-09-17T18:15:23.301 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-17T18:15:23.302 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_zonegroup": "", 2024-09-17T18:15:23.302 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_zonegroup_id": "", 2024-09-17T18:15:23.302 INFO:teuthology.orchestra.run.smithi087.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-17T18:15:23.302 INFO:teuthology.orchestra.run.smithi087.stdout: "rgwlc_auto_session_clear": "true", 2024-09-17T18:15:23.302 INFO:teuthology.orchestra.run.smithi087.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-17T18:15:23.302 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_block_size": "4096", 2024-09-17T18:15:23.302 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-17T18:15:23.302 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-17T18:15:23.302 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-17T18:15:23.302 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-17T18:15:23.302 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-17T18:15:23.302 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_cache_size": "536870912", 2024-09-17T18:15:23.302 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-17T18:15:23.303 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-17T18:15:23.303 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-17T18:15:23.303 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-17T18:15:23.303 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-17T18:15:23.303 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-17T18:15:23.303 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-17T18:15:23.303 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-17T18:15:23.303 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_index_type": "binary_search", 2024-09-17T18:15:23.303 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-17T18:15:23.303 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-17T18:15:23.303 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_partition_filters": "false", 2024-09-17T18:15:23.303 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_perf": "false", 2024-09-17T18:15:23.303 INFO:teuthology.orchestra.run.smithi087.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-17T18:15:23.303 INFO:teuthology.orchestra.run.smithi087.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-17T18:15:23.304 INFO:teuthology.orchestra.run.smithi087.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-17T18:15:23.304 INFO:teuthology.orchestra.run.smithi087.stdout: "run_dir": "/var/run/ceph", 2024-09-17T18:15:23.304 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_block_create": "true", 2024-09-17T18:15:23.304 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_cache_lru_size": "67108864", 2024-09-17T18:15:23.304 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-17T18:15:23.304 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-17T18:15:23.304 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_default_max_object_size": "16777216", 2024-09-17T18:15:23.304 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-17T18:15:23.304 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_device_size": "53687091200", 2024-09-17T18:15:23.304 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-17T18:15:23.304 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_full_integrity_check": "false", 2024-09-17T18:15:23.304 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_journal_batch_capacity": "16", 2024-09-17T18:15:23.305 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-17T18:15:23.305 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-17T18:15:23.305 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-17T18:15:23.305 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_main_device_type": "SSD", 2024-09-17T18:15:23.305 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-17T18:15:23.305 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-17T18:15:23.305 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-17T18:15:23.305 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-17T18:15:23.305 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-17T18:15:23.305 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-17T18:15:23.305 INFO:teuthology.orchestra.run.smithi087.stdout: "seastore_segment_size": "67108864", 2024-09-17T18:15:23.305 INFO:teuthology.orchestra.run.smithi087.stdout: "set_keepcaps": "false", 2024-09-17T18:15:23.305 INFO:teuthology.orchestra.run.smithi087.stdout: "setgroup": "", 2024-09-17T18:15:23.305 INFO:teuthology.orchestra.run.smithi087.stdout: "setuser": "", 2024-09-17T18:15:23.306 INFO:teuthology.orchestra.run.smithi087.stdout: "setuser_match_path": "", 2024-09-17T18:15:23.306 INFO:teuthology.orchestra.run.smithi087.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-17T18:15:23.306 INFO:teuthology.orchestra.run.smithi087.stdout: "thp": "false", 2024-09-17T18:15:23.306 INFO:teuthology.orchestra.run.smithi087.stdout: "threadpool_default_timeout": "60", 2024-09-17T18:15:23.306 INFO:teuthology.orchestra.run.smithi087.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-17T18:15:23.306 INFO:teuthology.orchestra.run.smithi087.stdout: "throttler_perf_counter": "true", 2024-09-17T18:15:23.306 INFO:teuthology.orchestra.run.smithi087.stdout: "tmp_dir": "/tmp", 2024-09-17T18:15:23.306 INFO:teuthology.orchestra.run.smithi087.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-17T18:15:23.306 INFO:teuthology.orchestra.run.smithi087.stdout: "uadk_compressor_enabled": "false", 2024-09-17T18:15:23.306 INFO:teuthology.orchestra.run.smithi087.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-17T18:15:23.306 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:23.309 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-17T18:15:23.458 INFO:teuthology.orchestra.run.smithi087.stdout:mon.a: {} 2024-09-17T18:15:23.458 INFO:teuthology.orchestra.run.smithi087.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T18:15:23.471 INFO:teuthology.orchestra.run.smithi087.stdout:mon.b: {} 2024-09-17T18:15:23.472 INFO:teuthology.orchestra.run.smithi087.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T18:15:23.485 INFO:teuthology.orchestra.run.smithi087.stdout:mon.c: {} 2024-09-17T18:15:23.485 INFO:teuthology.orchestra.run.smithi087.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T18:15:23.501 DEBUG:teuthology.orchestra.run.smithi087:> type ceph-objectstore-tool 2024-09-17T18:15:23.505 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T18:15:23.505 DEBUG:teuthology.orchestra.run.smithi146:> type ceph-objectstore-tool 2024-09-17T18:15:23.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T18:15:23.511 DEBUG:teuthology.orchestra.run.smithi134:> type ceph-objectstore-tool 2024-09-17T18:15:23.517 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T18:15:23.517 DEBUG:teuthology.orchestra.run.smithi154:> type ceph-objectstore-tool 2024-09-17T18:15:23.522 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T18:15:23.523 INFO:teuthology.run_tasks:Running task rados... 2024-09-17T18:15:23.537 INFO:tasks.rados:Beginning rados... 2024-09-17T18:15:23.537 INFO:tasks.rados:config is {'clients': ['client.0'], 'ec_pool': True, 'erasure_code_profile': {'c': 2, 'crush-failure-domain': 'osd', 'k': 4, 'm': 3, 'name': 'shecprofile', 'plugin': 'shec'}, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 400, 'write_append_excl': False} 2024-09-17T18:15:23.538 INFO:tasks.rados:overrides is {'admin_socket': {'branch': 'wip-bharath10-testing-2024-09-17-1348'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath10-testing-2024-09-17-1348', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}} 2024-09-17T18:15:23.538 INFO:tasks.rados:config is {'clients': ['client.0'], 'ec_pool': True, 'erasure_code_profile': {'c': 2, 'crush-failure-domain': 'osd', 'k': 4, 'm': 3, 'name': 'shecprofile', 'plugin': 'shec'}, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 400, 'write_append_excl': False} 2024-09-17T18:15:23.538 DEBUG:teuthology.run_tasks:Unwinding manager rados 2024-09-17T18:15:23.575 INFO:tasks.rados:joining rados 2024-09-17T18:15:23.575 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-17T18:15:23.575 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T18:15:23.575 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T18:15:23.576 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-17T18:15:23.576 INFO:tasks.thrashosds.thrasher:Setting osd 15 primary_affinity to 1.000000 2024-09-17T18:15:23.576 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 15 1 2024-09-17T18:15:23.576 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-17T18:15:23.577 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-17T18:15:23.577 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T18:15:23.577 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-17T18:15:23.577 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T18:15:23.578 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-17T18:15:23.578 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T18:15:23.578 INFO:tasks.rados:clients are ['client.0'] 2024-09-17T18:15:23.578 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set shecprofile c=2 crush-failure-domain=osd k=4 m=3 name=shecprofile plugin=shec 2024-09-17T18:15:23.580 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:23.572+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:23.679 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:23.676+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:23.708 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:23.708 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:23.708 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-17T18:15:23.708 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:23.729 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T18:15:23.735 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:15:23.736 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:15:23.772 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:15:23.772 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:15:23.780 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:23.776+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:23.799 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:15:23.799 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:15:23.820 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:15:23.820 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:15:23.837 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:15:23.837 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:15:23.856 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:23.856 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:23.858 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:15:23.858 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:15:23.870 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T18:15:23.881 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:23.875+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:23.893 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:15:23.893 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:15:23.928 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:15:23.928 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:15:23.960 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:15:23.960 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:15:23.982 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:23.977+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:23.982 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:15:23.983 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:15:24.003 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:15:24.003 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:15:24.003 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:24.004 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:24.016 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T18:15:24.023 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:15:24.024 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:15:24.054 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:15:24.054 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:15:24.074 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:15:24.074 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:15:24.083 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:24.081+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:24.094 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:15:24.094 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:15:24.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:15:24.091+0000 7f6e5b7fe640 0 -- 172.21.15.87:0/1636863014 >> [v2:172.21.15.154:6824/3670919160,v1:172.21.15.154:6825/3670919160] conn(0x7f6e340334a0 msgr2=0x7f6e34035890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T18:15:24.129 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:24.129 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:24.142 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T18:15:24.183 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:24.179+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:24.284 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:24.279+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:24.298 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:24.299 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:24.312 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T18:15:24.320 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:15:24.320 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:15:24.385 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:24.381+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:24.426 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:24.426 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:24.439 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T18:15:24.487 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:24.479+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:24.553 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:24.553 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:24.566 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T18:15:24.587 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:24.583+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:24.629 INFO:teuthology.orchestra.run.smithi087.stderr:noscrub is set 2024-09-17T18:15:24.629 INFO:teuthology.orchestra.run.smithi087.stderr:load: shec 2024-09-17T18:15:24.629 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.15 primary-affinity to 1 (8655362) 2024-09-17T18:15:24.656 INFO:tasks.rados:starting run 0 out of 1 2024-09-17T18:15:24.656 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-17T18:15:24.656 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 16 erasure shecprofile 2024-09-17T18:15:24.686 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:24.686 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:24.688 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:24.685+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:24.699 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T18:15:24.789 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:24.785+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:24.855 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:24.856 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:24.868 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T18:15:24.889 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:24.885+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:24.974 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:24.974 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:24.986 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T18:15:24.990 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:24.983+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:25.090 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:25.083+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:25.091 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:25.091 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:25.105 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T18:15:25.191 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:25.187+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:25.222 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:25.222 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:25.235 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T18:15:25.292 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:25.289+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:25.366 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:25.366 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:25.380 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T18:15:25.393 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:25.391+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:25.493 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:25.491+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:25.499 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:25.499 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:25.514 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T18:15:25.595 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:25.593+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:25.635 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:25.635 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:25.651 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T18:15:25.699 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:25.696+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:25.773 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:25.774 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:25.788 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T18:15:25.831 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:25.828+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:25.896 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:25.892+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:25.950 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:25.951 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:25.964 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T18:15:25.998 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:25.995+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:26.099 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:26.097+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:26.128 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:26.128 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:26.142 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T18:15:26.199 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:26.196+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:26.264 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:26.264 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:26.277 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T18:15:26.300 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:26.297+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:26.340 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T18:15:26.401 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:26.396+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:26.440 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:26.440 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:26.455 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T18:15:26.491 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:15:26.492 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:15:26.511 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:15:26.512 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:15:26.532 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:15:26.533 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:15:26.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:26.540+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:26.553 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:15:26.553 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:15:26.570 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:15:26.570 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:15:26.589 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:15:26.589 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:15:26.603 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:26.600+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:26.611 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:15:26.611 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:15:26.616 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:26.616 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:26.632 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:15:26.632 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:15:26.633 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T18:15:26.652 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:15:26.652 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:15:26.654 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'unique_pool_0' created 2024-09-17T18:15:26.656 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T18:15:26.676 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:15:26.676 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:15:26.683 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-17T18:15:26.704 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:26.699+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:26.705 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:15:26.705 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:15:26.726 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:15:26.726 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:15:26.744 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:15:26.744 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:15:26.763 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:15:26.763 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:15:26.784 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:15:26.784 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:15:26.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:15:26.787+0000 7f15aa389640 0 -- 172.21.15.87:0/74655946 >> [v2:172.21.15.154:6824/3670919160,v1:172.21.15.154:6825/3670919160] conn(0x7f15a42245e0 msgr2=0x7f15a42269d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T18:15:26.797 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:26.798 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:26.798 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:15:26.798 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:26.804 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:26.799+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:26.805 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:15:26.805 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:15:26.812 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T18:15:26.907 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:26.903+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:26.928 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:15:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:15:26.928 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:26.942 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T18:15:27.007 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:27.005+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:27.064 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:27.064 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:15:27.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:15:27.064 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:15:27.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.065 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4341.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-17T18:15:27.065 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:14.589675+0000", 2024-09-17T18:15:27.065 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.474351272, 2024-09-17T18:15:27.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042949549999999996, 2024-09-17T18:15:27.065 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:27.065 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:27.065 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:27.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:27.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4341", 2024-09-17T18:15:27.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.87:0/844060755", 2024-09-17T18:15:27.065 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2 2024-09-17T18:15:27.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.066 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:27.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:27.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589675+0000", 2024-09-17T18:15:27.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:27.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:27.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589675+0000", 2024-09-17T18:15:27.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:27.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:27.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589677+0000", 2024-09-17T18:15:27.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4030000000000001e-06 2024-09-17T18:15:27.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:27.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589689+0000", 2024-09-17T18:15:27.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1453e-05 2024-09-17T18:15:27.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:27.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589710+0000", 2024-09-17T18:15:27.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1005e-05 2024-09-17T18:15:27.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:27.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589733+0000", 2024-09-17T18:15:27.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2951000000000001e-05 2024-09-17T18:15:27.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:27.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589824+0000", 2024-09-17T18:15:27.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1292999999999995e-05 2024-09-17T18:15:27.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-17T18:15:27.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589832+0000", 2024-09-17T18:15:27.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4589999999999998e-06 2024-09-17T18:15:27.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:27.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.593651+0000", 2024-09-17T18:15:27.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038184740000000001 2024-09-17T18:15:27.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:27.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.593970+0000", 2024-09-17T18:15:27.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000318917 2024-09-17T18:15:27.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:27.070 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:27.070 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:27.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.070 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4341.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-17T18:15:27.070 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:14.594366+0000", 2024-09-17T18:15:27.070 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.469659979999999, 2024-09-17T18:15:27.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000229791, 2024-09-17T18:15:27.070 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:27.070 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:27.070 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:27.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:27.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4341", 2024-09-17T18:15:27.071 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.87:0/844060755", 2024-09-17T18:15:27.071 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3 2024-09-17T18:15:27.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.071 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:27.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:27.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.594366+0000", 2024-09-17T18:15:27.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:27.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:27.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.594366+0000", 2024-09-17T18:15:27.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:27.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:27.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.594368+0000", 2024-09-17T18:15:27.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.39e-06 2024-09-17T18:15:27.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:27.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.594380+0000", 2024-09-17T18:15:27.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1266e-05 2024-09-17T18:15:27.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:27.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.594408+0000", 2024-09-17T18:15:27.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8260999999999999e-05 2024-09-17T18:15:27.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:27.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.594428+0000", 2024-09-17T18:15:27.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0265e-05 2024-09-17T18:15:27.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:27.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.594494+0000", 2024-09-17T18:15:27.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5555000000000005e-05 2024-09-17T18:15:27.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:27.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.594596+0000", 2024-09-17T18:15:27.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102054 2024-09-17T18:15:27.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:27.074 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:27.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:27.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.074 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4341.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-17T18:15:27.074 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:15.593080+0000", 2024-09-17T18:15:27.074 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.470945819000001, 2024-09-17T18:15:27.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085923119999999995, 2024-09-17T18:15:27.074 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:27.075 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:27.075 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:27.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:27.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4341", 2024-09-17T18:15:27.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.87:0/844060755", 2024-09-17T18:15:27.075 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 5 2024-09-17T18:15:27.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.075 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:27.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:27.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593080+0000", 2024-09-17T18:15:27.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:27.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:27.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593080+0000", 2024-09-17T18:15:27.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:27.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:27.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593094+0000", 2024-09-17T18:15:27.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3369e-05 2024-09-17T18:15:27.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:27.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593124+0000", 2024-09-17T18:15:27.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0443999999999999e-05 2024-09-17T18:15:27.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:27.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593168+0000", 2024-09-17T18:15:27.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4299999999999999e-05 2024-09-17T18:15:27.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:27.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593188+0000", 2024-09-17T18:15:27.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9235000000000001e-05 2024-09-17T18:15:27.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:27.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593430+0000", 2024-09-17T18:15:27.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000242267 2024-09-17T18:15:27.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:15:27.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593449+0000", 2024-09-17T18:15:27.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8692e-05 2024-09-17T18:15:27.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:27.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.597551+0000", 2024-09-17T18:15:27.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041025549999999999 2024-09-17T18:15:27.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:27.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.597784+0000", 2024-09-17T18:15:27.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023263099999999999 2024-09-17T18:15:27.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 12", 2024-09-17T18:15:27.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.598048+0000", 2024-09-17T18:15:27.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000264515 2024-09-17T18:15:27.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-17T18:15:27.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.599628+0000", 2024-09-17T18:15:27.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015802310000000001 2024-09-17T18:15:27.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:27.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.601515+0000", 2024-09-17T18:15:27.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001886432 2024-09-17T18:15:27.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:27.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.601610+0000", 2024-09-17T18:15:27.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4819000000000001e-05 2024-09-17T18:15:27.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:27.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.601673+0000", 2024-09-17T18:15:27.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2822000000000003e-05 2024-09-17T18:15:27.081 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:27.081 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:27.081 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:27.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.081 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4341.0:5 2.2 e25/24 ondisk, result = 0)", 2024-09-17T18:15:27.081 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:15.601328+0000", 2024-09-17T18:15:27.081 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.462697842000001, 2024-09-17T18:15:27.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0003591, 2024-09-17T18:15:27.081 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:27.081 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:27.081 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:27.081 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:27.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:27.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.601328+0000", 2024-09-17T18:15:27.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:27.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:27.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.601328+0000", 2024-09-17T18:15:27.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:27.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:27.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.601330+0000", 2024-09-17T18:15:27.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0530000000000001e-06 2024-09-17T18:15:27.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:27.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.601345+0000", 2024-09-17T18:15:27.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5038000000000001e-05 2024-09-17T18:15:27.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:27.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.601374+0000", 2024-09-17T18:15:27.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8844999999999999e-05 2024-09-17T18:15:27.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:27.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.601388+0000", 2024-09-17T18:15:27.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3478999999999999e-05 2024-09-17T18:15:27.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:27.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.601491+0000", 2024-09-17T18:15:27.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103218 2024-09-17T18:15:27.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:27.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.601504+0000", 2024-09-17T18:15:27.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3625000000000001e-05 2024-09-17T18:15:27.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:27.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.601687+0000", 2024-09-17T18:15:27.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018284200000000001 2024-09-17T18:15:27.085 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:27.085 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:27.085 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:27.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.085 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4341.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-17T18:15:27.085 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:16.614267+0000", 2024-09-17T18:15:27.085 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.449759036, 2024-09-17T18:15:27.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013420657000000001, 2024-09-17T18:15:27.085 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:27.085 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:27.085 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:27.086 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:27.086 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4341", 2024-09-17T18:15:27.086 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.87:0/844060755", 2024-09-17T18:15:27.086 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7 2024-09-17T18:15:27.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.086 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:27.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:27.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614267+0000", 2024-09-17T18:15:27.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:27.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:27.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614267+0000", 2024-09-17T18:15:27.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:27.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:27.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614270+0000", 2024-09-17T18:15:27.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6929999999999999e-06 2024-09-17T18:15:27.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:27.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614283+0000", 2024-09-17T18:15:27.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2986000000000001e-05 2024-09-17T18:15:27.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:27.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614316+0000", 2024-09-17T18:15:27.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3481e-05 2024-09-17T18:15:27.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:27.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614335+0000", 2024-09-17T18:15:27.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9088000000000001e-05 2024-09-17T18:15:27.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:27.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614487+0000", 2024-09-17T18:15:27.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015212400000000001 2024-09-17T18:15:27.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:15:27.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614498+0000", 2024-09-17T18:15:27.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.112e-05 2024-09-17T18:15:27.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:27.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.618395+0000", 2024-09-17T18:15:27.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038966130000000002 2024-09-17T18:15:27.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:27.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.618540+0000", 2024-09-17T18:15:27.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144902 2024-09-17T18:15:27.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 12", 2024-09-17T18:15:27.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.618745+0000", 2024-09-17T18:15:27.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020472700000000001 2024-09-17T18:15:27.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:27.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.621296+0000", 2024-09-17T18:15:27.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025509529999999999 2024-09-17T18:15:27.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-17T18:15:27.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.627523+0000", 2024-09-17T18:15:27.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062271490000000004 2024-09-17T18:15:27.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:27.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.627617+0000", 2024-09-17T18:15:27.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4133000000000002e-05 2024-09-17T18:15:27.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:27.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.627688+0000", 2024-09-17T18:15:27.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0687999999999998e-05 2024-09-17T18:15:27.092 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:27.092 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:27.092 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:27.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.092 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4341.0:7 2.2 e26/24 ondisk, result = 0)", 2024-09-17T18:15:27.092 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:16.621028+0000", 2024-09-17T18:15:27.092 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.442998237999999, 2024-09-17T18:15:27.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028005400000000001, 2024-09-17T18:15:27.093 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:27.093 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:27.093 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:27.093 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:27.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:27.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.621028+0000", 2024-09-17T18:15:27.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:27.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:27.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.621028+0000", 2024-09-17T18:15:27.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:27.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:27.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.621036+0000", 2024-09-17T18:15:27.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9389999999999997e-06 2024-09-17T18:15:27.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:27.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.621046+0000", 2024-09-17T18:15:27.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0719e-05 2024-09-17T18:15:27.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:27.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.621076+0000", 2024-09-17T18:15:27.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9725000000000001e-05 2024-09-17T18:15:27.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:27.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.621104+0000", 2024-09-17T18:15:27.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7521e-05 2024-09-17T18:15:27.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:27.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.621272+0000", 2024-09-17T18:15:27.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016809600000000001 2024-09-17T18:15:27.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:27.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.621286+0000", 2024-09-17T18:15:27.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4429e-05 2024-09-17T18:15:27.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:27.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:27.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:27.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.621308+0000", 2024-09-17T18:15:27.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1625e-05 2024-09-17T18:15:27.096 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:27.096 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:27.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:27.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:27.097 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:27.097 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:27.098 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T18:15:27.108 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:27.104+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:27.209 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:27.208+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:27.232 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:27.232 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:27.232 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:15:27.232 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:27.246 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T18:15:27.310 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:27.303+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:27.365 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:27.365 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:27.365 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:15:27.365 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:15:27.365 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:27.381 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T18:15:27.411 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:27.411+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:27.511 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:27.511+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:27.544 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:15:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:15:27.545 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [] 2024-09-17T18:15:27.545 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:27.559 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T18:15:27.612 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:27.609+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:27.664 INFO:teuthology.orchestra.run.smithi087.stderr:nodeep-scrub is set 2024-09-17T18:15:27.664 INFO:teuthology.orchestra.run.smithi087.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-17T18:15:27.691 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:27.691 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:27.691 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:15:27.691 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:27.706 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T18:15:27.713 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:27.708+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:27.813 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:27.812+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:27.821 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:27.821 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:27.822 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:15:27.822 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:15:27.822 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:27.836 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T18:15:27.914 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:27.907+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:27.961 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:27.961 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:15:27.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:15:27.961 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-17T18:15:27.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.962 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:27.962 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:13.571510+0000", 2024-09-17T18:15:27.962 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 14.387435648, 2024-09-17T18:15:27.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.35549906399999998, 2024-09-17T18:15:27.962 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:27.962 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:27.962 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:27.962 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:27.962 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:27.962 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:27.962 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 1 2024-09-17T18:15:27.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.962 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:27.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:27.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571510+0000", 2024-09-17T18:15:27.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:27.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:27.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571510+0000", 2024-09-17T18:15:27.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:27.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:27.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571513+0000", 2024-09-17T18:15:27.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5900000000000002e-06 2024-09-17T18:15:27.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:27.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571526+0000", 2024-09-17T18:15:27.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3106e-05 2024-09-17T18:15:27.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:27.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571548+0000", 2024-09-17T18:15:27.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1832999999999999e-05 2024-09-17T18:15:27.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:27.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571568+0000", 2024-09-17T18:15:27.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0446e-05 2024-09-17T18:15:27.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:27.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571715+0000", 2024-09-17T18:15:27.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000146475 2024-09-17T18:15:27.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-17T18:15:27.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571741+0000", 2024-09-17T18:15:27.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6009000000000001e-05 2024-09-17T18:15:27.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:27.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.922992+0000", 2024-09-17T18:15:27.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.35125145800000002 2024-09-17T18:15:27.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:27.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.923283+0000", 2024-09-17T18:15:27.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00029046999999999998 2024-09-17T18:15:27.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:27.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.923607+0000", 2024-09-17T18:15:27.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00032395200000000002 2024-09-17T18:15:27.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:27.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.924798+0000", 2024-09-17T18:15:27.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011917329999999999 2024-09-17T18:15:27.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:27.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.926847+0000", 2024-09-17T18:15:27.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020485009999999999 2024-09-17T18:15:27.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:27.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.926945+0000", 2024-09-17T18:15:27.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7750000000000004e-05 2024-09-17T18:15:27.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.968 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:27.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.927009+0000", 2024-09-17T18:15:27.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4740999999999996e-05 2024-09-17T18:15:27.968 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:27.968 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:27.968 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:27.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.969 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:27.969 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073054+0000", 2024-09-17T18:15:27.969 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.885892061, 2024-09-17T18:15:27.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017781126000000001, 2024-09-17T18:15:27.969 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:27.969 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:27.969 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:27.969 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:27.969 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:27.969 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:27.969 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 47 2024-09-17T18:15:27.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.969 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:27.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:27.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073054+0000", 2024-09-17T18:15:27.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:27.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:27.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073054+0000", 2024-09-17T18:15:27.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:27.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:27.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073055+0000", 2024-09-17T18:15:27.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4700000000000001e-07 2024-09-17T18:15:27.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:27.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073138+0000", 2024-09-17T18:15:27.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3607000000000001e-05 2024-09-17T18:15:27.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:27.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073153+0000", 2024-09-17T18:15:27.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4969e-05 2024-09-17T18:15:27.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:27.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073161+0000", 2024-09-17T18:15:27.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6000000000000001e-06 2024-09-17T18:15:27.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:27.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.084558+0000", 2024-09-17T18:15:27.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011397457999999999 2024-09-17T18:15:27.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:27.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.084732+0000", 2024-09-17T18:15:27.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000173401 2024-09-17T18:15:27.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:27.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.084940+0000", 2024-09-17T18:15:27.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020803400000000001 2024-09-17T18:15:27.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:27.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090671+0000", 2024-09-17T18:15:27.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0057309450000000003 2024-09-17T18:15:27.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.973 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:27.973 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090695+0000", 2024-09-17T18:15:27.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3932000000000001e-05 2024-09-17T18:15:27.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:27.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090771+0000", 2024-09-17T18:15:27.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6014999999999996e-05 2024-09-17T18:15:27.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:27.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090835+0000", 2024-09-17T18:15:27.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4418000000000006e-05 2024-09-17T18:15:27.974 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:27.974 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:27.974 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:27.974 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.975 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:27.975 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073198+0000", 2024-09-17T18:15:27.975 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.885747839, 2024-09-17T18:15:27.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018005944999999999, 2024-09-17T18:15:27.975 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:27.975 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:27.975 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:27.975 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:27.975 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:27.975 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:27.975 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 48 2024-09-17T18:15:27.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.976 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:27.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:27.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073198+0000", 2024-09-17T18:15:27.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:27.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:27.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073198+0000", 2024-09-17T18:15:27.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:27.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:27.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073199+0000", 2024-09-17T18:15:27.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7599999999999996e-07 2024-09-17T18:15:27.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:27.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073205+0000", 2024-09-17T18:15:27.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2840000000000003e-06 2024-09-17T18:15:27.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:27.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073221+0000", 2024-09-17T18:15:27.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5498999999999998e-05 2024-09-17T18:15:27.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:27.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073246+0000", 2024-09-17T18:15:27.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4793000000000001e-05 2024-09-17T18:15:27.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:27.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.085863+0000", 2024-09-17T18:15:27.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012617033 2024-09-17T18:15:27.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:27.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.085983+0000", 2024-09-17T18:15:27.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012071299999999999 2024-09-17T18:15:27.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:27.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.086174+0000", 2024-09-17T18:15:27.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000190457 2024-09-17T18:15:27.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:27.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090925+0000", 2024-09-17T18:15:27.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047513659999999999 2024-09-17T18:15:27.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:27.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091032+0000", 2024-09-17T18:15:27.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106933 2024-09-17T18:15:27.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:27.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091143+0000", 2024-09-17T18:15:27.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111197 2024-09-17T18:15:27.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:27.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091204+0000", 2024-09-17T18:15:27.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0794000000000001e-05 2024-09-17T18:15:27.980 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:27.980 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:27.981 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:27.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.981 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:27.981 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073262+0000", 2024-09-17T18:15:27.981 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.885684351, 2024-09-17T18:15:27.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018090469000000001, 2024-09-17T18:15:27.981 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:27.981 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:27.981 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:27.981 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:27.981 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:27.981 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:27.982 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 49 2024-09-17T18:15:27.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.982 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:27.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:27.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073262+0000", 2024-09-17T18:15:27.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:27.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:27.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073262+0000", 2024-09-17T18:15:27.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:27.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:27.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073263+0000", 2024-09-17T18:15:27.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0160000000000001e-06 2024-09-17T18:15:27.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:27.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073269+0000", 2024-09-17T18:15:27.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0039999999999996e-06 2024-09-17T18:15:27.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:27.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073283+0000", 2024-09-17T18:15:27.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4559000000000001e-05 2024-09-17T18:15:27.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:27.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073291+0000", 2024-09-17T18:15:27.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7200000000000006e-06 2024-09-17T18:15:27.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:27.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.087142+0000", 2024-09-17T18:15:27.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013850987 2024-09-17T18:15:27.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:27.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.087298+0000", 2024-09-17T18:15:27.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015572900000000001 2024-09-17T18:15:27.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:27.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.087485+0000", 2024-09-17T18:15:27.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018764399999999999 2024-09-17T18:15:27.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:27.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091014+0000", 2024-09-17T18:15:27.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035285780000000001 2024-09-17T18:15:27.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:27.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091217+0000", 2024-09-17T18:15:27.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020357 2024-09-17T18:15:27.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:27.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091302+0000", 2024-09-17T18:15:27.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4614e-05 2024-09-17T18:15:27.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:27.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091352+0000", 2024-09-17T18:15:27.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0047999999999999e-05 2024-09-17T18:15:27.986 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:27.987 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:27.987 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:27.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.987 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:27.987 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073303+0000", 2024-09-17T18:15:27.987 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.885643069, 2024-09-17T18:15:27.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.020201742000000002, 2024-09-17T18:15:27.988 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:27.988 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:27.988 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:27.988 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:27.988 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:27.988 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:27.988 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 50 2024-09-17T18:15:27.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.988 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:27.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:27.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073303+0000", 2024-09-17T18:15:27.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:27.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:27.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073303+0000", 2024-09-17T18:15:27.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:27.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:27.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073304+0000", 2024-09-17T18:15:27.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1699999999999997e-07 2024-09-17T18:15:27.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:27.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073388+0000", 2024-09-17T18:15:27.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4222999999999996e-05 2024-09-17T18:15:27.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:27.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073403+0000", 2024-09-17T18:15:27.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.488e-05 2024-09-17T18:15:27.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:27.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073411+0000", 2024-09-17T18:15:27.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0660000000000004e-06 2024-09-17T18:15:27.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:27.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.089184+0000", 2024-09-17T18:15:27.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015773646999999998 2024-09-17T18:15:27.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:27.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.089309+0000", 2024-09-17T18:15:27.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000124809 2024-09-17T18:15:27.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:27.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.089514+0000", 2024-09-17T18:15:27.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000204871 2024-09-17T18:15:27.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:27.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093318+0000", 2024-09-17T18:15:27.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038034050000000002 2024-09-17T18:15:27.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:27.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093337+0000", 2024-09-17T18:15:27.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9839000000000001e-05 2024-09-17T18:15:27.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:27.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093412+0000", 2024-09-17T18:15:27.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5012000000000006e-05 2024-09-17T18:15:27.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:27.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093505+0000", 2024-09-17T18:15:27.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2273000000000002e-05 2024-09-17T18:15:27.993 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:27.994 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:27.994 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:27.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.994 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:27.994 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:15:27.994 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.885520422999999, 2024-09-17T18:15:27.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.020790197, 2024-09-17T18:15:27.994 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:27.994 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:27.994 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:27.994 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:27.994 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:27.994 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:27.995 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 51 2024-09-17T18:15:27.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.995 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:27.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:27.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:15:27.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:27.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:27.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:15:27.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:27.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:27.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:15:27.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5000000000000001e-07 2024-09-17T18:15:27.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:27.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073432+0000", 2024-09-17T18:15:27.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7030000000000003e-06 2024-09-17T18:15:27.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:27.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073445+0000", 2024-09-17T18:15:27.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.239e-05 2024-09-17T18:15:27.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:27.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073452+0000", 2024-09-17T18:15:27.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8460000000000008e-06 2024-09-17T18:15:27.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:27.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091415+0000", 2024-09-17T18:15:27.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017962982999999998 2024-09-17T18:15:27.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:27.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091545+0000", 2024-09-17T18:15:27.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013008599999999999 2024-09-17T18:15:27.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:27.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091736+0000", 2024-09-17T18:15:27.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019030100000000001 2024-09-17T18:15:27.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:27.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093524+0000", 2024-09-17T18:15:27.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017882060000000001 2024-09-17T18:15:27.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:27.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094070+0000", 2024-09-17T18:15:27.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00054624999999999997 2024-09-17T18:15:27.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:27.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094156+0000", 2024-09-17T18:15:27.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5446999999999997e-05 2024-09-17T18:15:27.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:27.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:27.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:27.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094216+0000", 2024-09-17T18:15:28.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0134999999999999e-05 2024-09-17T18:15:28.000 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.000 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.000 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.000 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:28.000 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073465+0000", 2024-09-17T18:15:28.000 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.885481087, 2024-09-17T18:15:28.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021176878, 2024-09-17T18:15:28.000 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:28.000 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:28.000 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:28.001 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:28.001 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:28.001 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:28.001 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 52 2024-09-17T18:15:28.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.001 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:28.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:28.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073465+0000", 2024-09-17T18:15:28.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:28.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073465+0000", 2024-09-17T18:15:28.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:28.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073466+0000", 2024-09-17T18:15:28.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3e-07 2024-09-17T18:15:28.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:28.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073472+0000", 2024-09-17T18:15:28.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0519999999999998e-06 2024-09-17T18:15:28.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:28.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073483+0000", 2024-09-17T18:15:28.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1586999999999999e-05 2024-09-17T18:15:28.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:28.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073490+0000", 2024-09-17T18:15:28.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8229999999999997e-06 2024-09-17T18:15:28.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:28.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.092415+0000", 2024-09-17T18:15:28.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018924926000000002 2024-09-17T18:15:28.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:28.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.092535+0000", 2024-09-17T18:15:28.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012039 2024-09-17T18:15:28.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:28.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.092739+0000", 2024-09-17T18:15:28.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000203926 2024-09-17T18:15:28.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:28.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094258+0000", 2024-09-17T18:15:28.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015184689999999999 2024-09-17T18:15:28.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:28.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094513+0000", 2024-09-17T18:15:28.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00025523199999999998 2024-09-17T18:15:28.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:28.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094590+0000", 2024-09-17T18:15:28.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6743999999999996e-05 2024-09-17T18:15:28.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:28.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094642+0000", 2024-09-17T18:15:28.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1999000000000001e-05 2024-09-17T18:15:28.006 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.006 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.006 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.006 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:28.006 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180665+0000", 2024-09-17T18:15:28.006 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.778280801999999, 2024-09-17T18:15:28.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.014802907000000001, 2024-09-17T18:15:28.006 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:28.006 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:28.007 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:28.007 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:28.007 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:28.007 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:28.007 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 70 2024-09-17T18:15:28.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.007 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:28.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:28.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180665+0000", 2024-09-17T18:15:28.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:28.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180665+0000", 2024-09-17T18:15:28.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:28.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180666+0000", 2024-09-17T18:15:28.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1200000000000001e-06 2024-09-17T18:15:28.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:28.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180673+0000", 2024-09-17T18:15:28.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2140000000000001e-06 2024-09-17T18:15:28.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:28.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180682+0000", 2024-09-17T18:15:28.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8360000000000004e-06 2024-09-17T18:15:28.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:28.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180690+0000", 2024-09-17T18:15:28.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2060000000000001e-06 2024-09-17T18:15:28.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:28.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.186564+0000", 2024-09-17T18:15:28.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0058741669999999996 2024-09-17T18:15:28.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:28.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.186728+0000", 2024-09-17T18:15:28.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000163852 2024-09-17T18:15:28.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:28.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.186907+0000", 2024-09-17T18:15:28.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000179801 2024-09-17T18:15:28.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:28.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.192695+0000", 2024-09-17T18:15:28.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0057873860000000003 2024-09-17T18:15:28.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:28.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195312+0000", 2024-09-17T18:15:28.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026170239999999999 2024-09-17T18:15:28.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:28.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195399+0000", 2024-09-17T18:15:28.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6984000000000006e-05 2024-09-17T18:15:28.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:28.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195468+0000", 2024-09-17T18:15:28.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9317000000000001e-05 2024-09-17T18:15:28.012 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.012 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.012 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.012 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:28.012 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180702+0000", 2024-09-17T18:15:28.012 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.778243915999999, 2024-09-17T18:15:28.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.01511287, 2024-09-17T18:15:28.013 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:28.013 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:28.013 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:28.013 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:28.013 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:28.013 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:28.013 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 71 2024-09-17T18:15:28.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.013 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:28.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:28.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180702+0000", 2024-09-17T18:15:28.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:28.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180702+0000", 2024-09-17T18:15:28.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:28.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180703+0000", 2024-09-17T18:15:28.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-17T18:15:28.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:28.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180709+0000", 2024-09-17T18:15:28.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0000000000000002e-06 2024-09-17T18:15:28.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:28.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180718+0000", 2024-09-17T18:15:28.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.969e-06 2024-09-17T18:15:28.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:28.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180725+0000", 2024-09-17T18:15:28.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9199999999999998e-06 2024-09-17T18:15:28.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:28.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.187527+0000", 2024-09-17T18:15:28.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0068019179999999997 2024-09-17T18:15:28.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:28.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.187641+0000", 2024-09-17T18:15:28.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011426599999999999 2024-09-17T18:15:28.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:28.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.187819+0000", 2024-09-17T18:15:28.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017757800000000001 2024-09-17T18:15:28.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:28.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.192702+0000", 2024-09-17T18:15:28.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0048828880000000002 2024-09-17T18:15:28.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:28.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195593+0000", 2024-09-17T18:15:28.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028913150000000002 2024-09-17T18:15:28.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:28.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195730+0000", 2024-09-17T18:15:28.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013735900000000001 2024-09-17T18:15:28.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:28.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195815+0000", 2024-09-17T18:15:28.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4647000000000005e-05 2024-09-17T18:15:28.018 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.018 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.018 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.018 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:28.018 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180737+0000", 2024-09-17T18:15:28.019 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.778209329999999, 2024-09-17T18:15:28.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016428557999999999, 2024-09-17T18:15:28.019 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:28.019 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:28.019 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:28.019 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:28.019 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:28.019 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:28.019 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 72 2024-09-17T18:15:28.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.019 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:28.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:28.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180737+0000", 2024-09-17T18:15:28.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:28.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180737+0000", 2024-09-17T18:15:28.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:28.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180738+0000", 2024-09-17T18:15:28.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.006e-06 2024-09-17T18:15:28.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:28.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180875+0000", 2024-09-17T18:15:28.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000136952 2024-09-17T18:15:28.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:28.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180887+0000", 2024-09-17T18:15:28.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2636999999999999e-05 2024-09-17T18:15:28.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:28.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180896+0000", 2024-09-17T18:15:28.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3860000000000007e-06 2024-09-17T18:15:28.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:28.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.188650+0000", 2024-09-17T18:15:28.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0077543810000000003 2024-09-17T18:15:28.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:28.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.188761+0000", 2024-09-17T18:15:28.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011128699999999999 2024-09-17T18:15:28.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:28.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.188934+0000", 2024-09-17T18:15:28.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000172817 2024-09-17T18:15:28.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:28.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195490+0000", 2024-09-17T18:15:28.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0065560360000000003 2024-09-17T18:15:28.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:28.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.196887+0000", 2024-09-17T18:15:28.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001397138 2024-09-17T18:15:28.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:28.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.197049+0000", 2024-09-17T18:15:28.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000161628 2024-09-17T18:15:28.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:28.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.197165+0000", 2024-09-17T18:15:28.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011629 2024-09-17T18:15:28.024 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.025 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.025 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.025 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:28.025 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180912+0000", 2024-09-17T18:15:28.025 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.778034055999999, 2024-09-17T18:15:28.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017495620999999999, 2024-09-17T18:15:28.025 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:28.025 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:28.025 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:28.025 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:28.026 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:28.026 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:28.026 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 73 2024-09-17T18:15:28.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.026 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:28.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:28.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180912+0000", 2024-09-17T18:15:28.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:28.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180912+0000", 2024-09-17T18:15:28.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:28.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180913+0000", 2024-09-17T18:15:28.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0529999999999999e-06 2024-09-17T18:15:28.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:28.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180920+0000", 2024-09-17T18:15:28.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8369999999999999e-06 2024-09-17T18:15:28.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:28.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180929+0000", 2024-09-17T18:15:28.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3659999999999998e-06 2024-09-17T18:15:28.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:28.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180936+0000", 2024-09-17T18:15:28.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9659999999999999e-06 2024-09-17T18:15:28.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:28.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.191317+0000", 2024-09-17T18:15:28.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010380545 2024-09-17T18:15:28.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:28.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.191435+0000", 2024-09-17T18:15:28.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118746 2024-09-17T18:15:28.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:28.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.191616+0000", 2024-09-17T18:15:28.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018002799999999999 2024-09-17T18:15:28.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:28.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.197244+0000", 2024-09-17T18:15:28.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056280940000000002 2024-09-17T18:15:28.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:28.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198243+0000", 2024-09-17T18:15:28.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00099925500000000011 2024-09-17T18:15:28.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:28.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198336+0000", 2024-09-17T18:15:28.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3447000000000002e-05 2024-09-17T18:15:28.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:28.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198408+0000", 2024-09-17T18:15:28.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1284000000000004e-05 2024-09-17T18:15:28.031 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.031 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.031 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.031 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:28.031 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180948+0000", 2024-09-17T18:15:28.031 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.777997704000001, 2024-09-17T18:15:28.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017711738000000001, 2024-09-17T18:15:28.032 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:28.032 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:28.032 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:28.032 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:28.032 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:28.032 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:28.032 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 74 2024-09-17T18:15:28.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.032 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:28.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:28.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180948+0000", 2024-09-17T18:15:28.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:28.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180948+0000", 2024-09-17T18:15:28.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:28.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180949+0000", 2024-09-17T18:15:28.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9000000000000005e-07 2024-09-17T18:15:28.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:28.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180955+0000", 2024-09-17T18:15:28.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3900000000000001e-06 2024-09-17T18:15:28.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:28.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180964+0000", 2024-09-17T18:15:28.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0559999999999994e-06 2024-09-17T18:15:28.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:28.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180970+0000", 2024-09-17T18:15:28.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-17T18:15:28.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:28.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.192795+0000", 2024-09-17T18:15:28.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011825057999999999 2024-09-17T18:15:28.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:28.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193035+0000", 2024-09-17T18:15:28.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00023942000000000001 2024-09-17T18:15:28.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:28.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193232+0000", 2024-09-17T18:15:28.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000197383 2024-09-17T18:15:28.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:28.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.197434+0000", 2024-09-17T18:15:28.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0042018029999999996 2024-09-17T18:15:28.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:28.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198506+0000", 2024-09-17T18:15:28.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0010720860000000001 2024-09-17T18:15:28.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:28.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198595+0000", 2024-09-17T18:15:28.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8710999999999998e-05 2024-09-17T18:15:28.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:28.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198660+0000", 2024-09-17T18:15:28.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5251000000000003e-05 2024-09-17T18:15:28.037 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.037 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.037 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.038 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:28.038 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180982+0000", 2024-09-17T18:15:28.038 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.777964024999999, 2024-09-17T18:15:28.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0204972, 2024-09-17T18:15:28.038 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:28.038 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:28.038 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:28.038 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:28.038 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:28.038 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:28.038 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 75 2024-09-17T18:15:28.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.038 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:28.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:28.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180982+0000", 2024-09-17T18:15:28.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:28.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180982+0000", 2024-09-17T18:15:28.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:28.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180983+0000", 2024-09-17T18:15:28.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8700000000000005e-07 2024-09-17T18:15:28.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:28.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181111+0000", 2024-09-17T18:15:28.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012798200000000001 2024-09-17T18:15:28.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:28.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181123+0000", 2024-09-17T18:15:28.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2283000000000001e-05 2024-09-17T18:15:28.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181133+0000", 2024-09-17T18:15:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.028e-05 2024-09-17T18:15:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193832+0000", 2024-09-17T18:15:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012698276999999999 2024-09-17T18:15:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193952+0000", 2024-09-17T18:15:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012077 2024-09-17T18:15:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.194141+0000", 2024-09-17T18:15:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018815100000000001 2024-09-17T18:15:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.199915+0000", 2024-09-17T18:15:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0057741190000000003 2024-09-17T18:15:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201326+0000", 2024-09-17T18:15:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001411463 2024-09-17T18:15:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201410+0000", 2024-09-17T18:15:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4166999999999996e-05 2024-09-17T18:15:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201479+0000", 2024-09-17T18:15:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8921e-05 2024-09-17T18:15:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.044 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.044 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.044 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:28.044 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.181149+0000", 2024-09-17T18:15:28.044 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.777797064, 2024-09-17T18:15:28.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.02060089, 2024-09-17T18:15:28.044 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:28.044 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:28.044 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:28.044 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 76 2024-09-17T18:15:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181149+0000", 2024-09-17T18:15:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181149+0000", 2024-09-17T18:15:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181150+0000", 2024-09-17T18:15:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3399999999999997e-07 2024-09-17T18:15:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181157+0000", 2024-09-17T18:15:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.379e-06 2024-09-17T18:15:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181166+0000", 2024-09-17T18:15:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0869999999999996e-06 2024-09-17T18:15:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181173+0000", 2024-09-17T18:15:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8360000000000003e-06 2024-09-17T18:15:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195884+0000", 2024-09-17T18:15:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.014710877000000001 2024-09-17T18:15:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:28.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.196029+0000", 2024-09-17T18:15:28.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014536900000000001 2024-09-17T18:15:28.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:28.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.196221+0000", 2024-09-17T18:15:28.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019122 2024-09-17T18:15:28.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:28.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.199925+0000", 2024-09-17T18:15:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037047389999999999 2024-09-17T18:15:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201572+0000", 2024-09-17T18:15:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001646652 2024-09-17T18:15:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201656+0000", 2024-09-17T18:15:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4107e-05 2024-09-17T18:15:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201750+0000", 2024-09-17T18:15:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3690000000000006e-05 2024-09-17T18:15:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.377941+0000", 2024-09-17T18:15:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.581005209000001, 2024-09-17T18:15:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.014341242000000001, 2024-09-17T18:15:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 119 2024-09-17T18:15:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.377941+0000", 2024-09-17T18:15:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.377941+0000", 2024-09-17T18:15:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.377942+0000", 2024-09-17T18:15:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.406e-06 2024-09-17T18:15:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.377953+0000", 2024-09-17T18:15:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0987e-05 2024-09-17T18:15:28.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:28.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.377972+0000", 2024-09-17T18:15:28.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8338999999999998e-05 2024-09-17T18:15:28.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:28.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.377985+0000", 2024-09-17T18:15:28.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3563e-05 2024-09-17T18:15:28.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.388154+0000", 2024-09-17T18:15:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010168961000000001 2024-09-17T18:15:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.388290+0000", 2024-09-17T18:15:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000136272 2024-09-17T18:15:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.388496+0000", 2024-09-17T18:15:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020587399999999999 2024-09-17T18:15:28.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:28.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392013+0000", 2024-09-17T18:15:28.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035166149999999998 2024-09-17T18:15:28.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:28.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392049+0000", 2024-09-17T18:15:28.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5812000000000002e-05 2024-09-17T18:15:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392178+0000", 2024-09-17T18:15:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000129209 2024-09-17T18:15:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392282+0000", 2024-09-17T18:15:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010420399999999999 2024-09-17T18:15:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378036+0000", 2024-09-17T18:15:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.580910036000001, 2024-09-17T18:15:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015468097, 2024-09-17T18:15:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:28.058 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:28.058 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 120 2024-09-17T18:15:28.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.058 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:28.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:28.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378036+0000", 2024-09-17T18:15:28.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:28.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378036+0000", 2024-09-17T18:15:28.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378038+0000", 2024-09-17T18:15:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5600000000000001e-06 2024-09-17T18:15:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378173+0000", 2024-09-17T18:15:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013549600000000001 2024-09-17T18:15:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378198+0000", 2024-09-17T18:15:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4975999999999999e-05 2024-09-17T18:15:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378220+0000", 2024-09-17T18:15:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1688999999999999e-05 2024-09-17T18:15:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.389483+0000", 2024-09-17T18:15:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011263237000000001 2024-09-17T18:15:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.389603+0000", 2024-09-17T18:15:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119696 2024-09-17T18:15:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.389804+0000", 2024-09-17T18:15:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000201177 2024-09-17T18:15:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393237+0000", 2024-09-17T18:15:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034328599999999998 2024-09-17T18:15:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393278+0000", 2024-09-17T18:15:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1343e-05 2024-09-17T18:15:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393410+0000", 2024-09-17T18:15:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000131839 2024-09-17T18:15:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393504+0000", 2024-09-17T18:15:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4223999999999998e-05 2024-09-17T18:15:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378256+0000", 2024-09-17T18:15:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.580690346000001, 2024-09-17T18:15:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017159648999999999, 2024-09-17T18:15:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 121 2024-09-17T18:15:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378256+0000", 2024-09-17T18:15:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378256+0000", 2024-09-17T18:15:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378257+0000", 2024-09-17T18:15:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.573e-06 2024-09-17T18:15:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378269+0000", 2024-09-17T18:15:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1246999999999999e-05 2024-09-17T18:15:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378288+0000", 2024-09-17T18:15:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9239e-05 2024-09-17T18:15:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378302+0000", 2024-09-17T18:15:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4123e-05 2024-09-17T18:15:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.390941+0000", 2024-09-17T18:15:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012639015999999999 2024-09-17T18:15:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.391061+0000", 2024-09-17T18:15:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000120569 2024-09-17T18:15:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.391251+0000", 2024-09-17T18:15:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018965099999999999 2024-09-17T18:15:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393610+0000", 2024-09-17T18:15:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023590550000000001 2024-09-17T18:15:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.395217+0000", 2024-09-17T18:15:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0016063819999999999 2024-09-17T18:15:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.395355+0000", 2024-09-17T18:15:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000138863 2024-09-17T18:15:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.395415+0000", 2024-09-17T18:15:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9930999999999999e-05 2024-09-17T18:15:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:28.070 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378327+0000", 2024-09-17T18:15:28.070 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.580619264999999, 2024-09-17T18:15:28.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018591921000000001, 2024-09-17T18:15:28.070 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:28.070 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:28.070 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:28.070 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:28.070 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:28.070 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:28.070 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 122 2024-09-17T18:15:28.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.070 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:28.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:28.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378327+0000", 2024-09-17T18:15:28.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:28.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378327+0000", 2024-09-17T18:15:28.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:28.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378328+0000", 2024-09-17T18:15:28.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3170000000000001e-06 2024-09-17T18:15:28.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:28.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378338+0000", 2024-09-17T18:15:28.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0006e-05 2024-09-17T18:15:28.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:28.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378358+0000", 2024-09-17T18:15:28.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9919e-05 2024-09-17T18:15:28.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:28.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378371+0000", 2024-09-17T18:15:28.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3363999999999999e-05 2024-09-17T18:15:28.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:28.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392332+0000", 2024-09-17T18:15:28.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013960396999999999 2024-09-17T18:15:28.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:28.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392445+0000", 2024-09-17T18:15:28.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011278899999999999 2024-09-17T18:15:28.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:28.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392625+0000", 2024-09-17T18:15:28.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000180082 2024-09-17T18:15:28.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:28.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396780+0000", 2024-09-17T18:15:28.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0041555639999999996 2024-09-17T18:15:28.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:28.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396802+0000", 2024-09-17T18:15:28.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1460000000000001e-05 2024-09-17T18:15:28.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:28.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396864+0000", 2024-09-17T18:15:28.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2193999999999994e-05 2024-09-17T18:15:28.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:28.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396919+0000", 2024-09-17T18:15:28.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4829e-05 2024-09-17T18:15:28.075 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.075 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.075 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.076 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:28.076 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378397+0000", 2024-09-17T18:15:28.076 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.5805489, 2024-09-17T18:15:28.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018905537, 2024-09-17T18:15:28.076 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:28.076 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:28.076 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:28.076 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:28.076 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:28.076 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:28.076 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 123 2024-09-17T18:15:28.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.076 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:28.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:28.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378397+0000", 2024-09-17T18:15:28.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:28.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378397+0000", 2024-09-17T18:15:28.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:28.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378399+0000", 2024-09-17T18:15:28.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4559999999999999e-06 2024-09-17T18:15:28.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:28.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378595+0000", 2024-09-17T18:15:28.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019676399999999999 2024-09-17T18:15:28.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:28.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378611+0000", 2024-09-17T18:15:28.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5268999999999999e-05 2024-09-17T18:15:28.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:28.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378622+0000", 2024-09-17T18:15:28.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1593999999999999e-05 2024-09-17T18:15:28.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:28.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393759+0000", 2024-09-17T18:15:28.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015136836000000001 2024-09-17T18:15:28.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:28.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393966+0000", 2024-09-17T18:15:28.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020672 2024-09-17T18:15:28.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:28.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.394159+0000", 2024-09-17T18:15:28.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000193594 2024-09-17T18:15:28.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:28.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396935+0000", 2024-09-17T18:15:28.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027754889999999999 2024-09-17T18:15:28.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:28.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397041+0000", 2024-09-17T18:15:28.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105853 2024-09-17T18:15:28.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:28.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397193+0000", 2024-09-17T18:15:28.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015243200000000001 2024-09-17T18:15:28.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:28.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397303+0000", 2024-09-17T18:15:28.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010953 2024-09-17T18:15:28.081 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.084 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.084 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.084 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:28.084 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378646+0000", 2024-09-17T18:15:28.084 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.580300458, 2024-09-17T18:15:28.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019220590999999999, 2024-09-17T18:15:28.085 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:28.085 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:28.085 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:28.085 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:28.085 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:28.085 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:28.085 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 124 2024-09-17T18:15:28.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.085 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:28.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:28.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378646+0000", 2024-09-17T18:15:28.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:28.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378646+0000", 2024-09-17T18:15:28.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:28.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:28.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378647+0000", 2024-09-17T18:15:28.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.17e-06 2024-09-17T18:15:28.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:28.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378655+0000", 2024-09-17T18:15:28.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999997e-06 2024-09-17T18:15:28.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:28.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378669+0000", 2024-09-17T18:15:28.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4715000000000001e-05 2024-09-17T18:15:28.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:28.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378677+0000", 2024-09-17T18:15:28.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5499999999999997e-06 2024-09-17T18:15:28.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:28.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.395519+0000", 2024-09-17T18:15:28.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016842012999999999 2024-09-17T18:15:28.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:28.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.395741+0000", 2024-09-17T18:15:28.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000221776 2024-09-17T18:15:28.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:28.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396098+0000", 2024-09-17T18:15:28.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00035730199999999999 2024-09-17T18:15:28.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:28.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397456+0000", 2024-09-17T18:15:28.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001357701 2024-09-17T18:15:28.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:28.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397740+0000", 2024-09-17T18:15:28.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000284068 2024-09-17T18:15:28.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:28.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397813+0000", 2024-09-17T18:15:28.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2934000000000003e-05 2024-09-17T18:15:28.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:28.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:28.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:28.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397866+0000", 2024-09-17T18:15:28.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3542000000000003e-05 2024-09-17T18:15:28.090 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.090 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.090 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.090 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:28.090 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:28.090 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:28.092 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T18:15:28.095 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:28.089+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:28.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:28.192+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:28.264 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:28.264 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:28.264 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:15:28.265 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:28.281 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T18:15:28.295 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:28.295+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:28.396 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:28.391+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:28.403 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:28.404 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:28.404 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:15:28.404 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:15:28.404 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:28.418 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T18:15:28.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:28.492+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:28.576 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:28.576 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:15:28.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:15:28.576 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [] 2024-09-17T18:15:28.576 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:28.590 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T18:15:28.598 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:28.596+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:28.699 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:28.697+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:28.702 DEBUG:teuthology.orchestra.run.smithi154:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 400 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0 2024-09-17T18:15:28.709 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:28.709 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:28.709 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:15:28.709 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:28.723 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T18:15:28.724 INFO:tasks.rados.rados.0.smithi154.stdout:adding op weight read -> 100 2024-09-17T18:15:28.724 INFO:tasks.rados.rados.0.smithi154.stdout:adding op weight delete -> 50 2024-09-17T18:15:28.724 INFO:tasks.rados.rados.0.smithi154.stdout:adding op weight snap_create -> 50 2024-09-17T18:15:28.724 INFO:tasks.rados.rados.0.smithi154.stdout:adding op weight snap_remove -> 50 2024-09-17T18:15:28.724 INFO:tasks.rados.rados.0.smithi154.stdout:adding op weight rollback -> 50 2024-09-17T18:15:28.724 INFO:tasks.rados.rados.0.smithi154.stdout:adding op weight setattr -> 25 2024-09-17T18:15:28.724 INFO:tasks.rados.rados.0.smithi154.stdout:adding op weight rmattr -> 25 2024-09-17T18:15:28.724 INFO:tasks.rados.rados.0.smithi154.stdout:adding op weight copy_from -> 50 2024-09-17T18:15:28.725 INFO:tasks.rados.rados.0.smithi154.stdout:adding op weight append -> 100 2024-09-17T18:15:28.725 INFO:tasks.rados.rados.0.smithi154.stdout:ceph version 19.3.0-4975-g1889a165 (1889a165b5128787ec693450a3d1c5df5d6dc203) squid (dev) 2024-09-17T18:15:28.725 INFO:tasks.rados.rados.0.smithi154.stdout:Configuration: 2024-09-17T18:15:28.725 INFO:tasks.rados.rados.0.smithi154.stdout: Number of operations: 400 2024-09-17T18:15:28.725 INFO:tasks.rados.rados.0.smithi154.stdout: Number of objects: 50 2024-09-17T18:15:28.725 INFO:tasks.rados.rados.0.smithi154.stdout: Max in flight operations: 16 2024-09-17T18:15:28.725 INFO:tasks.rados.rados.0.smithi154.stdout: Object size (in bytes): 4000000 2024-09-17T18:15:28.725 INFO:tasks.rados.rados.0.smithi154.stdout: Write stride min: 400000 2024-09-17T18:15:28.725 INFO:tasks.rados.rados.0.smithi154.stdout: Write stride max: 800000 2024-09-17T18:15:28.800 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:28.795+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:28.822 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T18:15:28.842 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:15:28.842 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:15:28.842 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:28.856 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T18:15:28.901 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:28.897+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:28.976 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:15:28.976 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:15:28.998 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:15:28.998 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:15:29.001 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:28.995+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:29.018 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:15:29.018 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:15:29.021 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:29.021 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:15:29.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:15:29.021 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-17T18:15:29.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.021 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4341.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-17T18:15:29.021 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.579743+0000", 2024-09-17T18:15:29.021 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 14.441369567000001, 2024-09-17T18:15:29.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0016539359999999999, 2024-09-17T18:15:29.022 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:29.022 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:29.022 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:29.022 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:29.022 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4341", 2024-09-17T18:15:29.022 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/844060755", 2024-09-17T18:15:29.022 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 1 2024-09-17T18:15:29.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.022 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:29.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:29.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.579743+0000", 2024-09-17T18:15:29.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:29.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:29.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.579743+0000", 2024-09-17T18:15:29.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:29.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:29.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.579745+0000", 2024-09-17T18:15:29.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5820000000000001e-06 2024-09-17T18:15:29.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:29.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.579751+0000", 2024-09-17T18:15:29.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0299999999999999e-06 2024-09-17T18:15:29.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:29.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.579762+0000", 2024-09-17T18:15:29.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0542e-05 2024-09-17T18:15:29.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:29.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.579771+0000", 2024-09-17T18:15:29.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.952e-06 2024-09-17T18:15:29.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:29.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.579831+0000", 2024-09-17T18:15:29.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0636e-05 2024-09-17T18:15:29.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:29.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.579971+0000", 2024-09-17T18:15:29.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013934799999999999 2024-09-17T18:15:29.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 5", 2024-09-17T18:15:29.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.580084+0000", 2024-09-17T18:15:29.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011338200000000001 2024-09-17T18:15:29.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:29.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.580685+0000", 2024-09-17T18:15:29.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00060076800000000001 2024-09-17T18:15:29.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:29.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.581326+0000", 2024-09-17T18:15:29.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00064096400000000005 2024-09-17T18:15:29.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:29.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.581363+0000", 2024-09-17T18:15:29.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7237999999999998e-05 2024-09-17T18:15:29.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:29.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.581397+0000", 2024-09-17T18:15:29.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4493999999999999e-05 2024-09-17T18:15:29.028 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:29.028 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:29.028 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:29.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.028 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_repop_reply(client.4341.0:1 2.3 e25/24 ondisk, result = 0)", 2024-09-17T18:15:29.029 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.581253+0000", 2024-09-17T18:15:29.029 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 14.439859995000001, 2024-09-17T18:15:29.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014944700000000001, 2024-09-17T18:15:29.029 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:29.029 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:29.029 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-17T18:15:29.029 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:29.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:29.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.581253+0000", 2024-09-17T18:15:29.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:29.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:29.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.581253+0000", 2024-09-17T18:15:29.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:29.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:29.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.581254+0000", 2024-09-17T18:15:29.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.122e-06 2024-09-17T18:15:29.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:29.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.581261+0000", 2024-09-17T18:15:29.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7229999999999998e-06 2024-09-17T18:15:29.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:29.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.581270+0000", 2024-09-17T18:15:29.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4399999999999994e-06 2024-09-17T18:15:29.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:29.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.581276+0000", 2024-09-17T18:15:29.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2939999999999996e-06 2024-09-17T18:15:29.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:29.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.581315+0000", 2024-09-17T18:15:29.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9257e-05 2024-09-17T18:15:29.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:29.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.581322+0000", 2024-09-17T18:15:29.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6479999999999997e-06 2024-09-17T18:15:29.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:29.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:29.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:29.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.581402+0000", 2024-09-17T18:15:29.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0963000000000004e-05 2024-09-17T18:15:29.034 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:29.034 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:29.034 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:29.035 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:29.035 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:29.035 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:29.037 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T18:15:29.041 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:15:29.041 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:15:29.057 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:15:29.058 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:15:29.079 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:15:29.079 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:15:29.098 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:15:29.099 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:15:29.105 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:29.095+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:29.120 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:15:29.120 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:15:29.139 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:15:29.140 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:15:29.160 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:15:29.161 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:15:29.169 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:29.169 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:29.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T18:15:29.184 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:15:29.184 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:15:29.201 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:15:29.201 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:15:29.220 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:15:29.221 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:15:29.227 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:29.225+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:29.304 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:29.303+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:29.305 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:29.305 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:29.319 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T18:15:29.411 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:29.409+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:29.446 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:15:29.446 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:15:29.477 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:15:29.477 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:15:29.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:15:29.475+0000 7f41ef7fe640 0 -- 172.21.15.87:0/491333028 >> [v2:172.21.15.154:6824/3670919160,v1:172.21.15.154:6825/3670919160] conn(0x7f41f0224e50 msgr2=0x7f41f0227240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T18:15:29.484 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:29.484 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:29.499 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T18:15:29.543 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:29.541+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:29.609 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:29.603+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:29.656 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T18:15:29.656 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-17T18:15:29.666 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:29.666 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:29.681 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T18:15:29.682 INFO:tasks.rados.rados.0.smithi154.stdout:1: write initial oid 1 2024-09-17T18:15:29.682 INFO:tasks.rados.rados.0.smithi154.stdout:1: seq_num 0 ranges {0=32768} 2024-09-17T18:15:29.682 INFO:tasks.rados.rados.0.smithi154.stdout:1: writing smithi15432074-1 from 0 to 32768 tid 1 2024-09-17T18:15:29.682 INFO:tasks.rados.rados.0.smithi154.stdout:2: write initial oid 2 2024-09-17T18:15:29.683 INFO:tasks.rados.rados.0.smithi154.stdout:2: seq_num 1 ranges {0=32768} 2024-09-17T18:15:29.683 INFO:tasks.rados.rados.0.smithi154.stdout:2: writing smithi15432074-2 from 0 to 32768 tid 1 2024-09-17T18:15:29.683 INFO:tasks.rados.rados.0.smithi154.stdout:3: write initial oid 3 2024-09-17T18:15:29.683 INFO:tasks.rados.rados.0.smithi154.stdout:3: seq_num 2 ranges {0=49152} 2024-09-17T18:15:29.684 INFO:tasks.rados.rados.0.smithi154.stdout:3: writing smithi15432074-3 from 0 to 49152 tid 1 2024-09-17T18:15:29.684 INFO:tasks.rados.rados.0.smithi154.stdout:4: write initial oid 4 2024-09-17T18:15:29.685 INFO:tasks.rados.rados.0.smithi154.stdout:4: seq_num 3 ranges {0=65536} 2024-09-17T18:15:29.685 INFO:tasks.rados.rados.0.smithi154.stdout:4: writing smithi15432074-4 from 0 to 65536 tid 1 2024-09-17T18:15:29.685 INFO:tasks.rados.rados.0.smithi154.stdout:5: write initial oid 5 2024-09-17T18:15:29.685 INFO:tasks.rados.rados.0.smithi154.stdout:5: seq_num 4 ranges {0=81920} 2024-09-17T18:15:29.685 INFO:tasks.rados.rados.0.smithi154.stdout:5: writing smithi15432074-5 from 0 to 81920 tid 1 2024-09-17T18:15:29.685 INFO:tasks.rados.rados.0.smithi154.stdout:6: write initial oid 6 2024-09-17T18:15:29.685 INFO:tasks.rados.rados.0.smithi154.stdout:6: seq_num 5 ranges {0=98304} 2024-09-17T18:15:29.685 INFO:tasks.rados.rados.0.smithi154.stdout:6: writing smithi15432074-6 from 0 to 98304 tid 1 2024-09-17T18:15:29.685 INFO:tasks.rados.rados.0.smithi154.stdout:7: write initial oid 7 2024-09-17T18:15:29.685 INFO:tasks.rados.rados.0.smithi154.stdout:7: seq_num 6 ranges {0=114688} 2024-09-17T18:15:29.686 INFO:tasks.rados.rados.0.smithi154.stdout:7: writing smithi15432074-7 from 0 to 114688 tid 1 2024-09-17T18:15:29.686 INFO:tasks.rados.rados.0.smithi154.stdout:8: write initial oid 8 2024-09-17T18:15:29.686 INFO:tasks.rados.rados.0.smithi154.stdout:8: seq_num 7 ranges {0=131072} 2024-09-17T18:15:29.688 INFO:tasks.rados.rados.0.smithi154.stdout:8: writing smithi15432074-8 from 0 to 131072 tid 1 2024-09-17T18:15:29.688 INFO:tasks.rados.rados.0.smithi154.stdout:9: write initial oid 9 2024-09-17T18:15:29.688 INFO:tasks.rados.rados.0.smithi154.stdout:9: seq_num 8 ranges {0=147456} 2024-09-17T18:15:29.688 INFO:tasks.rados.rados.0.smithi154.stdout:9: writing smithi15432074-9 from 0 to 147456 tid 1 2024-09-17T18:15:29.688 INFO:tasks.rados.rados.0.smithi154.stdout:10: write initial oid 10 2024-09-17T18:15:29.688 INFO:tasks.rados.rados.0.smithi154.stdout:10: seq_num 9 ranges {0=163840} 2024-09-17T18:15:29.690 INFO:tasks.rados.rados.0.smithi154.stdout:10: writing smithi15432074-10 from 0 to 163840 tid 1 2024-09-17T18:15:29.690 INFO:tasks.rados.rados.0.smithi154.stdout:11: write initial oid 11 2024-09-17T18:15:29.690 INFO:tasks.rados.rados.0.smithi154.stdout:11: seq_num 10 ranges {0=180224} 2024-09-17T18:15:29.691 INFO:tasks.rados.rados.0.smithi154.stdout:11: writing smithi15432074-11 from 0 to 180224 tid 1 2024-09-17T18:15:29.691 INFO:tasks.rados.rados.0.smithi154.stdout:12: write initial oid 12 2024-09-17T18:15:29.691 INFO:tasks.rados.rados.0.smithi154.stdout:12: seq_num 11 ranges {0=196608} 2024-09-17T18:15:29.692 INFO:tasks.rados.rados.0.smithi154.stdout:12: writing smithi15432074-12 from 0 to 196608 tid 1 2024-09-17T18:15:29.692 INFO:tasks.rados.rados.0.smithi154.stdout:13: write initial oid 13 2024-09-17T18:15:29.692 INFO:tasks.rados.rados.0.smithi154.stdout:13: seq_num 12 ranges {0=212992} 2024-09-17T18:15:29.694 INFO:tasks.rados.rados.0.smithi154.stdout:13: writing smithi15432074-13 from 0 to 212992 tid 1 2024-09-17T18:15:29.694 INFO:tasks.rados.rados.0.smithi154.stdout:14: write initial oid 14 2024-09-17T18:15:29.695 INFO:tasks.rados.rados.0.smithi154.stdout:14: seq_num 13 ranges {0=229376} 2024-09-17T18:15:29.695 INFO:tasks.rados.rados.0.smithi154.stdout:14: writing smithi15432074-14 from 0 to 229376 tid 1 2024-09-17T18:15:29.696 INFO:tasks.rados.rados.0.smithi154.stdout:15: write initial oid 15 2024-09-17T18:15:29.696 INFO:tasks.rados.rados.0.smithi154.stdout:15: seq_num 14 ranges {0=245760} 2024-09-17T18:15:29.698 INFO:tasks.rados.rados.0.smithi154.stdout:15: writing smithi15432074-15 from 0 to 245760 tid 1 2024-09-17T18:15:29.698 INFO:tasks.rados.rados.0.smithi154.stdout:16: write initial oid 16 2024-09-17T18:15:29.698 INFO:tasks.rados.rados.0.smithi154.stdout:16: seq_num 15 ranges {0=262144} 2024-09-17T18:15:29.700 INFO:tasks.rados.rados.0.smithi154.stdout:16: writing smithi15432074-16 from 0 to 262144 tid 1 2024-09-17T18:15:29.700 INFO:tasks.rados.rados.0.smithi154.stdout:4: finishing write tid 1 to smithi15432074-4 2024-09-17T18:15:29.700 INFO:tasks.rados.rados.0.smithi154.stdout:2: finishing write tid 1 to smithi15432074-2 2024-09-17T18:15:29.701 INFO:tasks.rados.rados.0.smithi154.stdout:4: finishing write tid 2 to smithi15432074-4 2024-09-17T18:15:29.701 INFO:tasks.rados.rados.0.smithi154.stdout:5: finishing write tid 1 to smithi15432074-5 2024-09-17T18:15:29.701 INFO:tasks.rados.rados.0.smithi154.stdout:5: finishing write tid 2 to smithi15432074-5 2024-09-17T18:15:29.701 INFO:tasks.rados.rados.0.smithi154.stdout: waiting on 16 2024-09-17T18:15:29.701 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T18:15:29.703 INFO:tasks.rados.rados.0.smithi154.stdout:2: finishing write tid 2 to smithi15432074-2 2024-09-17T18:15:29.705 INFO:tasks.rados.rados.0.smithi154.stdout:4: finishing write tid 3 to smithi15432074-4 2024-09-17T18:15:29.705 INFO:tasks.rados.rados.0.smithi154.stdout:4: oid 4 updating version 0 to 1 2024-09-17T18:15:29.705 INFO:tasks.rados.rados.0.smithi154.stdout:4: oid 4 updating version 1 to 2 2024-09-17T18:15:29.705 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 4 v 2 (ObjNum 3 snap 0 seq_num 3) dirty exists 2024-09-17T18:15:29.705 INFO:tasks.rados.rados.0.smithi154.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2024-09-17T18:15:29.705 INFO:tasks.rados.rados.0.smithi154.stdout:4: done (15 left) 2024-09-17T18:15:29.706 INFO:tasks.rados.rados.0.smithi154.stdout:17: write initial oid 17 2024-09-17T18:15:29.706 INFO:tasks.rados.rados.0.smithi154.stdout:17: seq_num 16 ranges {0=278528} 2024-09-17T18:15:29.707 INFO:tasks.rados.rados.0.smithi154.stdout:17: writing smithi15432074-17 from 0 to 278528 tid 1 2024-09-17T18:15:29.707 INFO:tasks.rados.rados.0.smithi154.stdout: waiting on 16 2024-09-17T18:15:29.707 INFO:tasks.rados.rados.0.smithi154.stdout:7: finishing write tid 1 to smithi15432074-7 2024-09-17T18:15:29.707 INFO:tasks.rados.rados.0.smithi154.stdout:7: finishing write tid 2 to smithi15432074-7 2024-09-17T18:15:29.707 INFO:tasks.rados.rados.0.smithi154.stdout:9: finishing write tid 1 to smithi15432074-9 2024-09-17T18:15:29.709 INFO:tasks.rados.rados.0.smithi154.stdout:7: finishing write tid 3 to smithi15432074-7 2024-09-17T18:15:29.709 INFO:tasks.rados.rados.0.smithi154.stdout:7: oid 7 updating version 0 to 1 2024-09-17T18:15:29.709 INFO:tasks.rados.rados.0.smithi154.stdout:7: oid 7 updating version 1 to 2 2024-09-17T18:15:29.709 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 7 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-09-17T18:15:29.709 INFO:tasks.rados.rados.0.smithi154.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2024-09-17T18:15:29.709 INFO:tasks.rados.rados.0.smithi154.stdout:7: done (15 left) 2024-09-17T18:15:29.709 INFO:tasks.rados.rados.0.smithi154.stdout:18: write initial oid 18 2024-09-17T18:15:29.709 INFO:tasks.rados.rados.0.smithi154.stdout:18: seq_num 17 ranges {0=294912} 2024-09-17T18:15:29.711 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:29.709+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:29.712 INFO:tasks.rados.rados.0.smithi154.stdout:18: writing smithi15432074-18 from 0 to 294912 tid 1 2024-09-17T18:15:29.712 INFO:tasks.rados.rados.0.smithi154.stdout: waiting on 16 2024-09-17T18:15:29.712 INFO:tasks.rados.rados.0.smithi154.stdout:9: finishing write tid 2 to smithi15432074-9 2024-09-17T18:15:29.717 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:15:29.717 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:15:29.718 INFO:tasks.rados.rados.0.smithi154.stdout:9: finishing write tid 3 to smithi15432074-9 2024-09-17T18:15:29.718 INFO:tasks.rados.rados.0.smithi154.stdout:9: oid 9 updating version 0 to 1 2024-09-17T18:15:29.718 INFO:tasks.rados.rados.0.smithi154.stdout:9: oid 9 updating version 1 to 2 2024-09-17T18:15:29.718 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 9 v 2 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-09-17T18:15:29.719 INFO:tasks.rados.rados.0.smithi154.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2024-09-17T18:15:29.719 INFO:tasks.rados.rados.0.smithi154.stdout:9: done (15 left) 2024-09-17T18:15:29.719 INFO:tasks.rados.rados.0.smithi154.stdout:19: write initial oid 19 2024-09-17T18:15:29.719 INFO:tasks.rados.rados.0.smithi154.stdout:19: seq_num 18 ranges {0=311296} 2024-09-17T18:15:29.719 INFO:tasks.rados.rados.0.smithi154.stdout:19: writing smithi15432074-19 from 0 to 311296 tid 1 2024-09-17T18:15:29.719 INFO:tasks.rados.rados.0.smithi154.stdout: waiting on 16 2024-09-17T18:15:29.719 INFO:tasks.rados.rados.0.smithi154.stdout:6: finishing write tid 1 to smithi15432074-6 2024-09-17T18:15:29.719 INFO:tasks.rados.rados.0.smithi154.stdout:2: finishing write tid 3 to smithi15432074-2 2024-09-17T18:15:29.719 INFO:tasks.rados.rados.0.smithi154.stdout:2: oid 2 updating version 0 to 2 2024-09-17T18:15:29.719 INFO:tasks.rados.rados.0.smithi154.stdout:2: oid 2 version 2 is already newer than 1 2024-09-17T18:15:29.719 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 2 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-09-17T18:15:29.719 INFO:tasks.rados.rados.0.smithi154.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2024-09-17T18:15:29.719 INFO:tasks.rados.rados.0.smithi154.stdout:2: done (15 left) 2024-09-17T18:15:29.720 INFO:tasks.rados.rados.0.smithi154.stdout:20: write initial oid 20 2024-09-17T18:15:29.720 INFO:tasks.rados.rados.0.smithi154.stdout:20: seq_num 19 ranges {0=327680} 2024-09-17T18:15:29.720 INFO:tasks.rados.rados.0.smithi154.stdout:20: writing smithi15432074-20 from 0 to 327680 tid 1 2024-09-17T18:15:29.720 INFO:tasks.rados.rados.0.smithi154.stdout: waiting on 16 2024-09-17T18:15:29.723 INFO:tasks.rados.rados.0.smithi154.stdout:6: finishing write tid 2 to smithi15432074-6 2024-09-17T18:15:29.723 INFO:tasks.rados.rados.0.smithi154.stdout:3: finishing write tid 1 to smithi15432074-3 2024-09-17T18:15:29.724 INFO:tasks.rados.rados.0.smithi154.stdout:3: finishing write tid 2 to smithi15432074-3 2024-09-17T18:15:29.724 INFO:tasks.rados.rados.0.smithi154.stdout:16: finishing write tid 1 to smithi15432074-16 2024-09-17T18:15:29.725 INFO:tasks.rados.rados.0.smithi154.stdout:3: finishing write tid 3 to smithi15432074-3 2024-09-17T18:15:29.725 INFO:tasks.rados.rados.0.smithi154.stdout:3: oid 3 updating version 0 to 1 2024-09-17T18:15:29.726 INFO:tasks.rados.rados.0.smithi154.stdout:3: oid 3 updating version 1 to 2 2024-09-17T18:15:29.726 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 3 v 2 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-09-17T18:15:29.726 INFO:tasks.rados.rados.0.smithi154.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2024-09-17T18:15:29.726 INFO:tasks.rados.rados.0.smithi154.stdout:3: done (15 left) 2024-09-17T18:15:29.726 INFO:tasks.rados.rados.0.smithi154.stdout:21: write initial oid 21 2024-09-17T18:15:29.726 INFO:tasks.rados.rados.0.smithi154.stdout:21: seq_num 20 ranges {0=344064} 2024-09-17T18:15:29.729 INFO:tasks.rados.rados.0.smithi154.stdout:21: writing smithi15432074-21 from 0 to 344064 tid 1 2024-09-17T18:15:29.729 INFO:tasks.rados.rados.0.smithi154.stdout: waiting on 16 2024-09-17T18:15:29.729 INFO:tasks.rados.rados.0.smithi154.stdout:8: finishing write tid 1 to smithi15432074-8 2024-09-17T18:15:29.729 INFO:tasks.rados.rados.0.smithi154.stdout:13: finishing write tid 1 to smithi15432074-13 2024-09-17T18:15:29.730 INFO:tasks.rados.rados.0.smithi154.stdout:14: finishing write tid 1 to smithi15432074-14 2024-09-17T18:15:29.730 INFO:tasks.rados.rados.0.smithi154.stdout:14: finishing write tid 2 to smithi15432074-14 2024-09-17T18:15:29.730 INFO:tasks.rados.rados.0.smithi154.stdout:1: finishing write tid 1 to smithi15432074-1 2024-09-17T18:15:29.730 INFO:tasks.rados.rados.0.smithi154.stdout:1: finishing write tid 2 to smithi15432074-1 2024-09-17T18:15:29.730 INFO:tasks.rados.rados.0.smithi154.stdout:14: finishing write tid 3 to smithi15432074-14 2024-09-17T18:15:29.730 INFO:tasks.rados.rados.0.smithi154.stdout:14: oid 14 updating version 0 to 3 2024-09-17T18:15:29.730 INFO:tasks.rados.rados.0.smithi154.stdout:14: oid 14 updating version 3 to 4 2024-09-17T18:15:29.730 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 14 v 4 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-09-17T18:15:29.730 INFO:tasks.rados.rados.0.smithi154.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2024-09-17T18:15:29.730 INFO:tasks.rados.rados.0.smithi154.stdout:20: finishing write tid 1 to smithi15432074-20 2024-09-17T18:15:29.730 INFO:tasks.rados.rados.0.smithi154.stdout:20: finishing write tid 2 to smithi15432074-20 2024-09-17T18:15:29.730 INFO:tasks.rados.rados.0.smithi154.stdout:14: done (15 left) 2024-09-17T18:15:29.730 INFO:tasks.rados.rados.0.smithi154.stdout:22: write initial oid 22 2024-09-17T18:15:29.731 INFO:tasks.rados.rados.0.smithi154.stdout:22: seq_num 21 ranges {0=360448} 2024-09-17T18:15:29.732 INFO:tasks.rados.rados.0.smithi154.stdout:22: writing smithi15432074-22 from 0 to 360448 tid 1 2024-09-17T18:15:29.733 INFO:tasks.rados.rados.0.smithi154.stdout: waiting on 16 2024-09-17T18:15:29.733 INFO:tasks.rados.rados.0.smithi154.stdout:20: finishing write tid 3 to smithi15432074-20 2024-09-17T18:15:29.733 INFO:tasks.rados.rados.0.smithi154.stdout:20: oid 20 updating version 0 to 4 2024-09-17T18:15:29.733 INFO:tasks.rados.rados.0.smithi154.stdout:20: oid 20 version 4 is already newer than 3 2024-09-17T18:15:29.733 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 20 v 4 (ObjNum 19 snap 0 seq_num 19) dirty exists 2024-09-17T18:15:29.733 INFO:tasks.rados.rados.0.smithi154.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2024-09-17T18:15:29.733 INFO:tasks.rados.rados.0.smithi154.stdout:1: finishing write tid 3 to smithi15432074-1 2024-09-17T18:15:29.733 INFO:tasks.rados.rados.0.smithi154.stdout:1: oid 1 updating version 0 to 1 2024-09-17T18:15:29.733 INFO:tasks.rados.rados.0.smithi154.stdout:1: oid 1 updating version 1 to 2 2024-09-17T18:15:29.733 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 1 v 2 (ObjNum 0 snap 0 seq_num 0) dirty exists 2024-09-17T18:15:29.733 INFO:tasks.rados.rados.0.smithi154.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2024-09-17T18:15:29.733 INFO:tasks.rados.rados.0.smithi154.stdout:1: done (15 left) 2024-09-17T18:15:29.734 INFO:tasks.rados.rados.0.smithi154.stdout:20: done (14 left) 2024-09-17T18:15:29.734 INFO:tasks.rados.rados.0.smithi154.stdout:23: write initial oid 23 2024-09-17T18:15:29.734 INFO:tasks.rados.rados.0.smithi154.stdout:23: seq_num 22 ranges {0=376832} 2024-09-17T18:15:29.736 INFO:tasks.rados.rados.0.smithi154.stdout:23: writing smithi15432074-23 from 0 to 376832 tid 1 2024-09-17T18:15:29.736 INFO:tasks.rados.rados.0.smithi154.stdout:24: write initial oid 24 2024-09-17T18:15:29.736 INFO:tasks.rados.rados.0.smithi154.stdout:6: finishing write tid 3 to smithi15432074-6 2024-09-17T18:15:29.736 INFO:tasks.rados.rados.0.smithi154.stdout:6: oid 6 updating version 0 to 4 2024-09-17T18:15:29.736 INFO:tasks.rados.rados.0.smithi154.stdout:6: oid 6 version 4 is already newer than 3 2024-09-17T18:15:29.736 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 6 v 4 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-09-17T18:15:29.737 INFO:tasks.rados.rados.0.smithi154.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2024-09-17T18:15:29.737 INFO:tasks.rados.rados.0.smithi154.stdout:13: finishing write tid 2 to smithi15432074-13 2024-09-17T18:15:29.737 INFO:tasks.rados.rados.0.smithi154.stdout:5: finishing write tid 3 to smithi15432074-5 2024-09-17T18:15:29.737 INFO:tasks.rados.rados.0.smithi154.stdout:5: oid 5 updating version 0 to 2 2024-09-17T18:15:29.737 INFO:tasks.rados.rados.0.smithi154.stdout:5: oid 5 version 2 is already newer than 1 2024-09-17T18:15:29.737 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 5 v 2 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-09-17T18:15:29.737 INFO:tasks.rados.rados.0.smithi154.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2024-09-17T18:15:29.737 INFO:tasks.rados.rados.0.smithi154.stdout:13: finishing write tid 3 to smithi15432074-13 2024-09-17T18:15:29.737 INFO:tasks.rados.rados.0.smithi154.stdout:13: oid 13 updating version 0 to 4 2024-09-17T18:15:29.737 INFO:tasks.rados.rados.0.smithi154.stdout:13: oid 13 version 4 is already newer than 3 2024-09-17T18:15:29.737 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 13 v 4 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-09-17T18:15:29.737 INFO:tasks.rados.rados.0.smithi154.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2024-09-17T18:15:29.737 INFO:tasks.rados.rados.0.smithi154.stdout:11: finishing write tid 1 to smithi15432074-11 2024-09-17T18:15:29.737 INFO:tasks.rados.rados.0.smithi154.stdout:16: finishing write tid 2 to smithi15432074-16 2024-09-17T18:15:29.738 INFO:tasks.rados.rados.0.smithi154.stdout:11: finishing write tid 2 to smithi15432074-11 2024-09-17T18:15:29.738 INFO:tasks.rados.rados.0.smithi154.stdout:24: seq_num 23 ranges {0=393216} 2024-09-17T18:15:29.739 INFO:tasks.rados.rados.0.smithi154.stdout:24: writing smithi15432074-24 from 0 to 393216 tid 1 2024-09-17T18:15:29.739 INFO:tasks.rados.rados.0.smithi154.stdout:5: done (15 left) 2024-09-17T18:15:29.739 INFO:tasks.rados.rados.0.smithi154.stdout:6: done (14 left) 2024-09-17T18:15:29.739 INFO:tasks.rados.rados.0.smithi154.stdout:13: done (13 left) 2024-09-17T18:15:29.739 INFO:tasks.rados.rados.0.smithi154.stdout:25: write initial oid 25 2024-09-17T18:15:29.740 INFO:tasks.rados.rados.0.smithi154.stdout:25: seq_num 24 ranges {0=409600} 2024-09-17T18:15:29.743 INFO:tasks.rados.rados.0.smithi154.stdout:25: writing smithi15432074-25 from 0 to 409600 tid 1 2024-09-17T18:15:29.743 INFO:tasks.rados.rados.0.smithi154.stdout:26: write initial oid 26 2024-09-17T18:15:29.743 INFO:tasks.rados.rados.0.smithi154.stdout:26: seq_num 25 ranges {0=425984} 2024-09-17T18:15:29.747 INFO:tasks.rados.rados.0.smithi154.stdout:26: writing smithi15432074-26 from 0 to 425984 tid 1 2024-09-17T18:15:29.748 INFO:tasks.rados.rados.0.smithi154.stdout:27: write initial oid 27 2024-09-17T18:15:29.748 INFO:tasks.rados.rados.0.smithi154.stdout:16: finishing write tid 3 to smithi15432074-16 2024-09-17T18:15:29.748 INFO:tasks.rados.rados.0.smithi154.stdout:16: oid 16 updating version 0 to 1 2024-09-17T18:15:29.748 INFO:tasks.rados.rados.0.smithi154.stdout:16: oid 16 updating version 1 to 2 2024-09-17T18:15:29.748 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 16 v 2 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-09-17T18:15:29.748 INFO:tasks.rados.rados.0.smithi154.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2024-09-17T18:15:29.748 INFO:tasks.rados.rados.0.smithi154.stdout:19: finishing write tid 1 to smithi15432074-19 2024-09-17T18:15:29.748 INFO:tasks.rados.rados.0.smithi154.stdout:15: finishing write tid 1 to smithi15432074-15 2024-09-17T18:15:29.748 INFO:tasks.rados.rados.0.smithi154.stdout:15: finishing write tid 2 to smithi15432074-15 2024-09-17T18:15:29.749 INFO:tasks.rados.rados.0.smithi154.stdout:8: finishing write tid 2 to smithi15432074-8 2024-09-17T18:15:29.749 INFO:tasks.rados.rados.0.smithi154.stdout:19: finishing write tid 2 to smithi15432074-19 2024-09-17T18:15:29.749 INFO:tasks.rados.rados.0.smithi154.stdout:17: finishing write tid 1 to smithi15432074-17 2024-09-17T18:15:29.749 INFO:tasks.rados.rados.0.smithi154.stdout:19: finishing write tid 3 to smithi15432074-19 2024-09-17T18:15:29.749 INFO:tasks.rados.rados.0.smithi154.stdout:19: oid 19 updating version 0 to 1 2024-09-17T18:15:29.749 INFO:tasks.rados.rados.0.smithi154.stdout:19: oid 19 updating version 1 to 2 2024-09-17T18:15:29.749 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 19 v 2 (ObjNum 18 snap 0 seq_num 18) dirty exists 2024-09-17T18:15:29.749 INFO:tasks.rados.rados.0.smithi154.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2024-09-17T18:15:29.749 INFO:tasks.rados.rados.0.smithi154.stdout:23: finishing write tid 1 to smithi15432074-23 2024-09-17T18:15:29.749 INFO:tasks.rados.rados.0.smithi154.stdout:10: finishing write tid 1 to smithi15432074-10 2024-09-17T18:15:29.749 INFO:tasks.rados.rados.0.smithi154.stdout:10: finishing write tid 2 to smithi15432074-10 2024-09-17T18:15:29.749 INFO:tasks.rados.rados.0.smithi154.stdout:17: finishing write tid 2 to smithi15432074-17 2024-09-17T18:15:29.749 INFO:tasks.rados.rados.0.smithi154.stdout:24: finishing write tid 1 to smithi15432074-24 2024-09-17T18:15:29.750 INFO:tasks.rados.rados.0.smithi154.stdout:23: finishing write tid 2 to smithi15432074-23 2024-09-17T18:15:29.750 INFO:tasks.rados.rados.0.smithi154.stdout:12: finishing write tid 1 to smithi15432074-12 2024-09-17T18:15:29.750 INFO:tasks.rados.rados.0.smithi154.stdout:24: finishing write tid 2 to smithi15432074-24 2024-09-17T18:15:29.750 INFO:tasks.rados.rados.0.smithi154.stdout:27: seq_num 26 ranges {0=442368} 2024-09-17T18:15:29.752 INFO:tasks.rados.rados.0.smithi154.stdout:27: writing smithi15432074-27 from 0 to 442368 tid 1 2024-09-17T18:15:29.752 INFO:tasks.rados.rados.0.smithi154.stdout:12: finishing write tid 2 to smithi15432074-12 2024-09-17T18:15:29.752 INFO:tasks.rados.rados.0.smithi154.stdout:11: finishing write tid 3 to smithi15432074-11 2024-09-17T18:15:29.752 INFO:tasks.rados.rados.0.smithi154.stdout:11: oid 11 updating version 0 to 1 2024-09-17T18:15:29.752 INFO:tasks.rados.rados.0.smithi154.stdout:11: oid 11 updating version 1 to 2 2024-09-17T18:15:29.752 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 11 v 2 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-09-17T18:15:29.752 INFO:tasks.rados.rados.0.smithi154.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2024-09-17T18:15:29.752 INFO:tasks.rados.rados.0.smithi154.stdout:24: finishing write tid 3 to smithi15432074-24 2024-09-17T18:15:29.752 INFO:tasks.rados.rados.0.smithi154.stdout:24: oid 24 updating version 0 to 4 2024-09-17T18:15:29.753 INFO:tasks.rados.rados.0.smithi154.stdout:24: oid 24 version 4 is already newer than 3 2024-09-17T18:15:29.753 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 24 v 4 (ObjNum 23 snap 0 seq_num 23) dirty exists 2024-09-17T18:15:29.753 INFO:tasks.rados.rados.0.smithi154.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2024-09-17T18:15:29.753 INFO:tasks.rados.rados.0.smithi154.stdout:15: finishing write tid 3 to smithi15432074-15 2024-09-17T18:15:29.753 INFO:tasks.rados.rados.0.smithi154.stdout:15: oid 15 updating version 0 to 3 2024-09-17T18:15:29.753 INFO:tasks.rados.rados.0.smithi154.stdout:15: oid 15 updating version 3 to 4 2024-09-17T18:15:29.753 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 15 v 4 (ObjNum 14 snap 0 seq_num 14) dirty exists 2024-09-17T18:15:29.753 INFO:tasks.rados.rados.0.smithi154.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2024-09-17T18:15:29.753 INFO:tasks.rados.rados.0.smithi154.stdout:25: finishing write tid 1 to smithi15432074-25 2024-09-17T18:15:29.753 INFO:tasks.rados.rados.0.smithi154.stdout:8: finishing write tid 3 to smithi15432074-8 2024-09-17T18:15:29.753 INFO:tasks.rados.rados.0.smithi154.stdout:8: oid 8 updating version 0 to 5 2024-09-17T18:15:29.753 INFO:tasks.rados.rados.0.smithi154.stdout:8: oid 8 updating version 5 to 6 2024-09-17T18:15:29.753 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 8 v 6 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-09-17T18:15:29.753 INFO:tasks.rados.rados.0.smithi154.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2024-09-17T18:15:29.754 INFO:tasks.rados.rados.0.smithi154.stdout:23: finishing write tid 3 to smithi15432074-23 2024-09-17T18:15:29.754 INFO:tasks.rados.rados.0.smithi154.stdout:23: oid 23 updating version 0 to 2 2024-09-17T18:15:29.754 INFO:tasks.rados.rados.0.smithi154.stdout:23: oid 23 version 2 is already newer than 1 2024-09-17T18:15:29.754 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 23 v 2 (ObjNum 22 snap 0 seq_num 22) dirty exists 2024-09-17T18:15:29.754 INFO:tasks.rados.rados.0.smithi154.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2024-09-17T18:15:29.754 INFO:tasks.rados.rados.0.smithi154.stdout:25: finishing write tid 2 to smithi15432074-25 2024-09-17T18:15:29.754 INFO:tasks.rados.rados.0.smithi154.stdout:8: done (15 left) 2024-09-17T18:15:29.754 INFO:tasks.rados.rados.0.smithi154.stdout:11: done (14 left) 2024-09-17T18:15:29.754 INFO:tasks.rados.rados.0.smithi154.stdout:15: done (13 left) 2024-09-17T18:15:29.754 INFO:tasks.rados.rados.0.smithi154.stdout:16: done (12 left) 2024-09-17T18:15:29.754 INFO:tasks.rados.rados.0.smithi154.stdout:19: done (11 left) 2024-09-17T18:15:29.754 INFO:tasks.rados.rados.0.smithi154.stdout:23: done (10 left) 2024-09-17T18:15:29.754 INFO:tasks.rados.rados.0.smithi154.stdout:24: done (9 left) 2024-09-17T18:15:29.755 INFO:tasks.rados.rados.0.smithi154.stdout:28: write initial oid 28 2024-09-17T18:15:29.755 INFO:tasks.rados.rados.0.smithi154.stdout:28: seq_num 27 ranges {0=458752} 2024-09-17T18:15:29.756 INFO:tasks.rados.rados.0.smithi154.stdout:28: writing smithi15432074-28 from 0 to 458752 tid 1 2024-09-17T18:15:29.756 INFO:tasks.rados.rados.0.smithi154.stdout:29: write initial oid 29 2024-09-17T18:15:29.756 INFO:tasks.rados.rados.0.smithi154.stdout:29: seq_num 28 ranges {0=475136} 2024-09-17T18:15:29.760 INFO:tasks.rados.rados.0.smithi154.stdout:29: writing smithi15432074-29 from 0 to 475136 tid 1 2024-09-17T18:15:29.760 INFO:tasks.rados.rados.0.smithi154.stdout:25: finishing write tid 3 to smithi15432074-25 2024-09-17T18:15:29.760 INFO:tasks.rados.rados.0.smithi154.stdout:25: oid 25 updating version 0 to 6 2024-09-17T18:15:29.760 INFO:tasks.rados.rados.0.smithi154.stdout:25: oid 25 version 6 is already newer than 5 2024-09-17T18:15:29.760 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 25 v 6 (ObjNum 24 snap 0 seq_num 24) dirty exists 2024-09-17T18:15:29.760 INFO:tasks.rados.rados.0.smithi154.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2024-09-17T18:15:29.760 INFO:tasks.rados.rados.0.smithi154.stdout:10: finishing write tid 3 to smithi15432074-10 2024-09-17T18:15:29.760 INFO:tasks.rados.rados.0.smithi154.stdout:10: oid 10 updating version 0 to 7 2024-09-17T18:15:29.760 INFO:tasks.rados.rados.0.smithi154.stdout:10: oid 10 updating version 7 to 8 2024-09-17T18:15:29.760 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 10 v 8 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-09-17T18:15:29.760 INFO:tasks.rados.rados.0.smithi154.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2024-09-17T18:15:29.760 INFO:tasks.rados.rados.0.smithi154.stdout:12: finishing write tid 3 to smithi15432074-12 2024-09-17T18:15:29.761 INFO:tasks.rados.rados.0.smithi154.stdout:12: oid 12 updating version 0 to 9 2024-09-17T18:15:29.761 INFO:tasks.rados.rados.0.smithi154.stdout:12: oid 12 updating version 9 to 10 2024-09-17T18:15:29.761 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 12 v 10 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-09-17T18:15:29.761 INFO:tasks.rados.rados.0.smithi154.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2024-09-17T18:15:29.761 INFO:tasks.rados.rados.0.smithi154.stdout:17: finishing write tid 3 to smithi15432074-17 2024-09-17T18:15:29.761 INFO:tasks.rados.rados.0.smithi154.stdout:17: oid 17 updating version 0 to 6 2024-09-17T18:15:29.761 INFO:tasks.rados.rados.0.smithi154.stdout:17: oid 17 version 6 is already newer than 5 2024-09-17T18:15:29.761 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 17 v 6 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-09-17T18:15:29.761 INFO:tasks.rados.rados.0.smithi154.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2024-09-17T18:15:29.761 INFO:tasks.rados.rados.0.smithi154.stdout:26: finishing write tid 1 to smithi15432074-26 2024-09-17T18:15:29.761 INFO:tasks.rados.rados.0.smithi154.stdout:21: finishing write tid 1 to smithi15432074-21 2024-09-17T18:15:29.761 INFO:tasks.rados.rados.0.smithi154.stdout:21: finishing write tid 2 to smithi15432074-21 2024-09-17T18:15:29.761 INFO:tasks.rados.rados.0.smithi154.stdout:26: finishing write tid 2 to smithi15432074-26 2024-09-17T18:15:29.761 INFO:tasks.rados.rados.0.smithi154.stdout:27: finishing write tid 1 to smithi15432074-27 2024-09-17T18:15:29.762 INFO:tasks.rados.rados.0.smithi154.stdout:10: done (10 left) 2024-09-17T18:15:29.762 INFO:tasks.rados.rados.0.smithi154.stdout:12: done (9 left) 2024-09-17T18:15:29.762 INFO:tasks.rados.rados.0.smithi154.stdout:17: done (8 left) 2024-09-17T18:15:29.762 INFO:tasks.rados.rados.0.smithi154.stdout:25: done (7 left) 2024-09-17T18:15:29.762 INFO:tasks.rados.rados.0.smithi154.stdout:30: write initial oid 30 2024-09-17T18:15:29.762 INFO:tasks.rados.rados.0.smithi154.stdout:30: seq_num 29 ranges {0=491520} 2024-09-17T18:15:29.764 INFO:tasks.rados.rados.0.smithi154.stdout:30: writing smithi15432074-30 from 0 to 491520 tid 1 2024-09-17T18:15:29.764 INFO:tasks.rados.rados.0.smithi154.stdout:31: write initial oid 31 2024-09-17T18:15:29.764 INFO:tasks.rados.rados.0.smithi154.stdout:31: seq_num 30 ranges {0=507904} 2024-09-17T18:15:29.768 INFO:tasks.rados.rados.0.smithi154.stdout:31: writing smithi15432074-31 from 0 to 507904 tid 1 2024-09-17T18:15:29.768 INFO:tasks.rados.rados.0.smithi154.stdout:32: write initial oid 32 2024-09-17T18:15:29.768 INFO:tasks.rados.rados.0.smithi154.stdout:32: seq_num 31 ranges {0=524288} 2024-09-17T18:15:29.771 INFO:tasks.rados.rados.0.smithi154.stdout:32: writing smithi15432074-32 from 0 to 524288 tid 1 2024-09-17T18:15:29.771 INFO:tasks.rados.rados.0.smithi154.stdout:33: write initial oid 33 2024-09-17T18:15:29.771 INFO:tasks.rados.rados.0.smithi154.stdout:33: seq_num 32 ranges {0=540672} 2024-09-17T18:15:29.775 INFO:tasks.rados.rados.0.smithi154.stdout:33: writing smithi15432074-33 from 0 to 540672 tid 1 2024-09-17T18:15:29.775 INFO:tasks.rados.rados.0.smithi154.stdout:34: write initial oid 34 2024-09-17T18:15:29.775 INFO:tasks.rados.rados.0.smithi154.stdout:34: seq_num 33 ranges {0=557056} 2024-09-17T18:15:29.778 INFO:tasks.rados.rados.0.smithi154.stdout:34: writing smithi15432074-34 from 0 to 557056 tid 1 2024-09-17T18:15:29.778 INFO:tasks.rados.rados.0.smithi154.stdout:35: write initial oid 35 2024-09-17T18:15:29.778 INFO:tasks.rados.rados.0.smithi154.stdout:27: finishing write tid 2 to smithi15432074-27 2024-09-17T18:15:29.779 INFO:tasks.rados.rados.0.smithi154.stdout:35: seq_num 34 ranges {0=573440} 2024-09-17T18:15:29.782 INFO:tasks.rados.rados.0.smithi154.stdout:35: writing smithi15432074-35 from 0 to 573440 tid 1 2024-09-17T18:15:29.782 INFO:tasks.rados.rados.0.smithi154.stdout:36: write initial oid 36 2024-09-17T18:15:29.782 INFO:tasks.rados.rados.0.smithi154.stdout:36: seq_num 35 ranges {0=589824} 2024-09-17T18:15:29.786 INFO:tasks.rados.rados.0.smithi154.stdout:36: writing smithi15432074-36 from 0 to 589824 tid 1 2024-09-17T18:15:29.786 INFO:tasks.rados.rados.0.smithi154.stdout:37: write initial oid 37 2024-09-17T18:15:29.786 INFO:tasks.rados.rados.0.smithi154.stdout:37: seq_num 36 ranges {0=606208} 2024-09-17T18:15:29.790 INFO:tasks.rados.rados.0.smithi154.stdout:37: writing smithi15432074-37 from 0 to 606208 tid 1 2024-09-17T18:15:29.790 INFO:tasks.rados.rados.0.smithi154.stdout:38: write initial oid 38 2024-09-17T18:15:29.790 INFO:tasks.rados.rados.0.smithi154.stdout:38: seq_num 37 ranges {0=622592} 2024-09-17T18:15:29.794 INFO:tasks.rados.rados.0.smithi154.stdout:38: writing smithi15432074-38 from 0 to 622592 tid 1 2024-09-17T18:15:29.795 INFO:tasks.rados.rados.0.smithi154.stdout: waiting on 16 2024-09-17T18:15:29.795 INFO:tasks.rados.rados.0.smithi154.stdout:26: finishing write tid 3 to smithi15432074-26 2024-09-17T18:15:29.795 INFO:tasks.rados.rados.0.smithi154.stdout:26: oid 26 updating version 0 to 2 2024-09-17T18:15:29.795 INFO:tasks.rados.rados.0.smithi154.stdout:26: oid 26 version 2 is already newer than 1 2024-09-17T18:15:29.795 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 26 v 2 (ObjNum 25 snap 0 seq_num 25) dirty exists 2024-09-17T18:15:29.795 INFO:tasks.rados.rados.0.smithi154.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2024-09-17T18:15:29.795 INFO:tasks.rados.rados.0.smithi154.stdout:27: finishing write tid 3 to smithi15432074-27 2024-09-17T18:15:29.795 INFO:tasks.rados.rados.0.smithi154.stdout:27: oid 27 updating version 0 to 2 2024-09-17T18:15:29.796 INFO:tasks.rados.rados.0.smithi154.stdout:27: oid 27 version 2 is already newer than 1 2024-09-17T18:15:29.796 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 27 v 2 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-09-17T18:15:29.796 INFO:tasks.rados.rados.0.smithi154.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2024-09-17T18:15:29.796 INFO:tasks.rados.rados.0.smithi154.stdout:21: finishing write tid 3 to smithi15432074-21 2024-09-17T18:15:29.796 INFO:tasks.rados.rados.0.smithi154.stdout:21: oid 21 updating version 0 to 8 2024-09-17T18:15:29.796 INFO:tasks.rados.rados.0.smithi154.stdout:21: oid 21 version 8 is already newer than 7 2024-09-17T18:15:29.796 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 21 v 8 (ObjNum 20 snap 0 seq_num 20) dirty exists 2024-09-17T18:15:29.796 INFO:tasks.rados.rados.0.smithi154.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2024-09-17T18:15:29.796 INFO:tasks.rados.rados.0.smithi154.stdout:18: finishing write tid 1 to smithi15432074-18 2024-09-17T18:15:29.796 INFO:tasks.rados.rados.0.smithi154.stdout:18: finishing write tid 2 to smithi15432074-18 2024-09-17T18:15:29.796 INFO:tasks.rados.rados.0.smithi154.stdout:21: done (15 left) 2024-09-17T18:15:29.797 INFO:tasks.rados.rados.0.smithi154.stdout:26: done (14 left) 2024-09-17T18:15:29.797 INFO:tasks.rados.rados.0.smithi154.stdout:27: done (13 left) 2024-09-17T18:15:29.797 INFO:tasks.rados.rados.0.smithi154.stdout:39: write initial oid 39 2024-09-17T18:15:29.797 INFO:tasks.rados.rados.0.smithi154.stdout:39: seq_num 38 ranges {0=638976} 2024-09-17T18:15:29.798 INFO:tasks.rados.rados.0.smithi154.stdout:39: writing smithi15432074-39 from 0 to 638976 tid 1 2024-09-17T18:15:29.798 INFO:tasks.rados.rados.0.smithi154.stdout:40: write initial oid 40 2024-09-17T18:15:29.798 INFO:tasks.rados.rados.0.smithi154.stdout:40: seq_num 39 ranges {0=671744} 2024-09-17T18:15:29.802 INFO:tasks.rados.rados.0.smithi154.stdout:40: writing smithi15432074-40 from 0 to 671744 tid 1 2024-09-17T18:15:29.803 INFO:tasks.rados.rados.0.smithi154.stdout:41: write initial oid 41 2024-09-17T18:15:29.803 INFO:tasks.rados.rados.0.smithi154.stdout:41: seq_num 40 ranges {0=688128} 2024-09-17T18:15:29.808 INFO:tasks.rados.rados.0.smithi154.stdout:41: writing smithi15432074-41 from 0 to 688128 tid 1 2024-09-17T18:15:29.808 INFO:tasks.rados.rados.0.smithi154.stdout: waiting on 16 2024-09-17T18:15:29.808 INFO:tasks.rados.rados.0.smithi154.stdout:28: finishing write tid 1 to smithi15432074-28 2024-09-17T18:15:29.808 INFO:tasks.rados.rados.0.smithi154.stdout:28: finishing write tid 2 to smithi15432074-28 2024-09-17T18:15:29.808 INFO:tasks.rados.rados.0.smithi154.stdout:18: finishing write tid 3 to smithi15432074-18 2024-09-17T18:15:29.808 INFO:tasks.rados.rados.0.smithi154.stdout:18: oid 18 updating version 0 to 12 2024-09-17T18:15:29.808 INFO:tasks.rados.rados.0.smithi154.stdout:18: oid 18 version 12 is already newer than 11 2024-09-17T18:15:29.808 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 18 v 12 (ObjNum 17 snap 0 seq_num 17) dirty exists 2024-09-17T18:15:29.809 INFO:tasks.rados.rados.0.smithi154.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2024-09-17T18:15:29.809 INFO:tasks.rados.rados.0.smithi154.stdout:22: finishing write tid 1 to smithi15432074-22 2024-09-17T18:15:29.809 INFO:tasks.rados.rados.0.smithi154.stdout:18: done (15 left) 2024-09-17T18:15:29.809 INFO:tasks.rados.rados.0.smithi154.stdout:42: write initial oid 42 2024-09-17T18:15:29.809 INFO:tasks.rados.rados.0.smithi154.stdout:42: seq_num 41 ranges {0=704512} 2024-09-17T18:15:29.812 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:29.811+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:29.812 INFO:tasks.rados.rados.0.smithi154.stdout:42: writing smithi15432074-42 from 0 to 704512 tid 1 2024-09-17T18:15:29.812 INFO:tasks.rados.rados.0.smithi154.stdout: waiting on 16 2024-09-17T18:15:29.813 INFO:tasks.rados.rados.0.smithi154.stdout:29: finishing write tid 1 to smithi15432074-29 2024-09-17T18:15:29.813 INFO:tasks.rados.rados.0.smithi154.stdout:29: finishing write tid 2 to smithi15432074-29 2024-09-17T18:15:29.813 INFO:tasks.rados.rados.0.smithi154.stdout:29: finishing write tid 3 to smithi15432074-29 2024-09-17T18:15:29.813 INFO:tasks.rados.rados.0.smithi154.stdout:29: oid 29 updating version 0 to 1 2024-09-17T18:15:29.813 INFO:tasks.rados.rados.0.smithi154.stdout:29: oid 29 updating version 1 to 2 2024-09-17T18:15:29.813 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 29 v 2 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-09-17T18:15:29.813 INFO:tasks.rados.rados.0.smithi154.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2024-09-17T18:15:29.813 INFO:tasks.rados.rados.0.smithi154.stdout:28: finishing write tid 3 to smithi15432074-28 2024-09-17T18:15:29.813 INFO:tasks.rados.rados.0.smithi154.stdout:28: oid 28 updating version 0 to 3 2024-09-17T18:15:29.814 INFO:tasks.rados.rados.0.smithi154.stdout:28: oid 28 updating version 3 to 4 2024-09-17T18:15:29.814 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 28 v 4 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-09-17T18:15:29.814 INFO:tasks.rados.rados.0.smithi154.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2024-09-17T18:15:29.814 INFO:tasks.rados.rados.0.smithi154.stdout:30: finishing write tid 1 to smithi15432074-30 2024-09-17T18:15:29.814 INFO:tasks.rados.rados.0.smithi154.stdout:30: finishing write tid 2 to smithi15432074-30 2024-09-17T18:15:29.814 INFO:tasks.rados.rados.0.smithi154.stdout:30: finishing write tid 3 to smithi15432074-30 2024-09-17T18:15:29.814 INFO:tasks.rados.rados.0.smithi154.stdout:30: oid 30 updating version 0 to 6 2024-09-17T18:15:29.814 INFO:tasks.rados.rados.0.smithi154.stdout:30: oid 30 version 6 is already newer than 5 2024-09-17T18:15:29.814 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 30 v 6 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-09-17T18:15:29.814 INFO:tasks.rados.rados.0.smithi154.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2024-09-17T18:15:29.814 INFO:tasks.rados.rados.0.smithi154.stdout:22: finishing write tid 2 to smithi15432074-22 2024-09-17T18:15:29.814 INFO:tasks.rados.rados.0.smithi154.stdout:31: finishing write tid 1 to smithi15432074-31 2024-09-17T18:15:29.814 INFO:tasks.rados.rados.0.smithi154.stdout:22: finishing write tid 3 to smithi15432074-22 2024-09-17T18:15:29.815 INFO:tasks.rados.rados.0.smithi154.stdout:22: oid 22 updating version 0 to 14 2024-09-17T18:15:29.815 INFO:tasks.rados.rados.0.smithi154.stdout:22: oid 22 version 14 is already newer than 13 2024-09-17T18:15:29.815 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 22 v 14 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-09-17T18:15:29.815 INFO:tasks.rados.rados.0.smithi154.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2024-09-17T18:15:29.815 INFO:tasks.rados.rados.0.smithi154.stdout:22: done (15 left) 2024-09-17T18:15:29.815 INFO:tasks.rados.rados.0.smithi154.stdout:28: done (14 left) 2024-09-17T18:15:29.815 INFO:tasks.rados.rados.0.smithi154.stdout:29: done (13 left) 2024-09-17T18:15:29.815 INFO:tasks.rados.rados.0.smithi154.stdout:30: done (12 left) 2024-09-17T18:15:29.815 INFO:tasks.rados.rados.0.smithi154.stdout:43: write initial oid 43 2024-09-17T18:15:29.816 INFO:tasks.rados.rados.0.smithi154.stdout:43: seq_num 42 ranges {0=720896} 2024-09-17T18:15:29.816 INFO:tasks.rados.rados.0.smithi154.stdout:43: writing smithi15432074-43 from 0 to 720896 tid 1 2024-09-17T18:15:29.816 INFO:tasks.rados.rados.0.smithi154.stdout:44: write initial oid 44 2024-09-17T18:15:29.817 INFO:tasks.rados.rados.0.smithi154.stdout:44: seq_num 43 ranges {0=737280} 2024-09-17T18:15:29.823 INFO:tasks.rados.rados.0.smithi154.stdout:44: writing smithi15432074-44 from 0 to 737280 tid 1 2024-09-17T18:15:29.823 INFO:tasks.rados.rados.0.smithi154.stdout:32: finishing write tid 1 to smithi15432074-32 2024-09-17T18:15:29.823 INFO:tasks.rados.rados.0.smithi154.stdout:31: finishing write tid 2 to smithi15432074-31 2024-09-17T18:15:29.823 INFO:tasks.rados.rados.0.smithi154.stdout:32: finishing write tid 2 to smithi15432074-32 2024-09-17T18:15:29.823 INFO:tasks.rados.rados.0.smithi154.stdout:32: finishing write tid 3 to smithi15432074-32 2024-09-17T18:15:29.823 INFO:tasks.rados.rados.0.smithi154.stdout:32: oid 32 updating version 0 to 3 2024-09-17T18:15:29.823 INFO:tasks.rados.rados.0.smithi154.stdout:32: oid 32 updating version 3 to 4 2024-09-17T18:15:29.823 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 32 v 4 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-09-17T18:15:29.823 INFO:tasks.rados.rados.0.smithi154.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2024-09-17T18:15:29.823 INFO:tasks.rados.rados.0.smithi154.stdout:31: finishing write tid 3 to smithi15432074-31 2024-09-17T18:15:29.823 INFO:tasks.rados.rados.0.smithi154.stdout:31: oid 31 updating version 0 to 4 2024-09-17T18:15:29.824 INFO:tasks.rados.rados.0.smithi154.stdout:31: oid 31 version 4 is already newer than 3 2024-09-17T18:15:29.824 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 31 v 4 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-09-17T18:15:29.824 INFO:tasks.rados.rados.0.smithi154.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2024-09-17T18:15:29.824 INFO:tasks.rados.rados.0.smithi154.stdout:34: finishing write tid 1 to smithi15432074-34 2024-09-17T18:15:29.824 INFO:tasks.rados.rados.0.smithi154.stdout:33: finishing write tid 1 to smithi15432074-33 2024-09-17T18:15:29.824 INFO:tasks.rados.rados.0.smithi154.stdout:33: finishing write tid 2 to smithi15432074-33 2024-09-17T18:15:29.824 INFO:tasks.rados.rados.0.smithi154.stdout:33: finishing write tid 3 to smithi15432074-33 2024-09-17T18:15:29.824 INFO:tasks.rados.rados.0.smithi154.stdout:33: oid 33 updating version 0 to 8 2024-09-17T18:15:29.824 INFO:tasks.rados.rados.0.smithi154.stdout:33: oid 33 version 8 is already newer than 7 2024-09-17T18:15:29.824 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 33 v 8 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-09-17T18:15:29.824 INFO:tasks.rados.rados.0.smithi154.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2024-09-17T18:15:29.824 INFO:tasks.rados.rados.0.smithi154.stdout:34: finishing write tid 2 to smithi15432074-34 2024-09-17T18:15:29.824 INFO:tasks.rados.rados.0.smithi154.stdout:34: finishing write tid 3 to smithi15432074-34 2024-09-17T18:15:29.825 INFO:tasks.rados.rados.0.smithi154.stdout:34: oid 34 updating version 0 to 8 2024-09-17T18:15:29.825 INFO:tasks.rados.rados.0.smithi154.stdout:34: oid 34 version 8 is already newer than 7 2024-09-17T18:15:29.825 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 34 v 8 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-09-17T18:15:29.825 INFO:tasks.rados.rados.0.smithi154.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2024-09-17T18:15:29.825 INFO:tasks.rados.rados.0.smithi154.stdout:35: finishing write tid 1 to smithi15432074-35 2024-09-17T18:15:29.825 INFO:tasks.rados.rados.0.smithi154.stdout:35: finishing write tid 2 to smithi15432074-35 2024-09-17T18:15:29.825 INFO:tasks.rados.rados.0.smithi154.stdout:35: finishing write tid 3 to smithi15432074-35 2024-09-17T18:15:29.825 INFO:tasks.rados.rados.0.smithi154.stdout:35: oid 35 updating version 0 to 5 2024-09-17T18:15:29.825 INFO:tasks.rados.rados.0.smithi154.stdout:35: oid 35 updating version 5 to 6 2024-09-17T18:15:29.825 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 35 v 6 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-09-17T18:15:29.825 INFO:tasks.rados.rados.0.smithi154.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2024-09-17T18:15:29.825 INFO:tasks.rados.rados.0.smithi154.stdout:36: finishing write tid 1 to smithi15432074-36 2024-09-17T18:15:29.825 INFO:tasks.rados.rados.0.smithi154.stdout:36: finishing write tid 2 to smithi15432074-36 2024-09-17T18:15:29.826 INFO:tasks.rados.rados.0.smithi154.stdout:37: finishing write tid 1 to smithi15432074-37 2024-09-17T18:15:29.826 INFO:tasks.rados.rados.0.smithi154.stdout:37: finishing write tid 2 to smithi15432074-37 2024-09-17T18:15:29.826 INFO:tasks.rados.rados.0.smithi154.stdout:36: finishing write tid 3 to smithi15432074-36 2024-09-17T18:15:29.826 INFO:tasks.rados.rados.0.smithi154.stdout:36: oid 36 updating version 0 to 7 2024-09-17T18:15:29.826 INFO:tasks.rados.rados.0.smithi154.stdout:36: oid 36 updating version 7 to 8 2024-09-17T18:15:29.826 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 36 v 8 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-09-17T18:15:29.826 INFO:tasks.rados.rados.0.smithi154.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2024-09-17T18:15:29.826 INFO:tasks.rados.rados.0.smithi154.stdout:37: finishing write tid 3 to smithi15432074-37 2024-09-17T18:15:29.826 INFO:tasks.rados.rados.0.smithi154.stdout:37: oid 37 updating version 0 to 15 2024-09-17T18:15:29.826 INFO:tasks.rados.rados.0.smithi154.stdout:37: oid 37 updating version 15 to 16 2024-09-17T18:15:29.826 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 37 v 16 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-09-17T18:15:29.826 INFO:tasks.rados.rados.0.smithi154.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2024-09-17T18:15:29.826 INFO:tasks.rados.rados.0.smithi154.stdout:38: finishing write tid 1 to smithi15432074-38 2024-09-17T18:15:29.827 INFO:tasks.rados.rados.0.smithi154.stdout:40: finishing write tid 1 to smithi15432074-40 2024-09-17T18:15:29.827 INFO:tasks.rados.rados.0.smithi154.stdout:39: finishing write tid 1 to smithi15432074-39 2024-09-17T18:15:29.827 INFO:tasks.rados.rados.0.smithi154.stdout:39: finishing write tid 2 to smithi15432074-39 2024-09-17T18:15:29.827 INFO:tasks.rados.rados.0.smithi154.stdout:38: finishing write tid 2 to smithi15432074-38 2024-09-17T18:15:29.827 INFO:tasks.rados.rados.0.smithi154.stdout:40: finishing write tid 2 to smithi15432074-40 2024-09-17T18:15:29.827 INFO:tasks.rados.rados.0.smithi154.stdout:39: finishing write tid 3 to smithi15432074-39 2024-09-17T18:15:29.827 INFO:tasks.rados.rados.0.smithi154.stdout:39: oid 39 updating version 0 to 10 2024-09-17T18:15:29.827 INFO:tasks.rados.rados.0.smithi154.stdout:39: oid 39 version 10 is already newer than 9 2024-09-17T18:15:29.827 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 39 v 10 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-17T18:15:29.827 INFO:tasks.rados.rados.0.smithi154.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2024-09-17T18:15:29.827 INFO:tasks.rados.rados.0.smithi154.stdout:38: finishing write tid 3 to smithi15432074-38 2024-09-17T18:15:29.827 INFO:tasks.rados.rados.0.smithi154.stdout:38: oid 38 updating version 0 to 6 2024-09-17T18:15:29.827 INFO:tasks.rados.rados.0.smithi154.stdout:38: oid 38 version 6 is already newer than 5 2024-09-17T18:15:29.828 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 38 v 6 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-09-17T18:15:29.828 INFO:tasks.rados.rados.0.smithi154.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2024-09-17T18:15:29.828 INFO:tasks.rados.rados.0.smithi154.stdout:41: finishing write tid 1 to smithi15432074-41 2024-09-17T18:15:29.828 INFO:tasks.rados.rados.0.smithi154.stdout:40: finishing write tid 3 to smithi15432074-40 2024-09-17T18:15:29.828 INFO:tasks.rados.rados.0.smithi154.stdout:40: oid 40 updating version 0 to 3 2024-09-17T18:15:29.828 INFO:tasks.rados.rados.0.smithi154.stdout:40: oid 40 updating version 3 to 4 2024-09-17T18:15:29.828 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 40 v 4 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-09-17T18:15:29.828 INFO:tasks.rados.rados.0.smithi154.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2024-09-17T18:15:29.828 INFO:tasks.rados.rados.0.smithi154.stdout:41: finishing write tid 2 to smithi15432074-41 2024-09-17T18:15:29.828 INFO:tasks.rados.rados.0.smithi154.stdout:41: finishing write tid 3 to smithi15432074-41 2024-09-17T18:15:29.828 INFO:tasks.rados.rados.0.smithi154.stdout:41: oid 41 updating version 0 to 17 2024-09-17T18:15:29.828 INFO:tasks.rados.rados.0.smithi154.stdout:41: oid 41 updating version 17 to 18 2024-09-17T18:15:29.828 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 41 v 18 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-09-17T18:15:29.828 INFO:tasks.rados.rados.0.smithi154.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2024-09-17T18:15:29.829 INFO:tasks.rados.rados.0.smithi154.stdout:42: finishing write tid 1 to smithi15432074-42 2024-09-17T18:15:29.829 INFO:tasks.rados.rados.0.smithi154.stdout:42: finishing write tid 2 to smithi15432074-42 2024-09-17T18:15:29.829 INFO:tasks.rados.rados.0.smithi154.stdout:31: done (13 left) 2024-09-17T18:15:29.829 INFO:tasks.rados.rados.0.smithi154.stdout:32: done (12 left) 2024-09-17T18:15:29.829 INFO:tasks.rados.rados.0.smithi154.stdout:33: done (11 left) 2024-09-17T18:15:29.829 INFO:tasks.rados.rados.0.smithi154.stdout:34: done (10 left) 2024-09-17T18:15:29.829 INFO:tasks.rados.rados.0.smithi154.stdout:35: done (9 left) 2024-09-17T18:15:29.829 INFO:tasks.rados.rados.0.smithi154.stdout:36: done (8 left) 2024-09-17T18:15:29.829 INFO:tasks.rados.rados.0.smithi154.stdout:37: done (7 left) 2024-09-17T18:15:29.829 INFO:tasks.rados.rados.0.smithi154.stdout:38: done (6 left) 2024-09-17T18:15:29.829 INFO:tasks.rados.rados.0.smithi154.stdout:39: done (5 left) 2024-09-17T18:15:29.829 INFO:tasks.rados.rados.0.smithi154.stdout:40: done (4 left) 2024-09-17T18:15:29.829 INFO:tasks.rados.rados.0.smithi154.stdout:41: done (3 left) 2024-09-17T18:15:29.830 INFO:tasks.rados.rados.0.smithi154.stdout:45: write initial oid 45 2024-09-17T18:15:29.830 INFO:tasks.rados.rados.0.smithi154.stdout:45: seq_num 44 ranges {0=753664} 2024-09-17T18:15:29.830 INFO:tasks.rados.rados.0.smithi154.stdout:45: writing smithi15432074-45 from 0 to 753664 tid 1 2024-09-17T18:15:29.831 INFO:tasks.rados.rados.0.smithi154.stdout:46: write initial oid 46 2024-09-17T18:15:29.831 INFO:tasks.rados.rados.0.smithi154.stdout:46: seq_num 45 ranges {0=770048} 2024-09-17T18:15:29.831 INFO:tasks.rados.rados.0.smithi154.stdout:46: writing smithi15432074-46 from 0 to 770048 tid 1 2024-09-17T18:15:29.831 INFO:tasks.rados.rados.0.smithi154.stdout:47: write initial oid 47 2024-09-17T18:15:29.831 INFO:tasks.rados.rados.0.smithi154.stdout:47: seq_num 46 ranges {0=786432} 2024-09-17T18:15:29.835 INFO:tasks.rados.rados.0.smithi154.stdout:47: writing smithi15432074-47 from 0 to 786432 tid 1 2024-09-17T18:15:29.835 INFO:tasks.rados.rados.0.smithi154.stdout:48: write initial oid 48 2024-09-17T18:15:29.835 INFO:tasks.rados.rados.0.smithi154.stdout:48: seq_num 47 ranges {0=425984,425984=376832} 2024-09-17T18:15:29.837 INFO:tasks.rados.rados.0.smithi154.stdout:48: writing smithi15432074-48 from 0 to 425984 tid 1 2024-09-17T18:15:29.838 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:29.838 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:29.840 INFO:tasks.rados.rados.0.smithi154.stdout:48: writing smithi15432074-48 from 425984 to 802816 tid 2 2024-09-17T18:15:29.840 INFO:tasks.rados.rados.0.smithi154.stdout:49: write initial oid 49 2024-09-17T18:15:29.840 INFO:tasks.rados.rados.0.smithi154.stdout:49: seq_num 48 ranges {0=442368,442368=376832} 2024-09-17T18:15:29.842 INFO:tasks.rados.rados.0.smithi154.stdout:49: writing smithi15432074-49 from 0 to 442368 tid 1 2024-09-17T18:15:29.845 INFO:tasks.rados.rados.0.smithi154.stdout:49: writing smithi15432074-49 from 442368 to 819200 tid 2 2024-09-17T18:15:29.845 INFO:tasks.rados.rados.0.smithi154.stdout:50: write initial oid 50 2024-09-17T18:15:29.845 INFO:tasks.rados.rados.0.smithi154.stdout:50: seq_num 49 ranges {0=458752,458752=376832} 2024-09-17T18:15:29.848 INFO:tasks.rados.rados.0.smithi154.stdout:50: writing smithi15432074-50 from 0 to 458752 tid 1 2024-09-17T18:15:29.850 INFO:tasks.rados.rados.0.smithi154.stdout:50: writing smithi15432074-50 from 458752 to 835584 tid 2 2024-09-17T18:15:29.850 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 30 current snap is 0 2024-09-17T18:15:29.851 INFO:tasks.rados.rados.0.smithi154.stdout:51: seq_num 50 ranges {491520=475136,966656=376832} 2024-09-17T18:15:29.856 INFO:tasks.rados.rados.0.smithi154.stdout:51: writing smithi15432074-30 from 491520 to 966656 tid 1 2024-09-17T18:15:29.859 INFO:tasks.rados.rados.0.smithi154.stdout:51: writing smithi15432074-30 from 966656 to 1343488 tid 2 2024-09-17T18:15:29.859 INFO:tasks.rados.rados.0.smithi154.stdout:52: rmattr oid 12 current snap is 0 2024-09-17T18:15:29.859 INFO:tasks.rados.rados.0.smithi154.stdout:52: done (10 left) 2024-09-17T18:15:29.859 INFO:tasks.rados.rados.0.smithi154.stdout:53: rollback oid 36 current snap is 0 2024-09-17T18:15:29.859 INFO:tasks.rados.rados.0.smithi154.stdout:53: done (10 left) 2024-09-17T18:15:29.859 INFO:tasks.rados.rados.0.smithi154.stdout:54: rollback oid 12 current snap is 0 2024-09-17T18:15:29.859 INFO:tasks.rados.rados.0.smithi154.stdout:54: done (10 left) 2024-09-17T18:15:29.859 INFO:tasks.rados.rados.0.smithi154.stdout:55: delete oid 5 current snap is 0 2024-09-17T18:15:29.860 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T18:15:29.864 INFO:tasks.rados.rados.0.smithi154.stdout:43: finishing write tid 1 to smithi15432074-43 2024-09-17T18:15:29.864 INFO:tasks.rados.rados.0.smithi154.stdout:42: finishing write tid 3 to smithi15432074-42 2024-09-17T18:15:29.864 INFO:tasks.rados.rados.0.smithi154.stdout:42: oid 42 updating version 0 to 4 2024-09-17T18:15:29.864 INFO:tasks.rados.rados.0.smithi154.stdout:42: oid 42 version 4 is already newer than 3 2024-09-17T18:15:29.864 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 42 v 4 (ObjNum 41 snap 0 seq_num 41) dirty exists 2024-09-17T18:15:29.864 INFO:tasks.rados.rados.0.smithi154.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2024-09-17T18:15:29.864 INFO:tasks.rados.rados.0.smithi154.stdout:43: finishing write tid 2 to smithi15432074-43 2024-09-17T18:15:29.864 INFO:tasks.rados.rados.0.smithi154.stdout:43: finishing write tid 3 to smithi15432074-43 2024-09-17T18:15:29.864 INFO:tasks.rados.rados.0.smithi154.stdout:43: oid 43 updating version 0 to 4 2024-09-17T18:15:29.864 INFO:tasks.rados.rados.0.smithi154.stdout:43: oid 43 version 4 is already newer than 3 2024-09-17T18:15:29.864 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 43 v 4 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-09-17T18:15:29.865 INFO:tasks.rados.rados.0.smithi154.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2024-09-17T18:15:29.865 INFO:tasks.rados.rados.0.smithi154.stdout:44: finishing write tid 1 to smithi15432074-44 2024-09-17T18:15:29.865 INFO:tasks.rados.rados.0.smithi154.stdout:44: finishing write tid 2 to smithi15432074-44 2024-09-17T18:15:29.865 INFO:tasks.rados.rados.0.smithi154.stdout:45: finishing write tid 1 to smithi15432074-45 2024-09-17T18:15:29.865 INFO:tasks.rados.rados.0.smithi154.stdout:45: finishing write tid 2 to smithi15432074-45 2024-09-17T18:15:29.865 INFO:tasks.rados.rados.0.smithi154.stdout:44: finishing write tid 3 to smithi15432074-44 2024-09-17T18:15:29.865 INFO:tasks.rados.rados.0.smithi154.stdout:44: oid 44 updating version 0 to 5 2024-09-17T18:15:29.865 INFO:tasks.rados.rados.0.smithi154.stdout:44: oid 44 updating version 5 to 6 2024-09-17T18:15:29.865 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 44 v 6 (ObjNum 43 snap 0 seq_num 43) dirty exists 2024-09-17T18:15:29.865 INFO:tasks.rados.rados.0.smithi154.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2024-09-17T18:15:29.865 INFO:tasks.rados.rados.0.smithi154.stdout:45: finishing write tid 3 to smithi15432074-45 2024-09-17T18:15:29.865 INFO:tasks.rados.rados.0.smithi154.stdout:45: oid 45 updating version 0 to 8 2024-09-17T18:15:29.865 INFO:tasks.rados.rados.0.smithi154.stdout:45: oid 45 version 8 is already newer than 7 2024-09-17T18:15:29.865 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 45 v 8 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-09-17T18:15:29.866 INFO:tasks.rados.rados.0.smithi154.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2024-09-17T18:15:29.866 INFO:tasks.rados.rados.0.smithi154.stdout:46: finishing write tid 1 to smithi15432074-46 2024-09-17T18:15:29.866 INFO:tasks.rados.rados.0.smithi154.stdout:46: finishing write tid 2 to smithi15432074-46 2024-09-17T18:15:29.866 INFO:tasks.rados.rados.0.smithi154.stdout:46: finishing write tid 3 to smithi15432074-46 2024-09-17T18:15:29.866 INFO:tasks.rados.rados.0.smithi154.stdout:46: oid 46 updating version 0 to 9 2024-09-17T18:15:29.866 INFO:tasks.rados.rados.0.smithi154.stdout:46: oid 46 updating version 9 to 10 2024-09-17T18:15:29.866 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 46 v 10 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-17T18:15:29.866 INFO:tasks.rados.rados.0.smithi154.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2024-09-17T18:15:29.866 INFO:tasks.rados.rados.0.smithi154.stdout:47: finishing write tid 1 to smithi15432074-47 2024-09-17T18:15:29.866 INFO:tasks.rados.rados.0.smithi154.stdout:47: finishing write tid 2 to smithi15432074-47 2024-09-17T18:15:29.866 INFO:tasks.rados.rados.0.smithi154.stdout:48: finishing write tid 1 to smithi15432074-48 2024-09-17T18:15:29.866 INFO:tasks.rados.rados.0.smithi154.stdout:47: finishing write tid 3 to smithi15432074-47 2024-09-17T18:15:29.866 INFO:tasks.rados.rados.0.smithi154.stdout:47: oid 47 updating version 0 to 5 2024-09-17T18:15:29.867 INFO:tasks.rados.rados.0.smithi154.stdout:47: oid 47 updating version 5 to 6 2024-09-17T18:15:29.867 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 47 v 6 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-17T18:15:29.867 INFO:tasks.rados.rados.0.smithi154.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2024-09-17T18:15:29.867 INFO:tasks.rados.rados.0.smithi154.stdout:48: finishing write tid 2 to smithi15432074-48 2024-09-17T18:15:29.867 INFO:tasks.rados.rados.0.smithi154.stdout:48: finishing write tid 3 to smithi15432074-48 2024-09-17T18:15:29.867 INFO:tasks.rados.rados.0.smithi154.stdout:48: finishing write tid 4 to smithi15432074-48 2024-09-17T18:15:29.867 INFO:tasks.rados.rados.0.smithi154.stdout:48: oid 48 updating version 0 to 9 2024-09-17T18:15:29.867 INFO:tasks.rados.rados.0.smithi154.stdout:48: oid 48 updating version 9 to 11 2024-09-17T18:15:29.867 INFO:tasks.rados.rados.0.smithi154.stdout:48: oid 48 version 11 is already newer than 10 2024-09-17T18:15:29.867 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 48 v 11 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-09-17T18:15:29.867 INFO:tasks.rados.rados.0.smithi154.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2024-09-17T18:15:29.867 INFO:tasks.rados.rados.0.smithi154.stdout:49: finishing write tid 1 to smithi15432074-49 2024-09-17T18:15:29.867 INFO:tasks.rados.rados.0.smithi154.stdout:50: finishing write tid 1 to smithi15432074-50 2024-09-17T18:15:29.867 INFO:tasks.rados.rados.0.smithi154.stdout:49: finishing write tid 2 to smithi15432074-49 2024-09-17T18:15:29.868 INFO:tasks.rados.rados.0.smithi154.stdout:49: finishing write tid 3 to smithi15432074-49 2024-09-17T18:15:29.868 INFO:tasks.rados.rados.0.smithi154.stdout:50: finishing write tid 2 to smithi15432074-50 2024-09-17T18:15:29.868 INFO:tasks.rados.rados.0.smithi154.stdout:50: finishing write tid 3 to smithi15432074-50 2024-09-17T18:15:29.868 INFO:tasks.rados.rados.0.smithi154.stdout:50: finishing write tid 4 to smithi15432074-50 2024-09-17T18:15:29.868 INFO:tasks.rados.rados.0.smithi154.stdout:50: oid 50 updating version 0 to 3 2024-09-17T18:15:29.868 INFO:tasks.rados.rados.0.smithi154.stdout:50: oid 50 updating version 3 to 5 2024-09-17T18:15:29.868 INFO:tasks.rados.rados.0.smithi154.stdout:50: oid 50 version 5 is already newer than 4 2024-09-17T18:15:29.868 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 50 v 5 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-09-17T18:15:29.868 INFO:tasks.rados.rados.0.smithi154.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2024-09-17T18:15:29.869 INFO:tasks.rados.rados.0.smithi154.stdout:49: finishing write tid 4 to smithi15432074-49 2024-09-17T18:15:29.869 INFO:tasks.rados.rados.0.smithi154.stdout:49: oid 49 updating version 0 to 6 2024-09-17T18:15:29.869 INFO:tasks.rados.rados.0.smithi154.stdout:49: oid 49 updating version 6 to 7 2024-09-17T18:15:29.869 INFO:tasks.rados.rados.0.smithi154.stdout:49: oid 49 version 7 is already newer than 5 2024-09-17T18:15:29.869 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 49 v 7 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-09-17T18:15:29.869 INFO:tasks.rados.rados.0.smithi154.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2024-09-17T18:15:29.869 INFO:tasks.rados.rados.0.smithi154.stdout:51: finishing write tid 1 to smithi15432074-30 2024-09-17T18:15:29.869 INFO:tasks.rados.rados.0.smithi154.stdout:42: done (10 left) 2024-09-17T18:15:29.869 INFO:tasks.rados.rados.0.smithi154.stdout:43: done (9 left) 2024-09-17T18:15:29.869 INFO:tasks.rados.rados.0.smithi154.stdout:44: done (8 left) 2024-09-17T18:15:29.869 INFO:tasks.rados.rados.0.smithi154.stdout:45: done (7 left) 2024-09-17T18:15:29.869 INFO:tasks.rados.rados.0.smithi154.stdout:46: done (6 left) 2024-09-17T18:15:29.869 INFO:tasks.rados.rados.0.smithi154.stdout:47: done (5 left) 2024-09-17T18:15:29.870 INFO:tasks.rados.rados.0.smithi154.stdout:48: done (4 left) 2024-09-17T18:15:29.870 INFO:tasks.rados.rados.0.smithi154.stdout:49: done (3 left) 2024-09-17T18:15:29.870 INFO:tasks.rados.rados.0.smithi154.stdout:50: done (2 left) 2024-09-17T18:15:29.870 INFO:tasks.rados.rados.0.smithi154.stdout:55: done (1 left) 2024-09-17T18:15:29.870 INFO:tasks.rados.rados.0.smithi154.stdout:56: copy_from oid 19 from oid 4 current snap is 0 2024-09-17T18:15:29.870 INFO:tasks.rados.rados.0.smithi154.stdout:57: rmattr oid 7 current snap is 0 2024-09-17T18:15:29.870 INFO:tasks.rados.rados.0.smithi154.stdout:57: done (2 left) 2024-09-17T18:15:29.870 INFO:tasks.rados.rados.0.smithi154.stdout:58: rmattr oid 50 current snap is 0 2024-09-17T18:15:29.870 INFO:tasks.rados.rados.0.smithi154.stdout:58: done (2 left) 2024-09-17T18:15:29.870 INFO:tasks.rados.rados.0.smithi154.stdout:59: setattr oid 25 current snap is 0 2024-09-17T18:15:29.870 INFO:tasks.rados.rados.0.smithi154.stdout:60: rollback oid 5 current snap is 0 2024-09-17T18:15:29.870 INFO:tasks.rados.rados.0.smithi154.stdout:60: done (3 left) 2024-09-17T18:15:29.870 INFO:tasks.rados.rados.0.smithi154.stdout:61: read oid 9 snap -1 2024-09-17T18:15:29.870 INFO:tasks.rados.rados.0.smithi154.stdout:61: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-17T18:15:29.871 INFO:tasks.rados.rados.0.smithi154.stdout:62: read oid 35 snap -1 2024-09-17T18:15:29.871 INFO:tasks.rados.rados.0.smithi154.stdout:62: expect (ObjNum 34 snap 0 seq_num 34) 2024-09-17T18:15:29.871 INFO:tasks.rados.rados.0.smithi154.stdout:63: setattr oid 7 current snap is 0 2024-09-17T18:15:29.873 INFO:tasks.rados.rados.0.smithi154.stdout:51: finishing write tid 2 to smithi15432074-30 2024-09-17T18:15:29.873 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 39 current snap is 0 2024-09-17T18:15:29.873 INFO:tasks.rados.rados.0.smithi154.stdout:64: seq_num 52 ranges {638976=507904,1146880=376832} 2024-09-17T18:15:29.873 INFO:tasks.rados.rados.0.smithi154.stdout:64: writing smithi15432074-39 from 638976 to 1146880 tid 1 2024-09-17T18:15:29.874 INFO:tasks.rados.rados.0.smithi154.stdout:64: writing smithi15432074-39 from 1146880 to 1523712 tid 2 2024-09-17T18:15:29.875 INFO:tasks.rados.rados.0.smithi154.stdout:65: delete oid 3 current snap is 0 2024-09-17T18:15:29.875 INFO:tasks.rados.rados.0.smithi154.stdout:51: finishing write tid 3 to smithi15432074-30 2024-09-17T18:15:29.875 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 25 v 9 (ObjNum 24 snap 0 seq_num 24) dirty exists 2024-09-17T18:15:29.875 INFO:tasks.rados.rados.0.smithi154.stdout:56: finishing copy_from racing read to smithi15432074-19 2024-09-17T18:15:29.875 INFO:tasks.rados.rados.0.smithi154.stdout:51: finishing write tid 4 to smithi15432074-30 2024-09-17T18:15:29.875 INFO:tasks.rados.rados.0.smithi154.stdout:51: oid 30 updating version 0 to 12 2024-09-17T18:15:29.875 INFO:tasks.rados.rados.0.smithi154.stdout:51: oid 30 version 12 is already newer than 11 2024-09-17T18:15:29.875 INFO:tasks.rados.rados.0.smithi154.stdout:51: oid 30 updating version 12 to 13 2024-09-17T18:15:29.875 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 30 v 13 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-09-17T18:15:29.875 INFO:tasks.rados.rados.0.smithi154.stdout:51: left oid 30 (ObjNum 50 snap 0 seq_num 50) 2024-09-17T18:15:29.875 INFO:tasks.rados.rados.0.smithi154.stdout:61: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-17T18:15:29.875 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:29.876 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 17380 2024-09-17T18:15:29.878 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1306 2024-09-17T18:15:29.879 INFO:tasks.rados.rados.0.smithi154.stdout:62: expect (ObjNum 34 snap 0 seq_num 34) 2024-09-17T18:15:29.880 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:29.885 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 36588 2024-09-17T18:15:29.890 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:29.895 INFO:tasks.rados.rados.0.smithi154.stdout:56: finishing copy_from to smithi15432074-19 2024-09-17T18:15:29.895 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 19 v 2 (ObjNum 3 snap 0 seq_num 3) dirty exists 2024-09-17T18:15:29.895 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 7 v 14 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-09-17T18:15:29.895 INFO:tasks.rados.rados.0.smithi154.stdout:64: finishing write tid 1 to smithi15432074-39 2024-09-17T18:15:29.895 INFO:tasks.rados.rados.0.smithi154.stdout:64: finishing write tid 2 to smithi15432074-39 2024-09-17T18:15:29.895 INFO:tasks.rados.rados.0.smithi154.stdout:64: finishing write tid 3 to smithi15432074-39 2024-09-17T18:15:29.895 INFO:tasks.rados.rados.0.smithi154.stdout:64: finishing write tid 4 to smithi15432074-39 2024-09-17T18:15:29.896 INFO:tasks.rados.rados.0.smithi154.stdout:64: oid 39 updating version 0 to 13 2024-09-17T18:15:29.896 INFO:tasks.rados.rados.0.smithi154.stdout:64: oid 39 version 13 is already newer than 12 2024-09-17T18:15:29.896 INFO:tasks.rados.rados.0.smithi154.stdout:64: oid 39 version 13 is already newer than 11 2024-09-17T18:15:29.896 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 39 v 13 (ObjNum 52 snap 0 seq_num 52) dirty exists 2024-09-17T18:15:29.896 INFO:tasks.rados.rados.0.smithi154.stdout:64: left oid 39 (ObjNum 52 snap 0 seq_num 52) 2024-09-17T18:15:29.896 INFO:tasks.rados.rados.0.smithi154.stdout:51: done (7 left) 2024-09-17T18:15:29.896 INFO:tasks.rados.rados.0.smithi154.stdout:56: done (6 left) 2024-09-17T18:15:29.896 INFO:tasks.rados.rados.0.smithi154.stdout:59: done (5 left) 2024-09-17T18:15:29.896 INFO:tasks.rados.rados.0.smithi154.stdout:61: done (4 left) 2024-09-17T18:15:29.896 INFO:tasks.rados.rados.0.smithi154.stdout:62: done (3 left) 2024-09-17T18:15:29.896 INFO:tasks.rados.rados.0.smithi154.stdout:63: done (2 left) 2024-09-17T18:15:29.897 INFO:tasks.rados.rados.0.smithi154.stdout:64: done (1 left) 2024-09-17T18:15:29.897 INFO:tasks.rados.rados.0.smithi154.stdout:65: done (0 left) 2024-09-17T18:15:29.898 INFO:tasks.rados.rados.0.smithi154.stdout:66: rmattr oid 24 current snap is 0 2024-09-17T18:15:29.898 INFO:tasks.rados.rados.0.smithi154.stdout:66: done (0 left) 2024-09-17T18:15:29.898 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 12 current snap is 0 2024-09-17T18:15:29.898 INFO:tasks.rados.rados.0.smithi154.stdout:67: seq_num 54 ranges {196608=540672,737280=376832} 2024-09-17T18:15:29.898 INFO:tasks.rados.rados.0.smithi154.stdout:67: writing smithi15432074-12 from 196608 to 737280 tid 1 2024-09-17T18:15:29.901 INFO:tasks.rados.rados.0.smithi154.stdout:67: writing smithi15432074-12 from 737280 to 1114112 tid 2 2024-09-17T18:15:29.901 INFO:tasks.rados.rados.0.smithi154.stdout:68: read oid 23 snap -1 2024-09-17T18:15:29.901 INFO:tasks.rados.rados.0.smithi154.stdout:68: expect (ObjNum 22 snap 0 seq_num 22) 2024-09-17T18:15:29.901 INFO:tasks.rados.rados.0.smithi154.stdout:69: rmattr oid 45 current snap is 0 2024-09-17T18:15:29.901 INFO:tasks.rados.rados.0.smithi154.stdout:69: done (2 left) 2024-09-17T18:15:29.901 INFO:tasks.rados.rados.0.smithi154.stdout:70: copy_from oid 18 from oid 27 current snap is 0 2024-09-17T18:15:29.901 INFO:tasks.rados.rados.0.smithi154.stdout:71: snap_create 2024-09-17T18:15:29.907 INFO:tasks.rados.rados.0.smithi154.stdout:67: finishing write tid 1 to smithi15432074-12 2024-09-17T18:15:29.907 INFO:tasks.rados.rados.0.smithi154.stdout:68: expect (ObjNum 22 snap 0 seq_num 22) 2024-09-17T18:15:29.909 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 324983 2024-09-17T18:15:29.910 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:29.912 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:29.911+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:29.915 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 310785 2024-09-17T18:15:29.915 INFO:tasks.rados.rados.0.smithi154.stdout:67: finishing write tid 2 to smithi15432074-12 2024-09-17T18:15:29.915 INFO:tasks.rados.rados.0.smithi154.stdout:67: finishing write tid 3 to smithi15432074-12 2024-09-17T18:15:29.916 INFO:tasks.rados.rados.0.smithi154.stdout:67: finishing write tid 4 to smithi15432074-12 2024-09-17T18:15:29.916 INFO:tasks.rados.rados.0.smithi154.stdout:67: oid 12 updating version 0 to 19 2024-09-17T18:15:29.916 INFO:tasks.rados.rados.0.smithi154.stdout:67: oid 12 updating version 19 to 21 2024-09-17T18:15:29.916 INFO:tasks.rados.rados.0.smithi154.stdout:67: oid 12 version 21 is already newer than 20 2024-09-17T18:15:29.917 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 12 v 21 (ObjNum 54 snap 0 seq_num 54) dirty exists 2024-09-17T18:15:29.917 INFO:tasks.rados.rados.0.smithi154.stdout:67: left oid 12 (ObjNum 54 snap 0 seq_num 54) 2024-09-17T18:15:29.917 INFO:tasks.rados.rados.0.smithi154.stdout:70: finishing copy_from racing read to smithi15432074-18 2024-09-17T18:15:29.920 INFO:tasks.rados.rados.0.smithi154.stdout:70: finishing copy_from to smithi15432074-18 2024-09-17T18:15:29.920 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 18 v 2 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-09-17T18:15:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:29.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T18:15:30.016 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:30.008+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:30.114 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:30.107+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:30.160 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:30.160 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:30.174 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T18:15:30.215 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:30.212+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:30.290 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:30.290 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:30.304 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T18:15:30.316 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:30.312+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:30.417 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:30.413+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:30.427 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:30.427 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:30.441 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T18:15:30.520 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:30.519+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:30.605 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:30.606 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:30.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T18:15:30.621 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:30.617+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:30.680 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.0 to 1 (10000) 2024-09-17T18:15:30.680 INFO:teuthology.orchestra.run.smithi087.stderr:noscrub is unset 2024-09-17T18:15:30.685 INFO:tasks.rados.rados.0.smithi154.stdout:67: done (3 left) 2024-09-17T18:15:30.685 INFO:tasks.rados.rados.0.smithi154.stdout:68: done (2 left) 2024-09-17T18:15:30.686 INFO:tasks.rados.rados.0.smithi154.stdout:70: done (1 left) 2024-09-17T18:15:30.686 INFO:tasks.rados.rados.0.smithi154.stdout:71: done (0 left) 2024-09-17T18:15:30.686 INFO:tasks.rados.rados.0.smithi154.stdout:72: delete oid 46 current snap is 1 2024-09-17T18:15:30.696 INFO:tasks.rados.rados.0.smithi154.stdout:72: done (0 left) 2024-09-17T18:15:30.696 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 28 current snap is 1 2024-09-17T18:15:30.696 INFO:tasks.rados.rados.0.smithi154.stdout:73: seq_num 56 ranges {458752=573440,1032192=376832} 2024-09-17T18:15:30.703 INFO:tasks.rados.rados.0.smithi154.stdout:73: writing smithi15432074-28 from 458752 to 1032192 tid 1 2024-09-17T18:15:30.706 INFO:tasks.rados.rados.0.smithi154.stdout:73: writing smithi15432074-28 from 1032192 to 1409024 tid 2 2024-09-17T18:15:30.706 INFO:tasks.rados.rados.0.smithi154.stdout:74: copy_from oid 2 from oid 7 current snap is 1 2024-09-17T18:15:30.706 INFO:tasks.rados.rados.0.smithi154.stdout:75: rollback oid 22 current snap is 1 2024-09-17T18:15:30.706 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 22 to 0 2024-09-17T18:15:30.706 INFO:tasks.rados.rados.0.smithi154.stdout:76: copy_from oid 10 from oid 36 current snap is 1 2024-09-17T18:15:30.706 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 41 current snap is 1 2024-09-17T18:15:30.706 INFO:tasks.rados.rados.0.smithi154.stdout:77: seq_num 57 ranges {688128=589824,1277952=376832} 2024-09-17T18:15:30.710 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-17T18:15:30.715 INFO:tasks.rados.rados.0.smithi154.stdout:77: writing smithi15432074-41 from 688128 to 1277952 tid 1 2024-09-17T18:15:30.719 INFO:tasks.rados.rados.0.smithi154.stdout:77: writing smithi15432074-41 from 1277952 to 1654784 tid 2 2024-09-17T18:15:30.719 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 25 current snap is 1 2024-09-17T18:15:30.719 INFO:tasks.rados.rados.0.smithi154.stdout:78: seq_num 58 ranges {409600=606208,1015808=376832} 2024-09-17T18:15:30.722 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:30.717+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:30.726 INFO:tasks.rados.rados.0.smithi154.stdout:78: writing smithi15432074-25 from 409600 to 1015808 tid 1 2024-09-17T18:15:30.731 INFO:tasks.rados.rados.0.smithi154.stdout:78: writing smithi15432074-25 from 1015808 to 1392640 tid 2 2024-09-17T18:15:30.731 INFO:tasks.rados.rados.0.smithi154.stdout:73: finishing write tid 1 to smithi15432074-28 2024-09-17T18:15:30.731 INFO:tasks.rados.rados.0.smithi154.stdout:73: finishing write tid 2 to smithi15432074-28 2024-09-17T18:15:30.731 INFO:tasks.rados.rados.0.smithi154.stdout:73: finishing write tid 3 to smithi15432074-28 2024-09-17T18:15:30.731 INFO:tasks.rados.rados.0.smithi154.stdout:73: finishing write tid 4 to smithi15432074-28 2024-09-17T18:15:30.731 INFO:tasks.rados.rados.0.smithi154.stdout:73: oid 28 updating version 0 to 6 2024-09-17T18:15:30.731 INFO:tasks.rados.rados.0.smithi154.stdout:73: oid 28 updating version 6 to 8 2024-09-17T18:15:30.732 INFO:tasks.rados.rados.0.smithi154.stdout:73: oid 28 version 8 is already newer than 7 2024-09-17T18:15:30.732 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 28 v 8 (ObjNum 56 snap 1 seq_num 56) dirty exists 2024-09-17T18:15:30.732 INFO:tasks.rados.rados.0.smithi154.stdout:73: left oid 28 (ObjNum 56 snap 1 seq_num 56) 2024-09-17T18:15:30.732 INFO:tasks.rados.rados.0.smithi154.stdout:74: finishing copy_from racing read to smithi15432074-2 2024-09-17T18:15:30.732 INFO:tasks.rados.rados.0.smithi154.stdout:79: read oid 14 snap 0 2024-09-17T18:15:30.732 INFO:tasks.rados.rados.0.smithi154.stdout:79: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-17T18:15:30.732 INFO:tasks.rados.rados.0.smithi154.stdout:73: done (6 left) 2024-09-17T18:15:30.732 INFO:tasks.rados.rados.0.smithi154.stdout:80: rollback oid 43 current snap is 1 2024-09-17T18:15:30.732 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 43 to 0 2024-09-17T18:15:30.732 INFO:tasks.rados.rados.0.smithi154.stdout:75: finishing rollback tid 0 to smithi15432074-22 2024-09-17T18:15:30.732 INFO:tasks.rados.rados.0.smithi154.stdout:75: finishing rollback tid 1 to smithi15432074-22 2024-09-17T18:15:30.732 INFO:tasks.rados.rados.0.smithi154.stdout:75: finishing rollback tid 2 to smithi15432074-22 2024-09-17T18:15:30.733 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 22 v 26 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-09-17T18:15:30.733 INFO:tasks.rados.rados.0.smithi154.stdout:74: finishing copy_from to smithi15432074-2 2024-09-17T18:15:30.733 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 2 v 14 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-09-17T18:15:30.733 INFO:tasks.rados.rados.0.smithi154.stdout:74: done (6 left) 2024-09-17T18:15:30.733 INFO:tasks.rados.rados.0.smithi154.stdout:75: done (5 left) 2024-09-17T18:15:30.733 INFO:tasks.rados.rados.0.smithi154.stdout:81: rollback oid 40 current snap is 1 2024-09-17T18:15:30.733 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 40 to 0 2024-09-17T18:15:30.733 INFO:tasks.rados.rados.0.smithi154.stdout:82: snap_create 2024-09-17T18:15:30.742 INFO:tasks.rados.rados.0.smithi154.stdout:80: finishing rollback tid 0 to smithi15432074-43 2024-09-17T18:15:30.743 INFO:tasks.rados.rados.0.smithi154.stdout:80: finishing rollback tid 1 to smithi15432074-43 2024-09-17T18:15:30.743 INFO:tasks.rados.rados.0.smithi154.stdout:80: finishing rollback tid 2 to smithi15432074-43 2024-09-17T18:15:30.743 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 43 v 10 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-09-17T18:15:30.747 INFO:tasks.rados.rados.0.smithi154.stdout:78: finishing write tid 1 to smithi15432074-25 2024-09-17T18:15:30.748 INFO:tasks.rados.rados.0.smithi154.stdout:78: finishing write tid 2 to smithi15432074-25 2024-09-17T18:15:30.748 INFO:tasks.rados.rados.0.smithi154.stdout:78: finishing write tid 3 to smithi15432074-25 2024-09-17T18:15:30.749 INFO:tasks.rados.rados.0.smithi154.stdout:81: finishing rollback tid 0 to smithi15432074-40 2024-09-17T18:15:30.749 INFO:tasks.rados.rados.0.smithi154.stdout:81: finishing rollback tid 1 to smithi15432074-40 2024-09-17T18:15:30.749 INFO:tasks.rados.rados.0.smithi154.stdout:78: finishing write tid 4 to smithi15432074-25 2024-09-17T18:15:30.750 INFO:tasks.rados.rados.0.smithi154.stdout:78: oid 25 updating version 0 to 11 2024-09-17T18:15:30.750 INFO:tasks.rados.rados.0.smithi154.stdout:78: oid 25 updating version 11 to 12 2024-09-17T18:15:30.750 INFO:tasks.rados.rados.0.smithi154.stdout:78: oid 25 updating version 12 to 13 2024-09-17T18:15:30.750 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 25 v 13 (ObjNum 58 snap 1 seq_num 58) dirty exists 2024-09-17T18:15:30.750 INFO:tasks.rados.rados.0.smithi154.stdout:78: left oid 25 (ObjNum 58 snap 1 seq_num 58) 2024-09-17T18:15:30.750 INFO:tasks.rados.rados.0.smithi154.stdout:81: finishing rollback tid 2 to smithi15432074-40 2024-09-17T18:15:30.750 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 40 v 13 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-09-17T18:15:30.751 INFO:tasks.rados.rados.0.smithi154.stdout:76: finishing copy_from racing read to smithi15432074-10 2024-09-17T18:15:30.752 INFO:tasks.rados.rados.0.smithi154.stdout:77: finishing write tid 1 to smithi15432074-41 2024-09-17T18:15:30.753 INFO:tasks.rados.rados.0.smithi154.stdout:77: finishing write tid 2 to smithi15432074-41 2024-09-17T18:15:30.753 INFO:tasks.rados.rados.0.smithi154.stdout:79: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-17T18:15:30.754 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 206466 2024-09-17T18:15:30.754 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:30.756 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:30.756 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:30.757 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 58542 2024-09-17T18:15:30.758 INFO:tasks.rados.rados.0.smithi154.stdout:77: finishing write tid 3 to smithi15432074-41 2024-09-17T18:15:30.758 INFO:tasks.rados.rados.0.smithi154.stdout:76: finishing copy_from to smithi15432074-10 2024-09-17T18:15:30.759 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 10 v 8 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-09-17T18:15:30.759 INFO:tasks.rados.rados.0.smithi154.stdout:77: finishing write tid 4 to smithi15432074-41 2024-09-17T18:15:30.759 INFO:tasks.rados.rados.0.smithi154.stdout:77: oid 41 updating version 0 to 31 2024-09-17T18:15:30.759 INFO:tasks.rados.rados.0.smithi154.stdout:77: oid 41 version 31 is already newer than 30 2024-09-17T18:15:30.759 INFO:tasks.rados.rados.0.smithi154.stdout:77: oid 41 updating version 31 to 32 2024-09-17T18:15:30.759 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 41 v 32 (ObjNum 57 snap 1 seq_num 57) dirty exists 2024-09-17T18:15:30.759 INFO:tasks.rados.rados.0.smithi154.stdout:77: left oid 41 (ObjNum 57 snap 1 seq_num 57) 2024-09-17T18:15:30.771 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T18:15:30.825 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:30.823+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:30.925 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:30.920+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:30.941 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:30.941 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:30.953 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T18:15:31.026 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:31.019+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:31.074 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:31.074 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:31.087 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T18:15:31.127 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:31.123+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:31.204 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:31.205 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:31.218 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T18:15:31.228 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:31.225+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:31.330 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:31.327+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:31.338 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:31.338 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:31.352 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T18:15:31.431 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:31.429+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:31.475 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:31.475 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:31.489 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T18:15:31.532 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:31.531+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:31.607 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:31.608 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:31.621 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T18:15:31.633 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:31.628+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:31.694 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.1 to 1 (10000) 2024-09-17T18:15:31.701 INFO:tasks.rados.rados.0.smithi154.stdout:76: done (6 left) 2024-09-17T18:15:31.701 INFO:tasks.rados.rados.0.smithi154.stdout:77: done (5 left) 2024-09-17T18:15:31.701 INFO:tasks.rados.rados.0.smithi154.stdout:78: done (4 left) 2024-09-17T18:15:31.701 INFO:tasks.rados.rados.0.smithi154.stdout:79: done (3 left) 2024-09-17T18:15:31.701 INFO:tasks.rados.rados.0.smithi154.stdout:80: done (2 left) 2024-09-17T18:15:31.701 INFO:tasks.rados.rados.0.smithi154.stdout:81: done (1 left) 2024-09-17T18:15:31.702 INFO:tasks.rados.rados.0.smithi154.stdout:82: done (0 left) 2024-09-17T18:15:31.702 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 27 current snap is 2 2024-09-17T18:15:31.702 INFO:tasks.rados.rados.0.smithi154.stdout:83: seq_num 59 ranges {442368=622592,1064960=376832} 2024-09-17T18:15:31.710 INFO:tasks.rados.rados.0.smithi154.stdout:83: writing smithi15432074-27 from 442368 to 1064960 tid 1 2024-09-17T18:15:31.713 INFO:tasks.rados.rados.0.smithi154.stdout:83: writing smithi15432074-27 from 1064960 to 1441792 tid 2 2024-09-17T18:15:31.713 INFO:tasks.rados.rados.0.smithi154.stdout:84: read oid 3 snap -1 2024-09-17T18:15:31.713 INFO:tasks.rados.rados.0.smithi154.stdout:84: expect deleted 2024-09-17T18:15:31.714 INFO:tasks.rados.rados.0.smithi154.stdout:85: rollback oid 6 current snap is 2 2024-09-17T18:15:31.714 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 6 to 0 2024-09-17T18:15:31.714 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 49 current snap is 2 2024-09-17T18:15:31.714 INFO:tasks.rados.rados.0.smithi154.stdout:86: seq_num 60 ranges {819200=638976,1458176=376832} 2024-09-17T18:15:31.717 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-17T18:15:31.726 INFO:tasks.rados.rados.0.smithi154.stdout:86: writing smithi15432074-49 from 819200 to 1458176 tid 1 2024-09-17T18:15:31.730 INFO:tasks.rados.rados.0.smithi154.stdout:86: writing smithi15432074-49 from 1458176 to 1835008 tid 2 2024-09-17T18:15:31.730 INFO:tasks.rados.rados.0.smithi154.stdout:87: delete oid 34 current snap is 2 2024-09-17T18:15:31.730 INFO:tasks.rados.rados.0.smithi154.stdout:83: finishing write tid 1 to smithi15432074-27 2024-09-17T18:15:31.730 INFO:tasks.rados.rados.0.smithi154.stdout:83: finishing write tid 2 to smithi15432074-27 2024-09-17T18:15:31.730 INFO:tasks.rados.rados.0.smithi154.stdout:83: finishing write tid 3 to smithi15432074-27 2024-09-17T18:15:31.730 INFO:tasks.rados.rados.0.smithi154.stdout:83: finishing write tid 4 to smithi15432074-27 2024-09-17T18:15:31.730 INFO:tasks.rados.rados.0.smithi154.stdout:83: oid 27 updating version 0 to 15 2024-09-17T18:15:31.730 INFO:tasks.rados.rados.0.smithi154.stdout:83: oid 27 version 15 is already newer than 14 2024-09-17T18:15:31.730 INFO:tasks.rados.rados.0.smithi154.stdout:83: oid 27 version 15 is already newer than 13 2024-09-17T18:15:31.730 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 27 v 15 (ObjNum 59 snap 2 seq_num 59) dirty exists 2024-09-17T18:15:31.731 INFO:tasks.rados.rados.0.smithi154.stdout:83: left oid 27 (ObjNum 59 snap 2 seq_num 59) 2024-09-17T18:15:31.731 INFO:tasks.rados.rados.0.smithi154.stdout:85: finishing rollback tid 0 to smithi15432074-6 2024-09-17T18:15:31.731 INFO:tasks.rados.rados.0.smithi154.stdout:85: finishing rollback tid 1 to smithi15432074-6 2024-09-17T18:15:31.731 INFO:tasks.rados.rados.0.smithi154.stdout:85: finishing rollback tid 2 to smithi15432074-6 2024-09-17T18:15:31.731 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 6 v 38 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-09-17T18:15:31.733 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:31.727+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:31.740 INFO:tasks.rados.rados.0.smithi154.stdout:86: finishing write tid 1 to smithi15432074-49 2024-09-17T18:15:31.742 INFO:tasks.rados.rados.0.smithi154.stdout:86: finishing write tid 2 to smithi15432074-49 2024-09-17T18:15:31.745 INFO:tasks.rados.rados.0.smithi154.stdout:86: finishing write tid 3 to smithi15432074-49 2024-09-17T18:15:31.746 INFO:tasks.rados.rados.0.smithi154.stdout:83: done (4 left) 2024-09-17T18:15:31.747 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T18:15:31.748 INFO:tasks.rados.rados.0.smithi154.stdout:84: done (3 left) 2024-09-17T18:15:31.748 INFO:tasks.rados.rados.0.smithi154.stdout:85: done (2 left) 2024-09-17T18:15:31.748 INFO:tasks.rados.rados.0.smithi154.stdout:87: done (1 left) 2024-09-17T18:15:31.748 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 39 current snap is 2 2024-09-17T18:15:31.748 INFO:tasks.rados.rados.0.smithi154.stdout:88: seq_num 62 ranges {1523712=671744,2195456=376832} 2024-09-17T18:15:31.754 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:31.754 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:31.766 INFO:tasks.rados.rados.0.smithi154.stdout:88: writing smithi15432074-39 from 1523712 to 2195456 tid 1 2024-09-17T18:15:31.770 INFO:tasks.rados.rados.0.smithi154.stdout:88: writing smithi15432074-39 from 2195456 to 2572288 tid 2 2024-09-17T18:15:31.770 INFO:tasks.rados.rados.0.smithi154.stdout:89: setattr oid 23 current snap is 2 2024-09-17T18:15:31.770 INFO:tasks.rados.rados.0.smithi154.stdout:86: finishing write tid 4 to smithi15432074-49 2024-09-17T18:15:31.771 INFO:tasks.rados.rados.0.smithi154.stdout:86: oid 49 updating version 0 to 9 2024-09-17T18:15:31.771 INFO:tasks.rados.rados.0.smithi154.stdout:86: oid 49 updating version 9 to 11 2024-09-17T18:15:31.771 INFO:tasks.rados.rados.0.smithi154.stdout:86: oid 49 version 11 is already newer than 10 2024-09-17T18:15:31.771 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 49 v 11 (ObjNum 60 snap 2 seq_num 60) dirty exists 2024-09-17T18:15:31.771 INFO:tasks.rados.rados.0.smithi154.stdout:86: left oid 49 (ObjNum 60 snap 2 seq_num 60) 2024-09-17T18:15:31.772 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T18:15:31.773 INFO:tasks.rados.rados.0.smithi154.stdout:86: done (2 left) 2024-09-17T18:15:31.773 INFO:tasks.rados.rados.0.smithi154.stdout:90: rmattr oid 6 current snap is 2 2024-09-17T18:15:31.773 INFO:tasks.rados.rados.0.smithi154.stdout:90: done (2 left) 2024-09-17T18:15:31.773 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 17 current snap is 2 2024-09-17T18:15:31.773 INFO:tasks.rados.rados.0.smithi154.stdout:91: seq_num 63 ranges {278528=688128,966656=376832} 2024-09-17T18:15:31.781 INFO:tasks.rados.rados.0.smithi154.stdout:91: writing smithi15432074-17 from 278528 to 966656 tid 1 2024-09-17T18:15:31.785 INFO:tasks.rados.rados.0.smithi154.stdout:91: writing smithi15432074-17 from 966656 to 1343488 tid 2 2024-09-17T18:15:31.785 INFO:tasks.rados.rados.0.smithi154.stdout:92: copy_from oid 21 from oid 36 current snap is 2 2024-09-17T18:15:31.785 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 23 v 4 (ObjNum 22 snap 0 seq_num 22) dirty exists 2024-09-17T18:15:31.785 INFO:tasks.rados.rados.0.smithi154.stdout:88: finishing write tid 1 to smithi15432074-39 2024-09-17T18:15:31.785 INFO:tasks.rados.rados.0.smithi154.stdout:88: finishing write tid 2 to smithi15432074-39 2024-09-17T18:15:31.785 INFO:tasks.rados.rados.0.smithi154.stdout:89: done (3 left) 2024-09-17T18:15:31.785 INFO:tasks.rados.rados.0.smithi154.stdout:93: snap_create 2024-09-17T18:15:31.789 INFO:tasks.rados.rados.0.smithi154.stdout:88: finishing write tid 3 to smithi15432074-39 2024-09-17T18:15:31.795 INFO:tasks.rados.rados.0.smithi154.stdout:91: finishing write tid 1 to smithi15432074-17 2024-09-17T18:15:31.796 INFO:tasks.rados.rados.0.smithi154.stdout:88: finishing write tid 4 to smithi15432074-39 2024-09-17T18:15:31.797 INFO:tasks.rados.rados.0.smithi154.stdout:88: oid 39 updating version 0 to 15 2024-09-17T18:15:31.797 INFO:tasks.rados.rados.0.smithi154.stdout:88: oid 39 updating version 15 to 17 2024-09-17T18:15:31.797 INFO:tasks.rados.rados.0.smithi154.stdout:88: oid 39 version 17 is already newer than 16 2024-09-17T18:15:31.797 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 39 v 17 (ObjNum 62 snap 2 seq_num 62) dirty exists 2024-09-17T18:15:31.797 INFO:tasks.rados.rados.0.smithi154.stdout:88: left oid 39 (ObjNum 62 snap 2 seq_num 62) 2024-09-17T18:15:31.797 INFO:tasks.rados.rados.0.smithi154.stdout:91: finishing write tid 2 to smithi15432074-17 2024-09-17T18:15:31.798 INFO:tasks.rados.rados.0.smithi154.stdout:91: finishing write tid 3 to smithi15432074-17 2024-09-17T18:15:31.805 INFO:tasks.rados.rados.0.smithi154.stdout:92: finishing copy_from racing read to smithi15432074-21 2024-09-17T18:15:31.807 INFO:tasks.rados.rados.0.smithi154.stdout:91: finishing write tid 4 to smithi15432074-17 2024-09-17T18:15:31.807 INFO:tasks.rados.rados.0.smithi154.stdout:91: oid 17 updating version 0 to 21 2024-09-17T18:15:31.807 INFO:tasks.rados.rados.0.smithi154.stdout:91: oid 17 version 21 is already newer than 19 2024-09-17T18:15:31.807 INFO:tasks.rados.rados.0.smithi154.stdout:91: oid 17 version 21 is already newer than 20 2024-09-17T18:15:31.807 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 17 v 21 (ObjNum 63 snap 2 seq_num 63) dirty exists 2024-09-17T18:15:31.807 INFO:tasks.rados.rados.0.smithi154.stdout:91: left oid 17 (ObjNum 63 snap 2 seq_num 63) 2024-09-17T18:15:31.808 INFO:tasks.rados.rados.0.smithi154.stdout:92: finishing copy_from to smithi15432074-21 2024-09-17T18:15:31.808 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 21 v 8 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-09-17T18:15:31.834 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:31.828+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:31.897 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:15:31.897 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:15:31.918 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:15:31.919 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:15:31.937 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:31.932+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:31.938 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:31.938 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:31.939 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:15:31.939 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:15:31.952 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T18:15:31.960 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:15:31.961 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:15:31.977 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:15:31.977 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:15:31.998 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:15:31.998 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:15:32.018 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:15:32.019 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:15:32.038 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:32.031+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:32.039 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:15:32.039 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:15:32.056 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:15:32.057 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:15:32.065 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:32.066 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:32.066 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-17T18:15:32.066 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-17T18:15:32.066 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:32.076 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:15:32.076 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:15:32.078 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T18:15:32.139 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:32.137+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:32.229 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:32.229 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-17T18:15:32.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-17T18:15:32.229 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [] 2024-09-17T18:15:32.229 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:32.241 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T18:15:32.242 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:32.235+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:32.299 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:15:32.299 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:15:32.318 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:15:32.318 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:15:32.342 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:15:32.342 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:15:32.342 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:32.338+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:32.363 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:32.364 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:32.364 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-17T18:15:32.364 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:32.367 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:15:32.368 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:15:32.377 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T18:15:32.393 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:15:32.393 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:15:32.418 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:15:32.418 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:15:32.443 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:32.441+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:32.503 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:32.503 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:32.503 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-17T18:15:32.503 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-17T18:15:32.504 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:32.516 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T18:15:32.544 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:32.541+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:32.634 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:32.635 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-17T18:15:32.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-17T18:15:32.635 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-17T18:15:32.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.635 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4341.0:5 2.2 e26/24 2:5cea7035:::rbd_info:head v 26'1, mlcod=0'0)", 2024-09-17T18:15:32.635 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:15.597932+0000", 2024-09-17T18:15:32.635 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.036348536999999, 2024-09-17T18:15:32.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0026795310000000002, 2024-09-17T18:15:32.635 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:32.635 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:32.635 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:32.636 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:32.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:32.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:15.597932+0000", 2024-09-17T18:15:32.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:32.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:32.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:15.597932+0000", 2024-09-17T18:15:32.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:32.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:32.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:15.597932+0000", 2024-09-17T18:15:32.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5000000000000003e-07 2024-09-17T18:15:32.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:32.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:15.597953+0000", 2024-09-17T18:15:32.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0265e-05 2024-09-17T18:15:32.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:32.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:15.597982+0000", 2024-09-17T18:15:32.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8898999999999999e-05 2024-09-17T18:15:32.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:32.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:15.598003+0000", 2024-09-17T18:15:32.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1314999999999998e-05 2024-09-17T18:15:32.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:32.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:15.598211+0000", 2024-09-17T18:15:32.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020780199999999999 2024-09-17T18:15:32.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:32.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:15.598269+0000", 2024-09-17T18:15:32.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8866000000000002e-05 2024-09-17T18:15:32.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:32.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:15.600504+0000", 2024-09-17T18:15:32.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002234794 2024-09-17T18:15:32.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:32.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:15.600611+0000", 2024-09-17T18:15:32.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010704000000000001 2024-09-17T18:15:32.640 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:32.640 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:32.640 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:32.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.641 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4341.0:7 2.2 e27/24 2:5cea7035:::rbd_info:head v 27'2, mlcod=0'0)", 2024-09-17T18:15:32.641 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:16.618673+0000", 2024-09-17T18:15:32.641 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.01560769, 2024-09-17T18:15:32.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016602800000000001, 2024-09-17T18:15:32.641 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:32.641 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:32.641 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:32.641 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:32.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:32.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:16.618673+0000", 2024-09-17T18:15:32.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:32.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:32.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:16.618673+0000", 2024-09-17T18:15:32.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:32.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:32.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:16.618673+0000", 2024-09-17T18:15:32.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0999999999999999e-07 2024-09-17T18:15:32.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:32.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:16.618682+0000", 2024-09-17T18:15:32.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2499999999999995e-06 2024-09-17T18:15:32.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:32.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:16.618712+0000", 2024-09-17T18:15:32.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9648000000000001e-05 2024-09-17T18:15:32.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:32.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:16.618737+0000", 2024-09-17T18:15:32.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4459000000000001e-05 2024-09-17T18:15:32.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:32.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:16.618893+0000", 2024-09-17T18:15:32.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155988 2024-09-17T18:15:32.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:32.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:16.618936+0000", 2024-09-17T18:15:32.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3526999999999998e-05 2024-09-17T18:15:32.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:32.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:16.620257+0000", 2024-09-17T18:15:32.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001321048 2024-09-17T18:15:32.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:32.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:32.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:32.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:16.620333+0000", 2024-09-17T18:15:32.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5850000000000001e-05 2024-09-17T18:15:32.645 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:32.645 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:32.645 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:32.645 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:32.645 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:32.646 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:32.647 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:32.644+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:32.649 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T18:15:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.2 to 1 (10000) 2024-09-17T18:15:32.705 INFO:tasks.rados.rados.0.smithi154.stdout:88: done (3 left) 2024-09-17T18:15:32.705 INFO:tasks.rados.rados.0.smithi154.stdout:91: done (2 left) 2024-09-17T18:15:32.705 INFO:tasks.rados.rados.0.smithi154.stdout:92: done (1 left) 2024-09-17T18:15:32.705 INFO:tasks.rados.rados.0.smithi154.stdout:93: done (0 left) 2024-09-17T18:15:32.706 INFO:tasks.rados.rados.0.smithi154.stdout:94: rollback oid 44 current snap is 3 2024-09-17T18:15:32.706 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 44 to 2 2024-09-17T18:15:32.706 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 30 current snap is 3 2024-09-17T18:15:32.706 INFO:tasks.rados.rados.0.smithi154.stdout:95: seq_num 64 ranges {1343488=704512,2048000=376832} 2024-09-17T18:15:32.714 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T18:15:32.720 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-17T18:15:32.721 INFO:tasks.rados.rados.0.smithi154.stdout:95: writing smithi15432074-30 from 1343488 to 2048000 tid 1 2024-09-17T18:15:32.725 INFO:tasks.rados.rados.0.smithi154.stdout:95: writing smithi15432074-30 from 2048000 to 2424832 tid 2 2024-09-17T18:15:32.725 INFO:tasks.rados.rados.0.smithi154.stdout:96: rollback oid 17 current snap is 3 2024-09-17T18:15:32.725 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 17 to 0 2024-09-17T18:15:32.725 INFO:tasks.rados.rados.0.smithi154.stdout:94: finishing rollback tid 0 to smithi15432074-44 2024-09-17T18:15:32.725 INFO:tasks.rados.rados.0.smithi154.stdout:94: finishing rollback tid 1 to smithi15432074-44 2024-09-17T18:15:32.725 INFO:tasks.rados.rados.0.smithi154.stdout:94: finishing rollback tid 2 to smithi15432074-44 2024-09-17T18:15:32.725 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 44 v 17 (ObjNum 43 snap 0 seq_num 43) dirty exists 2024-09-17T18:15:32.725 INFO:tasks.rados.rados.0.smithi154.stdout:94: done (2 left) 2024-09-17T18:15:32.725 INFO:tasks.rados.rados.0.smithi154.stdout:97: delete oid 42 current snap is 3 2024-09-17T18:15:32.733 INFO:tasks.rados.rados.0.smithi154.stdout:95: finishing write tid 1 to smithi15432074-30 2024-09-17T18:15:32.733 INFO:tasks.rados.rados.0.smithi154.stdout:96: finishing rollback tid 0 to smithi15432074-17 2024-09-17T18:15:32.733 INFO:tasks.rados.rados.0.smithi154.stdout:95: finishing write tid 2 to smithi15432074-30 2024-09-17T18:15:32.733 INFO:tasks.rados.rados.0.smithi154.stdout:95: finishing write tid 3 to smithi15432074-30 2024-09-17T18:15:32.733 INFO:tasks.rados.rados.0.smithi154.stdout:96: finishing rollback tid 1 to smithi15432074-17 2024-09-17T18:15:32.733 INFO:tasks.rados.rados.0.smithi154.stdout:96: finishing rollback tid 2 to smithi15432074-17 2024-09-17T18:15:32.734 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 17 v 27 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-09-17T18:15:32.735 INFO:tasks.rados.rados.0.smithi154.stdout:95: finishing write tid 4 to smithi15432074-30 2024-09-17T18:15:32.735 INFO:tasks.rados.rados.0.smithi154.stdout:95: oid 30 updating version 0 to 20 2024-09-17T18:15:32.735 INFO:tasks.rados.rados.0.smithi154.stdout:95: oid 30 version 20 is already newer than 19 2024-09-17T18:15:32.735 INFO:tasks.rados.rados.0.smithi154.stdout:95: oid 30 version 20 is already newer than 18 2024-09-17T18:15:32.735 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 30 v 20 (ObjNum 64 snap 3 seq_num 64) dirty exists 2024-09-17T18:15:32.735 INFO:tasks.rados.rados.0.smithi154.stdout:95: left oid 30 (ObjNum 64 snap 3 seq_num 64) 2024-09-17T18:15:32.738 INFO:tasks.rados.rados.0.smithi154.stdout:95: done (2 left) 2024-09-17T18:15:32.738 INFO:tasks.rados.rados.0.smithi154.stdout:96: done (1 left) 2024-09-17T18:15:32.738 INFO:tasks.rados.rados.0.smithi154.stdout:97: done (0 left) 2024-09-17T18:15:32.738 INFO:tasks.rados.rados.0.smithi154.stdout:98: snap_create 2024-09-17T18:15:32.747 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:32.744+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:32.788 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:32.788 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:32.788 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:15:32.788 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:32.802 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T18:15:32.848 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:32.845+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:32.949 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:32.945+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:32.968 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:15:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:15:32.969 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:32.983 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T18:15:33.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:33.044+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:33.103 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:33.103 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:15:33.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:15:33.103 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:15:33.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.103 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 37/31 ECSubWrite(tid=60, reqid=client.4565.0:244, at_version=37'18, trim_to=0'0, roll_forward_to=35'16))", 2024-09-17T18:15:33.103 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.725738+0000", 2024-09-17T18:15:33.103 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.376002216, 2024-09-17T18:15:33.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047726399999999999, 2024-09-17T18:15:33.104 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.104 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.104 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.104 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.725738+0000", 2024-09-17T18:15:33.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.725738+0000", 2024-09-17T18:15:33.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.725739+0000", 2024-09-17T18:15:33.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2399999999999998e-07 2024-09-17T18:15:33.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.725977+0000", 2024-09-17T18:15:33.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023823200000000001 2024-09-17T18:15:33.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.725995+0000", 2024-09-17T18:15:33.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7983999999999999e-05 2024-09-17T18:15:33.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726011+0000", 2024-09-17T18:15:33.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5741000000000001e-05 2024-09-17T18:15:33.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726127+0000", 2024-09-17T18:15:33.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116743 2024-09-17T18:15:33.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726137+0000", 2024-09-17T18:15:33.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6339999999999996e-06 2024-09-17T18:15:33.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730463+0000", 2024-09-17T18:15:33.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043259550000000003 2024-09-17T18:15:33.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730511+0000", 2024-09-17T18:15:33.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7827000000000001e-05 2024-09-17T18:15:33.110 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.110 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.110 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.110 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 37/31 ECSubWrite(tid=101, reqid=client.4565.0:248, at_version=37'25, trim_to=0'0, roll_forward_to=36'23))", 2024-09-17T18:15:33.110 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.727639+0000", 2024-09-17T18:15:33.110 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.374101132, 2024-09-17T18:15:33.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040372259999999997, 2024-09-17T18:15:33.111 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.111 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.111 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.111 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727639+0000", 2024-09-17T18:15:33.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727639+0000", 2024-09-17T18:15:33.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727640+0000", 2024-09-17T18:15:33.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1600000000000001e-07 2024-09-17T18:15:33.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727678+0000", 2024-09-17T18:15:33.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7809999999999999e-05 2024-09-17T18:15:33.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727705+0000", 2024-09-17T18:15:33.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7620999999999999e-05 2024-09-17T18:15:33.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727717+0000", 2024-09-17T18:15:33.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2051e-05 2024-09-17T18:15:33.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727795+0000", 2024-09-17T18:15:33.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7616999999999999e-05 2024-09-17T18:15:33.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727804+0000", 2024-09-17T18:15:33.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1500000000000005e-06 2024-09-17T18:15:33.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.731630+0000", 2024-09-17T18:15:33.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038256190000000002 2024-09-17T18:15:33.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.731676+0000", 2024-09-17T18:15:33.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6742000000000001e-05 2024-09-17T18:15:33.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.115 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.115 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 37/31 ECSubWrite(tid=61, reqid=client.4565.0:245, at_version=37'19, trim_to=0'0, roll_forward_to=35'16))", 2024-09-17T18:15:33.115 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.728965+0000", 2024-09-17T18:15:33.115 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.37277508399999998, 2024-09-17T18:15:33.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031978390000000001, 2024-09-17T18:15:33.115 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.115 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.116 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.116 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.728965+0000", 2024-09-17T18:15:33.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.728965+0000", 2024-09-17T18:15:33.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.728966+0000", 2024-09-17T18:15:33.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3600000000000002e-07 2024-09-17T18:15:33.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729024+0000", 2024-09-17T18:15:33.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8214000000000002e-05 2024-09-17T18:15:33.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729037+0000", 2024-09-17T18:15:33.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2706e-05 2024-09-17T18:15:33.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729047+0000", 2024-09-17T18:15:33.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006e-05 2024-09-17T18:15:33.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729130+0000", 2024-09-17T18:15:33.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3354000000000002e-05 2024-09-17T18:15:33.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729144+0000", 2024-09-17T18:15:33.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3726e-05 2024-09-17T18:15:33.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.732120+0000", 2024-09-17T18:15:33.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002975358 2024-09-17T18:15:33.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.732163+0000", 2024-09-17T18:15:33.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3584999999999997e-05 2024-09-17T18:15:33.122 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.122 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.122 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.122 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 37/31 ECSubWrite(tid=62, reqid=client.4565.0:246, at_version=37'20, trim_to=0'0, roll_forward_to=35'16))", 2024-09-17T18:15:33.122 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.729074+0000", 2024-09-17T18:15:33.122 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.37266644999999998, 2024-09-17T18:15:33.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031134980000000001, 2024-09-17T18:15:33.122 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.122 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.123 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.123 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729074+0000", 2024-09-17T18:15:33.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729074+0000", 2024-09-17T18:15:33.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729074+0000", 2024-09-17T18:15:33.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2899999999999999e-07 2024-09-17T18:15:33.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729089+0000", 2024-09-17T18:15:33.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4224e-05 2024-09-17T18:15:33.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729097+0000", 2024-09-17T18:15:33.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7439999999999996e-06 2024-09-17T18:15:33.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729104+0000", 2024-09-17T18:15:33.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3539999999999996e-06 2024-09-17T18:15:33.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730227+0000", 2024-09-17T18:15:33.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001123546 2024-09-17T18:15:33.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730239+0000", 2024-09-17T18:15:33.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2147000000000001e-05 2024-09-17T18:15:33.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.732169+0000", 2024-09-17T18:15:33.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001929177 2024-09-17T18:15:33.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.732187+0000", 2024-09-17T18:15:33.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8876999999999999e-05 2024-09-17T18:15:33.127 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.127 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.127 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.127 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 37/31 ECSubWrite(tid=102, reqid=client.4565.0:249, at_version=37'26, trim_to=0'0, roll_forward_to=36'23))", 2024-09-17T18:15:33.128 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.729538+0000", 2024-09-17T18:15:33.128 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.37220268099999998, 2024-09-17T18:15:33.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027344209999999999, 2024-09-17T18:15:33.128 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.128 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.128 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.128 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729538+0000", 2024-09-17T18:15:33.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729538+0000", 2024-09-17T18:15:33.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729539+0000", 2024-09-17T18:15:33.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.189e-06 2024-09-17T18:15:33.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729563+0000", 2024-09-17T18:15:33.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4553e-05 2024-09-17T18:15:33.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729582+0000", 2024-09-17T18:15:33.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8485e-05 2024-09-17T18:15:33.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729596+0000", 2024-09-17T18:15:33.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4382999999999999e-05 2024-09-17T18:15:33.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730117+0000", 2024-09-17T18:15:33.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00052070000000000003 2024-09-17T18:15:33.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730139+0000", 2024-09-17T18:15:33.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2269e-05 2024-09-17T18:15:33.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.732190+0000", 2024-09-17T18:15:33.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020508990000000001 2024-09-17T18:15:33.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.732272+0000", 2024-09-17T18:15:33.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1942999999999998e-05 2024-09-17T18:15:33.132 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.132 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.132 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.132 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 37/31 ECSubWrite(tid=103, reqid=client.4565.0:250, at_version=37'27, trim_to=0'0, roll_forward_to=36'23))", 2024-09-17T18:15:33.132 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.730645+0000", 2024-09-17T18:15:33.132 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.371095328, 2024-09-17T18:15:33.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016956479999999999, 2024-09-17T18:15:33.133 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.133 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.133 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.133 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730645+0000", 2024-09-17T18:15:33.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730645+0000", 2024-09-17T18:15:33.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730646+0000", 2024-09-17T18:15:33.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.19e-06 2024-09-17T18:15:33.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730671+0000", 2024-09-17T18:15:33.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5230999999999999e-05 2024-09-17T18:15:33.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730688+0000", 2024-09-17T18:15:33.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6685999999999999e-05 2024-09-17T18:15:33.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730699+0000", 2024-09-17T18:15:33.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.132e-05 2024-09-17T18:15:33.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730967+0000", 2024-09-17T18:15:33.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026712300000000002 2024-09-17T18:15:33.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730990+0000", 2024-09-17T18:15:33.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3258999999999999e-05 2024-09-17T18:15:33.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.732284+0000", 2024-09-17T18:15:33.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001294248 2024-09-17T18:15:33.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.732341+0000", 2024-09-17T18:15:33.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6591000000000001e-05 2024-09-17T18:15:33.137 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.137 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.137 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.137 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 37/31 ECSubWrite(tid=63, reqid=client.4565.0:246, at_version=0'0, trim_to=0'0, roll_forward_to=37'20))", 2024-09-17T18:15:33.137 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.733915+0000", 2024-09-17T18:15:33.137 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.367825813, 2024-09-17T18:15:33.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074072799999999996, 2024-09-17T18:15:33.137 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.137 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.137 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.138 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.733915+0000", 2024-09-17T18:15:33.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.733915+0000", 2024-09-17T18:15:33.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.733916+0000", 2024-09-17T18:15:33.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0759999999999999e-06 2024-09-17T18:15:33.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.733932+0000", 2024-09-17T18:15:33.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5869999999999999e-05 2024-09-17T18:15:33.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.733950+0000", 2024-09-17T18:15:33.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8576999999999998e-05 2024-09-17T18:15:33.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.733960+0000", 2024-09-17T18:15:33.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0233e-05 2024-09-17T18:15:33.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734033+0000", 2024-09-17T18:15:33.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3124e-05 2024-09-17T18:15:33.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734048+0000", 2024-09-17T18:15:33.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5034999999999999e-05 2024-09-17T18:15:33.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734624+0000", 2024-09-17T18:15:33.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057540300000000005 2024-09-17T18:15:33.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734655+0000", 2024-09-17T18:15:33.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1409999999999999e-05 2024-09-17T18:15:33.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.144 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.144 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 37/31 ECSubWrite(tid=130, reqid=client.4565.0:251, at_version=37'13, trim_to=0'0, roll_forward_to=36'11))", 2024-09-17T18:15:33.144 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.733950+0000", 2024-09-17T18:15:33.144 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.36778997899999999, 2024-09-17T18:15:33.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018392149999999999, 2024-09-17T18:15:33.144 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.144 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.145 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.145 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.733950+0000", 2024-09-17T18:15:33.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.733950+0000", 2024-09-17T18:15:33.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.733951+0000", 2024-09-17T18:15:33.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5999999999999999e-07 2024-09-17T18:15:33.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.733979+0000", 2024-09-17T18:15:33.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8416e-05 2024-09-17T18:15:33.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.733991+0000", 2024-09-17T18:15:33.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1428e-05 2024-09-17T18:15:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734001+0000", 2024-09-17T18:15:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0806e-05 2024-09-17T18:15:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734079+0000", 2024-09-17T18:15:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7599e-05 2024-09-17T18:15:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734087+0000", 2024-09-17T18:15:33.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7670000000000003e-06 2024-09-17T18:15:33.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.735746+0000", 2024-09-17T18:15:33.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001659401 2024-09-17T18:15:33.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.735790+0000", 2024-09-17T18:15:33.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3438e-05 2024-09-17T18:15:33.148 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.149 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.149 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.149 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 37/31 ECSubWrite(tid=104, reqid=client.4565.0:250, at_version=0'0, trim_to=0'0, roll_forward_to=37'27))", 2024-09-17T18:15:33.149 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.734820+0000", 2024-09-17T18:15:33.149 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.366920833, 2024-09-17T18:15:33.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016174550000000001, 2024-09-17T18:15:33.149 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.149 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.149 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.149 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734820+0000", 2024-09-17T18:15:33.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734820+0000", 2024-09-17T18:15:33.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734821+0000", 2024-09-17T18:15:33.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8400000000000002e-07 2024-09-17T18:15:33.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734834+0000", 2024-09-17T18:15:33.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3579e-05 2024-09-17T18:15:33.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734885+0000", 2024-09-17T18:15:33.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0849000000000001e-05 2024-09-17T18:15:33.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734899+0000", 2024-09-17T18:15:33.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.361e-05 2024-09-17T18:15:33.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734963+0000", 2024-09-17T18:15:33.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4681e-05 2024-09-17T18:15:33.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734972+0000", 2024-09-17T18:15:33.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0850000000000003e-06 2024-09-17T18:15:33.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.736397+0000", 2024-09-17T18:15:33.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014242510000000001 2024-09-17T18:15:33.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.736437+0000", 2024-09-17T18:15:33.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0416000000000001e-05 2024-09-17T18:15:33.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.153 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.153 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 37/31 ECSubWrite(tid=131, reqid=client.4565.0:251, at_version=0'0, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T18:15:33.154 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.738966+0000", 2024-09-17T18:15:33.154 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.362774755, 2024-09-17T18:15:33.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00089401699999999999, 2024-09-17T18:15:33.154 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.154 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.154 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.154 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.738966+0000", 2024-09-17T18:15:33.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.738966+0000", 2024-09-17T18:15:33.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.738967+0000", 2024-09-17T18:15:33.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1100000000000004e-07 2024-09-17T18:15:33.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.738981+0000", 2024-09-17T18:15:33.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.488e-05 2024-09-17T18:15:33.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.738997+0000", 2024-09-17T18:15:33.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5778999999999999e-05 2024-09-17T18:15:33.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.739007+0000", 2024-09-17T18:15:33.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5859999999999994e-06 2024-09-17T18:15:33.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.739074+0000", 2024-09-17T18:15:33.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7300999999999998e-05 2024-09-17T18:15:33.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.739082+0000", 2024-09-17T18:15:33.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1049999999999995e-06 2024-09-17T18:15:33.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.739814+0000", 2024-09-17T18:15:33.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00073177300000000002 2024-09-17T18:15:33.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.739860+0000", 2024-09-17T18:15:33.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5682000000000001e-05 2024-09-17T18:15:33.158 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.158 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.158 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.158 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.158 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.158 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:33.160 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T18:15:33.160 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:33.155+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:33.261 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:33.258+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:33.329 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:33.329 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:33.329 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:15:33.329 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:33.344 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T18:15:33.362 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:33.358+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:33.464 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:33.459+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:33.464 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:15:33.465 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:15:33.465 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:33.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T18:15:33.564 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:33.561+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:33.610 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:15:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:15:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:15:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4341.0:1 2.3 e25/24 2:c4c92e5a:::rbd_trash:head v 25'1, mlcod=0'0)", 2024-09-17T18:15:33.610 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:14.581027+0000", 2024-09-17T18:15:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.023358697999999, 2024-09-17T18:15:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00093125399999999996, 2024-09-17T18:15:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.581027+0000", 2024-09-17T18:15:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.581027+0000", 2024-09-17T18:15:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.581027+0000", 2024-09-17T18:15:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3700000000000001e-07 2024-09-17T18:15:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.581036+0000", 2024-09-17T18:15:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2769999999999994e-06 2024-09-17T18:15:33.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.581053+0000", 2024-09-17T18:15:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6905000000000002e-05 2024-09-17T18:15:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.581068+0000", 2024-09-17T18:15:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4515000000000001e-05 2024-09-17T18:15:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.581115+0000", 2024-09-17T18:15:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7054e-05 2024-09-17T18:15:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.581131+0000", 2024-09-17T18:15:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6347000000000001e-05 2024-09-17T18:15:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.581926+0000", 2024-09-17T18:15:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00079464100000000001 2024-09-17T18:15:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.581958+0000", 2024-09-17T18:15:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2078e-05 2024-09-17T18:15:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:241 3.cs0 3:38dc802b:::smithi15432074-44:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-17T18:15:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.703744+0000", 2024-09-17T18:15:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.90064133499999999, 2024-09-17T18:15:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072158439999999999, 2024-09-17T18:15:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 241 2024-09-17T18:15:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703744+0000", 2024-09-17T18:15:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703744+0000", 2024-09-17T18:15:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703746+0000", 2024-09-17T18:15:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2290000000000002e-06 2024-09-17T18:15:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703756+0000", 2024-09-17T18:15:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9939999999999995e-06 2024-09-17T18:15:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703778+0000", 2024-09-17T18:15:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1668999999999999e-05 2024-09-17T18:15:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703793+0000", 2024-09-17T18:15:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5358000000000001e-05 2024-09-17T18:15:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703870+0000", 2024-09-17T18:15:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6966999999999997e-05 2024-09-17T18:15:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.704016+0000", 2024-09-17T18:15:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014566199999999999 2024-09-17T18:15:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.705073+0000", 2024-09-17T18:15:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00105704 2024-09-17T18:15:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707969+0000", 2024-09-17T18:15:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002896666 2024-09-17T18:15:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.710892+0000", 2024-09-17T18:15:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029225269999999999 2024-09-17T18:15:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.710960+0000", 2024-09-17T18:15:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7731999999999995e-05 2024-09-17T18:15:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:242 3.cs0 3:38dc802b:::smithi15432074-44:head [rollback 4] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-17T18:15:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.703819+0000", 2024-09-17T18:15:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.90056669099999997, 2024-09-17T18:15:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009696128, 2024-09-17T18:15:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 242 2024-09-17T18:15:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703819+0000", 2024-09-17T18:15:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703819+0000", 2024-09-17T18:15:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703819+0000", 2024-09-17T18:15:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1900000000000002e-07 2024-09-17T18:15:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703823+0000", 2024-09-17T18:15:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8879999999999999e-06 2024-09-17T18:15:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703833+0000", 2024-09-17T18:15:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4930000000000004e-06 2024-09-17T18:15:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703839+0000", 2024-09-17T18:15:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8050000000000001e-06 2024-09-17T18:15:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.705861+0000", 2024-09-17T18:15:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002021517 2024-09-17T18:15:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.705950+0000", 2024-09-17T18:15:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9370999999999995e-05 2024-09-17T18:15:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.706557+0000", 2024-09-17T18:15:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00060676800000000004 2024-09-17T18:15:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707971+0000", 2024-09-17T18:15:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014141519999999999 2024-09-17T18:15:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713458+0000", 2024-09-17T18:15:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054867010000000001 2024-09-17T18:15:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713515+0000", 2024-09-17T18:15:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6713999999999999e-05 2024-09-17T18:15:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:243 3.cs0 3:38dc802b:::smithi15432074-44:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-17T18:15:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.703851+0000", 2024-09-17T18:15:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.90053446500000001, 2024-09-17T18:15:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0098715450000000007, 2024-09-17T18:15:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 243 2024-09-17T18:15:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703851+0000", 2024-09-17T18:15:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703851+0000", 2024-09-17T18:15:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703851+0000", 2024-09-17T18:15:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8999999999999996e-07 2024-09-17T18:15:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703856+0000", 2024-09-17T18:15:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6670000000000004e-06 2024-09-17T18:15:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703864+0000", 2024-09-17T18:15:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2300000000000008e-06 2024-09-17T18:15:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703874+0000", 2024-09-17T18:15:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7559999999999994e-06 2024-09-17T18:15:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.706992+0000", 2024-09-17T18:15:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031183679999999998 2024-09-17T18:15:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707095+0000", 2024-09-17T18:15:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102736 2024-09-17T18:15:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707589+0000", 2024-09-17T18:15:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049381200000000005 2024-09-17T18:15:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708440+0000", 2024-09-17T18:15:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00085066600000000003 2024-09-17T18:15:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713642+0000", 2024-09-17T18:15:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052026970000000001 2024-09-17T18:15:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713722+0000", 2024-09-17T18:15:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9923e-05 2024-09-17T18:15:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.cs0 36/31 ECSubWriteReply(tid=30, last_complete=37'15, committed=1, applied=1))", 2024-09-17T18:15:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.707292+0000", 2024-09-17T18:15:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.89709312500000005, 2024-09-17T18:15:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00061141799999999997, 2024-09-17T18:15:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707292+0000", 2024-09-17T18:15:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707292+0000", 2024-09-17T18:15:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707293+0000", 2024-09-17T18:15:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3170000000000001e-06 2024-09-17T18:15:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707301+0000", 2024-09-17T18:15:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.79e-06 2024-09-17T18:15:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707317+0000", 2024-09-17T18:15:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6225000000000001e-05 2024-09-17T18:15:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707329+0000", 2024-09-17T18:15:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1454000000000001e-05 2024-09-17T18:15:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707879+0000", 2024-09-17T18:15:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00054961699999999997 2024-09-17T18:15:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707904+0000", 2024-09-17T18:15:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5015e-05 2024-09-17T18:15:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.cs0 36/31 ECSubWriteReply(tid=30, last_complete=37'15, committed=1, applied=1))", 2024-09-17T18:15:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.707434+0000", 2024-09-17T18:15:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.89695112200000005, 2024-09-17T18:15:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00053846799999999995, 2024-09-17T18:15:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707434+0000", 2024-09-17T18:15:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707434+0000", 2024-09-17T18:15:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707435+0000", 2024-09-17T18:15:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.206e-06 2024-09-17T18:15:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707442+0000", 2024-09-17T18:15:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.956e-06 2024-09-17T18:15:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707458+0000", 2024-09-17T18:15:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5262999999999999e-05 2024-09-17T18:15:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707467+0000", 2024-09-17T18:15:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1190000000000003e-06 2024-09-17T18:15:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707948+0000", 2024-09-17T18:15:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048167199999999999 2024-09-17T18:15:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707973+0000", 2024-09-17T18:15:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4252000000000001e-05 2024-09-17T18:15:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.cs0 36/31 ECSubWriteReply(tid=30, last_complete=37'15, committed=1, applied=1))", 2024-09-17T18:15:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.707643+0000", 2024-09-17T18:15:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.89674264400000003, 2024-09-17T18:15:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042631800000000002, 2024-09-17T18:15:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707643+0000", 2024-09-17T18:15:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707643+0000", 2024-09-17T18:15:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707644+0000", 2024-09-17T18:15:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9399999999999993e-07 2024-09-17T18:15:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707649+0000", 2024-09-17T18:15:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8610000000000003e-06 2024-09-17T18:15:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707666+0000", 2024-09-17T18:15:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6532e-05 2024-09-17T18:15:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707676+0000", 2024-09-17T18:15:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0437e-05 2024-09-17T18:15:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708049+0000", 2024-09-17T18:15:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037215600000000001 2024-09-17T18:15:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708069+0000", 2024-09-17T18:15:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0338000000000001e-05 2024-09-17T18:15:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.cs0 36/31 ECSubWriteReply(tid=30, last_complete=37'15, committed=1, applied=1))", 2024-09-17T18:15:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.707726+0000", 2024-09-17T18:15:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.89665930000000005, 2024-09-17T18:15:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029596100000000002, 2024-09-17T18:15:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707726+0000", 2024-09-17T18:15:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707726+0000", 2024-09-17T18:15:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707727+0000", 2024-09-17T18:15:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2699999999999999e-07 2024-09-17T18:15:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707731+0000", 2024-09-17T18:15:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6460000000000001e-06 2024-09-17T18:15:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707743+0000", 2024-09-17T18:15:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1511999999999999e-05 2024-09-17T18:15:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707754+0000", 2024-09-17T18:15:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1124000000000001e-05 2024-09-17T18:15:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708001+0000", 2024-09-17T18:15:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024707899999999998 2024-09-17T18:15:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708022+0000", 2024-09-17T18:15:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0973000000000001e-05 2024-09-17T18:15:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.cs0 36/31 ECSubWriteReply(tid=31, last_complete=37'16, committed=1, applied=1))", 2024-09-17T18:15:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.708781+0000", 2024-09-17T18:15:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.89560424000000005, 2024-09-17T18:15:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014630900000000001, 2024-09-17T18:15:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708781+0000", 2024-09-17T18:15:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708781+0000", 2024-09-17T18:15:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708782+0000", 2024-09-17T18:15:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2109999999999999e-06 2024-09-17T18:15:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708788+0000", 2024-09-17T18:15:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8980000000000001e-06 2024-09-17T18:15:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708805+0000", 2024-09-17T18:15:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6682000000000001e-05 2024-09-17T18:15:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708814+0000", 2024-09-17T18:15:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5629999999999998e-06 2024-09-17T18:15:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708898+0000", 2024-09-17T18:15:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3753999999999998e-05 2024-09-17T18:15:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708927+0000", 2024-09-17T18:15:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9201e-05 2024-09-17T18:15:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.cs0 37/31 ECSubWriteReply(tid=30, last_complete=37'15, committed=1, applied=1))", 2024-09-17T18:15:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.710772+0000", 2024-09-17T18:15:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.89361335600000003, 2024-09-17T18:15:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019648800000000001, 2024-09-17T18:15:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.710772+0000", 2024-09-17T18:15:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.710772+0000", 2024-09-17T18:15:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.710773+0000", 2024-09-17T18:15:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3200000000000004e-07 2024-09-17T18:15:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.710777+0000", 2024-09-17T18:15:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2200000000000003e-06 2024-09-17T18:15:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.710788+0000", 2024-09-17T18:15:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1491999999999999e-05 2024-09-17T18:15:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.710794+0000", 2024-09-17T18:15:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7420000000000003e-06 2024-09-17T18:15:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.710836+0000", 2024-09-17T18:15:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2267e-05 2024-09-17T18:15:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.710968+0000", 2024-09-17T18:15:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013193499999999999 2024-09-17T18:15:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.cs0 37/31 ECSubWriteReply(tid=32, last_complete=37'17, committed=1, applied=1))", 2024-09-17T18:15:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.713084+0000", 2024-09-17T18:15:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.89130112299999997, 2024-09-17T18:15:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015596499999999999, 2024-09-17T18:15:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713084+0000", 2024-09-17T18:15:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713084+0000", 2024-09-17T18:15:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713085+0000", 2024-09-17T18:15:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5600000000000001e-07 2024-09-17T18:15:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713088+0000", 2024-09-17T18:15:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.163e-06 2024-09-17T18:15:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713096+0000", 2024-09-17T18:15:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7180000000000002e-06 2024-09-17T18:15:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713103+0000", 2024-09-17T18:15:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1800000000000001e-06 2024-09-17T18:15:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713189+0000", 2024-09-17T18:15:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6695999999999998e-05 2024-09-17T18:15:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713240+0000", 2024-09-17T18:15:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0751999999999998e-05 2024-09-17T18:15:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.cs0 36/31 ECSubWriteReply(tid=31, last_complete=37'16, committed=1, applied=1))", 2024-09-17T18:15:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.713359+0000", 2024-09-17T18:15:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.89102636499999999, 2024-09-17T18:15:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016897, 2024-09-17T18:15:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713359+0000", 2024-09-17T18:15:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713359+0000", 2024-09-17T18:15:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713359+0000", 2024-09-17T18:15:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2599999999999998e-07 2024-09-17T18:15:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713362+0000", 2024-09-17T18:15:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0110000000000001e-06 2024-09-17T18:15:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713370+0000", 2024-09-17T18:15:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.362e-06 2024-09-17T18:15:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713376+0000", 2024-09-17T18:15:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1210000000000003e-06 2024-09-17T18:15:33.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713407+0000", 2024-09-17T18:15:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0806000000000003e-05 2024-09-17T18:15:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713528+0000", 2024-09-17T18:15:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012124400000000001 2024-09-17T18:15:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.cs0 37/31 ECSubWriteReply(tid=32, last_complete=37'17, committed=1, applied=1))", 2024-09-17T18:15:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.713388+0000", 2024-09-17T18:15:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.89099703900000005, 2024-09-17T18:15:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00083695000000000004, 2024-09-17T18:15:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713388+0000", 2024-09-17T18:15:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713388+0000", 2024-09-17T18:15:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713388+0000", 2024-09-17T18:15:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.91e-07 2024-09-17T18:15:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713390+0000", 2024-09-17T18:15:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.643e-06 2024-09-17T18:15:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713395+0000", 2024-09-17T18:15:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7570000000000004e-06 2024-09-17T18:15:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713398+0000", 2024-09-17T18:15:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3639999999999999e-06 2024-09-17T18:15:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713560+0000", 2024-09-17T18:15:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162268 2024-09-17T18:15:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.714225+0000", 2024-09-17T18:15:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066472700000000005 2024-09-17T18:15:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.cs0 37/31 ECSubWriteReply(tid=33, last_complete=37'17, committed=1, applied=1))", 2024-09-17T18:15:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.714770+0000", 2024-09-17T18:15:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.88961476500000003, 2024-09-17T18:15:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012796800000000001, 2024-09-17T18:15:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.714770+0000", 2024-09-17T18:15:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.714770+0000", 2024-09-17T18:15:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.714771+0000", 2024-09-17T18:15:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1699999999999997e-07 2024-09-17T18:15:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.714776+0000", 2024-09-17T18:15:33.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8339999999999998e-06 2024-09-17T18:15:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.714789+0000", 2024-09-17T18:15:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3025e-05 2024-09-17T18:15:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.714810+0000", 2024-09-17T18:15:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0309000000000002e-05 2024-09-17T18:15:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.714873+0000", 2024-09-17T18:15:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.347e-05 2024-09-17T18:15:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.714898+0000", 2024-09-17T18:15:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5412999999999999e-05 2024-09-17T18:15:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.cs0 37/31 ECSubWriteReply(tid=33, last_complete=37'17, committed=1, applied=1))", 2024-09-17T18:15:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.716016+0000", 2024-09-17T18:15:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.88836960700000001, 2024-09-17T18:15:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013811199999999999, 2024-09-17T18:15:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716016+0000", 2024-09-17T18:15:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716016+0000", 2024-09-17T18:15:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716017+0000", 2024-09-17T18:15:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7e-06 2024-09-17T18:15:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716026+0000", 2024-09-17T18:15:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9330000000000007e-06 2024-09-17T18:15:33.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716054+0000", 2024-09-17T18:15:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7929e-05 2024-09-17T18:15:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716071+0000", 2024-09-17T18:15:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6432000000000001e-05 2024-09-17T18:15:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716141+0000", 2024-09-17T18:15:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0223999999999997e-05 2024-09-17T18:15:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716154+0000", 2024-09-17T18:15:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2894000000000001e-05 2024-09-17T18:15:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.cs0 37/31 ECSubWriteReply(tid=33, last_complete=37'17, committed=1, applied=1))", 2024-09-17T18:15:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.716208+0000", 2024-09-17T18:15:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.88817770299999999, 2024-09-17T18:15:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014648600000000001, 2024-09-17T18:15:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716208+0000", 2024-09-17T18:15:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716208+0000", 2024-09-17T18:15:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716208+0000", 2024-09-17T18:15:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8299999999999995e-07 2024-09-17T18:15:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716214+0000", 2024-09-17T18:15:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9399999999999999e-06 2024-09-17T18:15:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716232+0000", 2024-09-17T18:15:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7846000000000002e-05 2024-09-17T18:15:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716260+0000", 2024-09-17T18:15:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7735000000000001e-05 2024-09-17T18:15:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716322+0000", 2024-09-17T18:15:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1996999999999996e-05 2024-09-17T18:15:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.716354+0000", 2024-09-17T18:15:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2085000000000002e-05 2024-09-17T18:15:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as3 37/31 ECSubWrite(tid=101, reqid=client.4565.0:248, at_version=37'25, trim_to=0'0, roll_forward_to=36'23))", 2024-09-17T18:15:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.727701+0000", 2024-09-17T18:15:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.87668374000000004, 2024-09-17T18:15:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016298370000000001, 2024-09-17T18:15:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727701+0000", 2024-09-17T18:15:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727701+0000", 2024-09-17T18:15:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727703+0000", 2024-09-17T18:15:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9929999999999998e-06 2024-09-17T18:15:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727738+0000", 2024-09-17T18:15:33.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4072000000000002e-05 2024-09-17T18:15:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727775+0000", 2024-09-17T18:15:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7373999999999998e-05 2024-09-17T18:15:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727793+0000", 2024-09-17T18:15:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7873999999999999e-05 2024-09-17T18:15:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727893+0000", 2024-09-17T18:15:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9724999999999998e-05 2024-09-17T18:15:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727906+0000", 2024-09-17T18:15:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3246e-05 2024-09-17T18:15:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729222+0000", 2024-09-17T18:15:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013157329999999999 2024-09-17T18:15:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729331+0000", 2024-09-17T18:15:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010982 2024-09-17T18:15:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as3 37/31 ECSubWrite(tid=102, reqid=client.4565.0:249, at_version=37'26, trim_to=0'0, roll_forward_to=36'23))", 2024-09-17T18:15:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.729599+0000", 2024-09-17T18:15:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.87478587600000002, 2024-09-17T18:15:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00113031, 2024-09-17T18:15:33.686 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729599+0000", 2024-09-17T18:15:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729599+0000", 2024-09-17T18:15:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729601+0000", 2024-09-17T18:15:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4529999999999999e-06 2024-09-17T18:15:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729629+0000", 2024-09-17T18:15:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8382e-05 2024-09-17T18:15:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729654+0000", 2024-09-17T18:15:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4561000000000001e-05 2024-09-17T18:15:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729667+0000", 2024-09-17T18:15:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2826000000000001e-05 2024-09-17T18:15:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729743+0000", 2024-09-17T18:15:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6378999999999995e-05 2024-09-17T18:15:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729755+0000", 2024-09-17T18:15:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1598e-05 2024-09-17T18:15:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730687+0000", 2024-09-17T18:15:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00093206400000000003 2024-09-17T18:15:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730730+0000", 2024-09-17T18:15:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3047000000000003e-05 2024-09-17T18:15:33.690 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as3 37/31 ECSubWrite(tid=103, reqid=client.4565.0:250, at_version=37'27, trim_to=0'0, roll_forward_to=36'23))", 2024-09-17T18:15:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.730694+0000", 2024-09-17T18:15:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.87369080499999996, 2024-09-17T18:15:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001000346, 2024-09-17T18:15:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730694+0000", 2024-09-17T18:15:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730694+0000", 2024-09-17T18:15:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730696+0000", 2024-09-17T18:15:33.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2330000000000001e-06 2024-09-17T18:15:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730737+0000", 2024-09-17T18:15:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1156999999999999e-05 2024-09-17T18:15:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730755+0000", 2024-09-17T18:15:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8314000000000001e-05 2024-09-17T18:15:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730768+0000", 2024-09-17T18:15:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2574e-05 2024-09-17T18:15:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730829+0000", 2024-09-17T18:15:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0945e-05 2024-09-17T18:15:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730837+0000", 2024-09-17T18:15:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3620000000000006e-06 2024-09-17T18:15:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.731588+0000", 2024-09-17T18:15:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075134699999999997 2024-09-17T18:15:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.731695+0000", 2024-09-17T18:15:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106414 2024-09-17T18:15:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as3 37/31 ECSubWrite(tid=104, reqid=client.4565.0:250, at_version=0'0, trim_to=0'0, roll_forward_to=37'27))", 2024-09-17T18:15:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.734918+0000", 2024-09-17T18:15:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.86946684799999996, 2024-09-17T18:15:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011044519999999999, 2024-09-17T18:15:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734918+0000", 2024-09-17T18:15:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734918+0000", 2024-09-17T18:15:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734920+0000", 2024-09-17T18:15:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1519999999999999e-06 2024-09-17T18:15:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734935+0000", 2024-09-17T18:15:33.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5569e-05 2024-09-17T18:15:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734965+0000", 2024-09-17T18:15:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9967e-05 2024-09-17T18:15:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734992+0000", 2024-09-17T18:15:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7413999999999999e-05 2024-09-17T18:15:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.735115+0000", 2024-09-17T18:15:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012204 2024-09-17T18:15:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.735127+0000", 2024-09-17T18:15:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2398000000000001e-05 2024-09-17T18:15:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.735985+0000", 2024-09-17T18:15:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00085777599999999998 2024-09-17T18:15:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.736023+0000", 2024-09-17T18:15:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8136000000000002e-05 2024-09-17T18:15:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:33.700 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:33.702 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T18:15:33.702 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:33.695+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:nodeep-scrub is unset 2024-09-17T18:15:33.715 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.3 to 1 (10000) 2024-09-17T18:15:33.723 INFO:tasks.rados.rados.0.smithi154.stdout:98: done (0 left) 2024-09-17T18:15:33.723 INFO:tasks.rados.rados.0.smithi154.stdout:99: read oid 41 snap -1 2024-09-17T18:15:33.723 INFO:tasks.rados.rados.0.smithi154.stdout:99: expect (ObjNum 57 snap 1 seq_num 57) 2024-09-17T18:15:33.723 INFO:tasks.rados.rados.0.smithi154.stdout:100: rmattr oid 33 current snap is 4 2024-09-17T18:15:33.723 INFO:tasks.rados.rados.0.smithi154.stdout:100: done (1 left) 2024-09-17T18:15:33.723 INFO:tasks.rados.rados.0.smithi154.stdout:101: read oid 32 snap -1 2024-09-17T18:15:33.724 INFO:tasks.rados.rados.0.smithi154.stdout:101: expect (ObjNum 31 snap 0 seq_num 31) 2024-09-17T18:15:33.724 INFO:tasks.rados.rados.0.smithi154.stdout:102: copy_from oid 31 from oid 8 current snap is 4 2024-09-17T18:15:33.724 INFO:tasks.rados.rados.0.smithi154.stdout:103: rollback oid 23 current snap is 4 2024-09-17T18:15:33.724 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 23 to 1 2024-09-17T18:15:33.724 INFO:tasks.rados.rados.0.smithi154.stdout:104: snap_create 2024-09-17T18:15:33.731 INFO:tasks.rados.rados.0.smithi154.stdout:103: finishing rollback tid 0 to smithi15432074-23 2024-09-17T18:15:33.735 INFO:tasks.rados.rados.0.smithi154.stdout:101: expect (ObjNum 31 snap 0 seq_num 31) 2024-09-17T18:15:33.735 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:33.749 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-17T18:15:33.751 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:33.762 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:33.774 INFO:tasks.rados.rados.0.smithi154.stdout:103: finishing rollback tid 1 to smithi15432074-23 2024-09-17T18:15:33.774 INFO:tasks.rados.rados.0.smithi154.stdout:103: finishing rollback tid 2 to smithi15432074-23 2024-09-17T18:15:33.775 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 23 v 8 (ObjNum 22 snap 0 seq_num 22) dirty exists 2024-09-17T18:15:33.775 INFO:tasks.rados.rados.0.smithi154.stdout:99: expect (ObjNum 57 snap 1 seq_num 57) 2024-09-17T18:15:33.790 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1072499 2024-09-17T18:15:33.803 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:33.799+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:33.814 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1493647 2024-09-17T18:15:33.817 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 145853 2024-09-17T18:15:33.829 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:33.830 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:15:33.830 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:33.839 INFO:tasks.rados.rados.0.smithi154.stdout:102: finishing copy_from racing read to smithi15432074-31 2024-09-17T18:15:33.839 INFO:tasks.rados.rados.0.smithi154.stdout:102: finishing copy_from to smithi15432074-31 2024-09-17T18:15:33.839 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 31 v 6 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-09-17T18:15:33.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T18:15:33.904 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:33.899+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:34.004 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:34.001+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:34.012 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:15:34.013 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:15:34.013 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:34.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T18:15:34.105 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:34.099+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:34.148 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:34.148 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s3 38/31 ECSubWrite(tid=34, reqid=client.4565.0:261, at_version=38'6, trim_to=0'0, roll_forward_to=36'4))", 2024-09-17T18:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.725299+0000", 2024-09-17T18:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.42323904200000001, 2024-09-17T18:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037175289999999998, 2024-09-17T18:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.725299+0000", 2024-09-17T18:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.725299+0000", 2024-09-17T18:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.725299+0000", 2024-09-17T18:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1199999999999998e-07 2024-09-17T18:15:34.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.725335+0000", 2024-09-17T18:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5617000000000001e-05 2024-09-17T18:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.725352+0000", 2024-09-17T18:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6807e-05 2024-09-17T18:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.725364+0000", 2024-09-17T18:15:34.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2627e-05 2024-09-17T18:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.725527+0000", 2024-09-17T18:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162418 2024-09-17T18:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.725556+0000", 2024-09-17T18:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9675e-05 2024-09-17T18:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728967+0000", 2024-09-17T18:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034109959999999999 2024-09-17T18:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.729016+0000", 2024-09-17T18:15:34.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8977000000000002e-05 2024-09-17T18:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s3 38/31 ECSubWrite(tid=35, reqid=client.4565.0:262, at_version=38'7, trim_to=0'0, roll_forward_to=36'4))", 2024-09-17T18:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.728475+0000", 2024-09-17T18:15:34.154 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.420063046, 2024-09-17T18:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030084389999999999, 2024-09-17T18:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728475+0000", 2024-09-17T18:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728475+0000", 2024-09-17T18:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728493+0000", 2024-09-17T18:15:34.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8193e-05 2024-09-17T18:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728516+0000", 2024-09-17T18:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2662000000000001e-05 2024-09-17T18:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728529+0000", 2024-09-17T18:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2968e-05 2024-09-17T18:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728537+0000", 2024-09-17T18:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2640000000000008e-06 2024-09-17T18:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728604+0000", 2024-09-17T18:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6852000000000003e-05 2024-09-17T18:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728617+0000", 2024-09-17T18:15:34.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3151e-05 2024-09-17T18:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.731422+0000", 2024-09-17T18:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028048840000000001 2024-09-17T18:15:34.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.731483+0000", 2024-09-17T18:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1464999999999995e-05 2024-09-17T18:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.163 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s3 38/31 ECSubWrite(tid=36, reqid=client.4565.0:263, at_version=38'8, trim_to=0'0, roll_forward_to=36'4))", 2024-09-17T18:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.730080+0000", 2024-09-17T18:15:34.164 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.418458096, 2024-09-17T18:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002211911, 2024-09-17T18:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.730080+0000", 2024-09-17T18:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.730080+0000", 2024-09-17T18:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.730081+0000", 2024-09-17T18:15:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.189e-06 2024-09-17T18:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.730108+0000", 2024-09-17T18:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7321000000000002e-05 2024-09-17T18:15:34.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.730130+0000", 2024-09-17T18:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1418999999999999e-05 2024-09-17T18:15:34.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.730143+0000", 2024-09-17T18:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3125000000000001e-05 2024-09-17T18:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.730309+0000", 2024-09-17T18:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016617699999999999 2024-09-17T18:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.730321+0000", 2024-09-17T18:15:34.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2387e-05 2024-09-17T18:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.732255+0000", 2024-09-17T18:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019339540000000001 2024-09-17T18:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.732292+0000", 2024-09-17T18:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6338999999999999e-05 2024-09-17T18:15:34.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s3 38/31 ECSubWrite(tid=37, reqid=client.4565.0:263, at_version=0'0, trim_to=0'0, roll_forward_to=38'8))", 2024-09-17T18:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.733808+0000", 2024-09-17T18:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.41473015699999999, 2024-09-17T18:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001593901, 2024-09-17T18:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.733808+0000", 2024-09-17T18:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.733808+0000", 2024-09-17T18:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.733809+0000", 2024-09-17T18:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2500000000000001e-06 2024-09-17T18:15:34.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.733827+0000", 2024-09-17T18:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8532000000000001e-05 2024-09-17T18:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.733849+0000", 2024-09-17T18:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.194e-05 2024-09-17T18:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.733862+0000", 2024-09-17T18:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2122e-05 2024-09-17T18:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.733953+0000", 2024-09-17T18:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1100000000000005e-05 2024-09-17T18:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.733968+0000", 2024-09-17T18:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5268e-05 2024-09-17T18:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.735353+0000", 2024-09-17T18:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001385414 2024-09-17T18:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.735402+0000", 2024-09-17T18:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8275000000000001e-05 2024-09-17T18:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.178 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.179 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:34.180 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T18:15:34.206 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:34.202+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:34.304 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:34.305 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:15:34.305 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:34.307 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:34.305+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:34.318 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T18:15:34.408 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:34.403+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:34.439 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:34.439 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:15:34.440 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:15:34.440 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:34.440 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T18:15:34.453 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T18:15:34.509 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:34.503+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:34.575 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:15:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:15:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:15:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.576 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4341.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-17T18:15:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:14.589675+0000", 2024-09-17T18:15:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.982605537000001, 2024-09-17T18:15:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042949549999999996, 2024-09-17T18:15:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.577 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4341", 2024-09-17T18:15:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.87:0/844060755", 2024-09-17T18:15:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2 2024-09-17T18:15:34.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589675+0000", 2024-09-17T18:15:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589675+0000", 2024-09-17T18:15:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589677+0000", 2024-09-17T18:15:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4030000000000001e-06 2024-09-17T18:15:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589689+0000", 2024-09-17T18:15:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1453e-05 2024-09-17T18:15:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589710+0000", 2024-09-17T18:15:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1005e-05 2024-09-17T18:15:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589733+0000", 2024-09-17T18:15:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2951000000000001e-05 2024-09-17T18:15:34.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589824+0000", 2024-09-17T18:15:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1292999999999995e-05 2024-09-17T18:15:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-17T18:15:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.589832+0000", 2024-09-17T18:15:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4589999999999998e-06 2024-09-17T18:15:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.593651+0000", 2024-09-17T18:15:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038184740000000001 2024-09-17T18:15:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:14.593970+0000", 2024-09-17T18:15:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000318917 2024-09-17T18:15:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.585 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4341.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-17T18:15:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:15.593080+0000", 2024-09-17T18:15:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.979200083999999, 2024-09-17T18:15:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085923119999999995, 2024-09-17T18:15:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4341", 2024-09-17T18:15:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.87:0/844060755", 2024-09-17T18:15:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 5 2024-09-17T18:15:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593080+0000", 2024-09-17T18:15:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593080+0000", 2024-09-17T18:15:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593094+0000", 2024-09-17T18:15:34.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3369e-05 2024-09-17T18:15:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593124+0000", 2024-09-17T18:15:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0443999999999999e-05 2024-09-17T18:15:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593168+0000", 2024-09-17T18:15:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4299999999999999e-05 2024-09-17T18:15:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593188+0000", 2024-09-17T18:15:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9235000000000001e-05 2024-09-17T18:15:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593430+0000", 2024-09-17T18:15:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000242267 2024-09-17T18:15:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:15:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.593449+0000", 2024-09-17T18:15:34.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8692e-05 2024-09-17T18:15:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.597551+0000", 2024-09-17T18:15:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041025549999999999 2024-09-17T18:15:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.597784+0000", 2024-09-17T18:15:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023263099999999999 2024-09-17T18:15:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 12", 2024-09-17T18:15:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.598048+0000", 2024-09-17T18:15:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000264515 2024-09-17T18:15:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-17T18:15:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.599628+0000", 2024-09-17T18:15:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015802310000000001 2024-09-17T18:15:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.601515+0000", 2024-09-17T18:15:34.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001886432 2024-09-17T18:15:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.601610+0000", 2024-09-17T18:15:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4819000000000001e-05 2024-09-17T18:15:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:15.601673+0000", 2024-09-17T18:15:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2822000000000003e-05 2024-09-17T18:15:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4341.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-17T18:15:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:16.614267+0000", 2024-09-17T18:15:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.958013301000001, 2024-09-17T18:15:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013420657000000001, 2024-09-17T18:15:34.593 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4341", 2024-09-17T18:15:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.87:0/844060755", 2024-09-17T18:15:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7 2024-09-17T18:15:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614267+0000", 2024-09-17T18:15:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614267+0000", 2024-09-17T18:15:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614270+0000", 2024-09-17T18:15:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6929999999999999e-06 2024-09-17T18:15:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614283+0000", 2024-09-17T18:15:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2986000000000001e-05 2024-09-17T18:15:34.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614316+0000", 2024-09-17T18:15:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3481e-05 2024-09-17T18:15:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614335+0000", 2024-09-17T18:15:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9088000000000001e-05 2024-09-17T18:15:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614487+0000", 2024-09-17T18:15:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015212400000000001 2024-09-17T18:15:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:15:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.614498+0000", 2024-09-17T18:15:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.112e-05 2024-09-17T18:15:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.618395+0000", 2024-09-17T18:15:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038966130000000002 2024-09-17T18:15:34.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.618540+0000", 2024-09-17T18:15:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144902 2024-09-17T18:15:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 12", 2024-09-17T18:15:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.618745+0000", 2024-09-17T18:15:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020472700000000001 2024-09-17T18:15:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.621296+0000", 2024-09-17T18:15:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025509529999999999 2024-09-17T18:15:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-17T18:15:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.627523+0000", 2024-09-17T18:15:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062271490000000004 2024-09-17T18:15:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.627617+0000", 2024-09-17T18:15:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4133000000000002e-05 2024-09-17T18:15:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:16.627688+0000", 2024-09-17T18:15:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0687999999999998e-05 2024-09-17T18:15:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.cs2 37/31 ECSubWrite(tid=30, reqid=client.4565.0:241, at_version=37'15, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:15:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.705163+0000", 2024-09-17T18:15:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.8671177889999999, 2024-09-17T18:15:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020480160000000002, 2024-09-17T18:15:34.601 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.705163+0000", 2024-09-17T18:15:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.705163+0000", 2024-09-17T18:15:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.705163+0000", 2024-09-17T18:15:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6199999999999998e-07 2024-09-17T18:15:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.705194+0000", 2024-09-17T18:15:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0602000000000003e-05 2024-09-17T18:15:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.705209+0000", 2024-09-17T18:15:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5773999999999998e-05 2024-09-17T18:15:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.705222+0000", 2024-09-17T18:15:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2308e-05 2024-09-17T18:15:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.705319+0000", 2024-09-17T18:15:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7597999999999996e-05 2024-09-17T18:15:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.705333+0000", 2024-09-17T18:15:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3491e-05 2024-09-17T18:15:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707163+0000", 2024-09-17T18:15:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001830414 2024-09-17T18:15:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707211+0000", 2024-09-17T18:15:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7367000000000002e-05 2024-09-17T18:15:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.cs2 37/31 ECSubWrite(tid=31, reqid=client.4565.0:242, at_version=37'16, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:15:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.706637+0000", 2024-09-17T18:15:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.8656433859999999, 2024-09-17T18:15:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002967707, 2024-09-17T18:15:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.606 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.706637+0000", 2024-09-17T18:15:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.706637+0000", 2024-09-17T18:15:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.706638+0000", 2024-09-17T18:15:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.198e-06 2024-09-17T18:15:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.706662+0000", 2024-09-17T18:15:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3805999999999999e-05 2024-09-17T18:15:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.706693+0000", 2024-09-17T18:15:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1115999999999998e-05 2024-09-17T18:15:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.706703+0000", 2024-09-17T18:15:34.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0071999999999999e-05 2024-09-17T18:15:34.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.706766+0000", 2024-09-17T18:15:34.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2942999999999997e-05 2024-09-17T18:15:34.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:34.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.706778+0000", 2024-09-17T18:15:34.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.199e-05 2024-09-17T18:15:34.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:34.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.709563+0000", 2024-09-17T18:15:34.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027849200000000002 2024-09-17T18:15:34.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.709605+0000", 2024-09-17T18:15:34.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1662000000000002e-05 2024-09-17T18:15:34.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.610 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.611 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.cs2 37/31 ECSubWrite(tid=32, reqid=client.4565.0:243, at_version=37'17, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:15:34.611 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.707632+0000", 2024-09-17T18:15:34.611 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.8646485880000001, 2024-09-17T18:15:34.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020034200000000001, 2024-09-17T18:15:34.611 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.611 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.611 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:34.611 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707632+0000", 2024-09-17T18:15:34.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707632+0000", 2024-09-17T18:15:34.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707633+0000", 2024-09-17T18:15:34.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9099999999999991e-07 2024-09-17T18:15:34.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707652+0000", 2024-09-17T18:15:34.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8978e-05 2024-09-17T18:15:34.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707664+0000", 2024-09-17T18:15:34.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1948e-05 2024-09-17T18:15:34.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707679+0000", 2024-09-17T18:15:34.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4899000000000001e-05 2024-09-17T18:15:34.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708004+0000", 2024-09-17T18:15:34.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032520200000000002 2024-09-17T18:15:34.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:34.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708019+0000", 2024-09-17T18:15:34.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5191000000000001e-05 2024-09-17T18:15:34.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:34.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.709611+0000", 2024-09-17T18:15:34.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015916579999999999 2024-09-17T18:15:34.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.709635+0000", 2024-09-17T18:15:34.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4553e-05 2024-09-17T18:15:34.615 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.615 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.615 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.615 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:248 3.as0 3:52022904:::smithi15432074-17:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-17T18:15:34.616 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.726333+0000", 2024-09-17T18:15:34.616 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.8459473960000001, 2024-09-17T18:15:34.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068798180000000002, 2024-09-17T18:15:34.616 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.616 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.616 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:34.616 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:34.616 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:34.616 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:34.616 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 248 2024-09-17T18:15:34.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.616 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726333+0000", 2024-09-17T18:15:34.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726333+0000", 2024-09-17T18:15:34.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726335+0000", 2024-09-17T18:15:34.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4320000000000002e-06 2024-09-17T18:15:34.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726347+0000", 2024-09-17T18:15:34.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1715999999999999e-05 2024-09-17T18:15:34.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726372+0000", 2024-09-17T18:15:34.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4632000000000001e-05 2024-09-17T18:15:34.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726387+0000", 2024-09-17T18:15:34.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4864e-05 2024-09-17T18:15:34.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726500+0000", 2024-09-17T18:15:34.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113497 2024-09-17T18:15:34.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:34.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726650+0000", 2024-09-17T18:15:34.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149801 2024-09-17T18:15:34.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:34.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.727685+0000", 2024-09-17T18:15:34.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010352969999999999 2024-09-17T18:15:34.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:34.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730856+0000", 2024-09-17T18:15:34.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031707150000000002 2024-09-17T18:15:34.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:34.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.733086+0000", 2024-09-17T18:15:34.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022300670000000001 2024-09-17T18:15:34.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.733213+0000", 2024-09-17T18:15:34.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126797 2024-09-17T18:15:34.621 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.621 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.621 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.622 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:249 3.as0 3:52022904:::smithi15432074-17:head [rollback 2] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-17T18:15:34.622 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.726413+0000", 2024-09-17T18:15:34.622 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.8458673320000001, 2024-09-17T18:15:34.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078380050000000003, 2024-09-17T18:15:34.622 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.622 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.622 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:34.622 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:34.622 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:34.622 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:34.622 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 249 2024-09-17T18:15:34.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.622 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726413+0000", 2024-09-17T18:15:34.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726413+0000", 2024-09-17T18:15:34.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726414+0000", 2024-09-17T18:15:34.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7899999999999998e-07 2024-09-17T18:15:34.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726425+0000", 2024-09-17T18:15:34.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1742999999999999e-05 2024-09-17T18:15:34.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726436+0000", 2024-09-17T18:15:34.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0696999999999999e-05 2024-09-17T18:15:34.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726442+0000", 2024-09-17T18:15:34.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5650000000000001e-06 2024-09-17T18:15:34.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.728570+0000", 2024-09-17T18:15:34.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002128408 2024-09-17T18:15:34.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:34.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.728705+0000", 2024-09-17T18:15:34.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000134652 2024-09-17T18:15:34.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:34.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729402+0000", 2024-09-17T18:15:34.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00069745300000000001 2024-09-17T18:15:34.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:34.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730860+0000", 2024-09-17T18:15:34.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014582359999999999 2024-09-17T18:15:34.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:34.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734117+0000", 2024-09-17T18:15:34.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032570619999999998 2024-09-17T18:15:34.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734251+0000", 2024-09-17T18:15:34.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013350999999999999 2024-09-17T18:15:34.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.627 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.628 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:250 3.as0 3:52022904:::smithi15432074-17:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-17T18:15:34.628 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.726481+0000", 2024-09-17T18:15:34.628 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.8457994960000002, 2024-09-17T18:15:34.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080835300000000002, 2024-09-17T18:15:34.628 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.628 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.628 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:34.628 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:34.628 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:34.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:34.629 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 250 2024-09-17T18:15:34.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.629 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726481+0000", 2024-09-17T18:15:34.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726481+0000", 2024-09-17T18:15:34.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726481+0000", 2024-09-17T18:15:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1500000000000004e-07 2024-09-17T18:15:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726485+0000", 2024-09-17T18:15:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.106e-06 2024-09-17T18:15:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726495+0000", 2024-09-17T18:15:34.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0047000000000001e-05 2024-09-17T18:15:34.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.726501+0000", 2024-09-17T18:15:34.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2450000000000003e-06 2024-09-17T18:15:34.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729818+0000", 2024-09-17T18:15:34.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033176220000000001 2024-09-17T18:15:34.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.729933+0000", 2024-09-17T18:15:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114764 2024-09-17T18:15:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:34.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.730536+0000", 2024-09-17T18:15:34.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00060256800000000005 2024-09-17T18:15:34.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:34.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.731326+0000", 2024-09-17T18:15:34.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000790633 2024-09-17T18:15:34.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:34.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734403+0000", 2024-09-17T18:15:34.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030768179999999998 2024-09-17T18:15:34.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.734564+0000", 2024-09-17T18:15:34.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016111200000000001 2024-09-17T18:15:34.637 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.637 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.637 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.637 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:253 3.ds0 3:b554fbc1:::smithi15432074-41:head [read 1072499~582285,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:15:34.637 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.723587+0000", 2024-09-17T18:15:34.637 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.84869315499999998, 2024-09-17T18:15:34.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0098759060000000003, 2024-09-17T18:15:34.638 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.638 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.638 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:34.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:34.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:34.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:34.639 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 253 2024-09-17T18:15:34.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.639 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723587+0000", 2024-09-17T18:15:34.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723587+0000", 2024-09-17T18:15:34.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723589+0000", 2024-09-17T18:15:34.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2800000000000002e-06 2024-09-17T18:15:34.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723600+0000", 2024-09-17T18:15:34.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0084999999999999e-05 2024-09-17T18:15:34.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723625+0000", 2024-09-17T18:15:34.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5207000000000001e-05 2024-09-17T18:15:34.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723641+0000", 2024-09-17T18:15:34.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5834000000000001e-05 2024-09-17T18:15:34.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723818+0000", 2024-09-17T18:15:34.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000177818 2024-09-17T18:15:34.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:15:34.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723839+0000", 2024-09-17T18:15:34.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0152e-05 2024-09-17T18:15:34.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.727953+0000", 2024-09-17T18:15:34.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041140500000000002 2024-09-17T18:15:34.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:34.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728041+0000", 2024-09-17T18:15:34.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8813000000000005e-05 2024-09-17T18:15:34.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.733463+0000", 2024-09-17T18:15:34.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054216669999999998 2024-09-17T18:15:34.646 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.647 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.647 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:254 3.ds0 3:b554fbc1:::smithi15432074-41:head [read 1493647~161137,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:15:34.647 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.723676+0000", 2024-09-17T18:15:34.647 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.84860388799999997, 2024-09-17T18:15:34.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01067107, 2024-09-17T18:15:34.647 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.647 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.647 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:34.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:34.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:34.648 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:34.648 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 254 2024-09-17T18:15:34.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.648 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723676+0000", 2024-09-17T18:15:34.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723676+0000", 2024-09-17T18:15:34.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723677+0000", 2024-09-17T18:15:34.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7300000000000004e-07 2024-09-17T18:15:34.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723683+0000", 2024-09-17T18:15:34.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4890000000000003e-06 2024-09-17T18:15:34.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723696+0000", 2024-09-17T18:15:34.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2680999999999999e-05 2024-09-17T18:15:34.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723704+0000", 2024-09-17T18:15:34.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5040000000000002e-06 2024-09-17T18:15:34.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.724004+0000", 2024-09-17T18:15:34.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000299461 2024-09-17T18:15:34.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:34.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.724020+0000", 2024-09-17T18:15:34.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6129000000000001e-05 2024-09-17T18:15:34.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.729075+0000", 2024-09-17T18:15:34.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050550170000000002 2024-09-17T18:15:34.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:34.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.729291+0000", 2024-09-17T18:15:34.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021584299999999999 2024-09-17T18:15:34.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.734347+0000", 2024-09-17T18:15:34.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050569730000000002 2024-09-17T18:15:34.652 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.652 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.652 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.653 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:255 3.ds0 3:b554fbc1:::smithi15432074-41:head [read 145853~1508931,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:15:34.653 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.723781+0000", 2024-09-17T18:15:34.653 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.84849932299999997, 2024-09-17T18:15:34.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013749413, 2024-09-17T18:15:34.653 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.653 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.653 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:34.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:34.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:34.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:34.653 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 255 2024-09-17T18:15:34.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.654 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723781+0000", 2024-09-17T18:15:34.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723781+0000", 2024-09-17T18:15:34.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723782+0000", 2024-09-17T18:15:34.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.02e-07 2024-09-17T18:15:34.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723788+0000", 2024-09-17T18:15:34.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0220000000000001e-06 2024-09-17T18:15:34.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723800+0000", 2024-09-17T18:15:34.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2072000000000001e-05 2024-09-17T18:15:34.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.723808+0000", 2024-09-17T18:15:34.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5189999999999992e-06 2024-09-17T18:15:34.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.724453+0000", 2024-09-17T18:15:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00064416199999999999 2024-09-17T18:15:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.724468+0000", 2024-09-17T18:15:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5622999999999999e-05 2024-09-17T18:15:34.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.732425+0000", 2024-09-17T18:15:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007957123 2024-09-17T18:15:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:34.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.732520+0000", 2024-09-17T18:15:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4990999999999999e-05 2024-09-17T18:15:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.737530+0000", 2024-09-17T18:15:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050099990000000002 2024-09-17T18:15:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(osd.14.23:1 3.ds0 3:b7c9c934:::smithi15432074-8:head [assert-version v6,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:15:34.660 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.727021+0000", 2024-09-17T18:15:34.660 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.84525909899999996, 2024-09-17T18:15:34.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049299610000000001, 2024-09-17T18:15:34.660 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.660 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.660 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:34.660 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.727021+0000", 2024-09-17T18:15:34.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.727021+0000", 2024-09-17T18:15:34.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.727023+0000", 2024-09-17T18:15:34.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.891e-06 2024-09-17T18:15:34.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.727029+0000", 2024-09-17T18:15:34.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2979999999999997e-06 2024-09-17T18:15:34.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.727042+0000", 2024-09-17T18:15:34.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2354000000000001e-05 2024-09-17T18:15:34.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.727051+0000", 2024-09-17T18:15:34.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9439999999999994e-06 2024-09-17T18:15:34.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.727319+0000", 2024-09-17T18:15:34.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026861099999999998 2024-09-17T18:15:34.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:34.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.727393+0000", 2024-09-17T18:15:34.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3965000000000001e-05 2024-09-17T18:15:34.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.731951+0000", 2024-09-17T18:15:34.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045578980000000003 2024-09-17T18:15:34.664 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.664 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.664 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.665 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpRead(3.ds0 38/31 ECSubRead(tid=106, to_read={3:b554fbc1:::smithi15432074-41:head=266240,147456,0}, subchunks={3:b554fbc1:::smithi15432074-41:head=[0,1]}, attrs_to_read=))", 2024-09-17T18:15:34.665 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.728297+0000", 2024-09-17T18:15:34.665 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.84398306000000001, 2024-09-17T18:15:34.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002546034, 2024-09-17T18:15:34.665 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.665 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.665 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:34.665 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728297+0000", 2024-09-17T18:15:34.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728297+0000", 2024-09-17T18:15:34.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728297+0000", 2024-09-17T18:15:34.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728297+0000", 2024-09-17T18:15:34.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728538+0000", 2024-09-17T18:15:34.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024120500000000001 2024-09-17T18:15:34.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728549+0000", 2024-09-17T18:15:34.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0304e-05 2024-09-17T18:15:34.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.730167+0000", 2024-09-17T18:15:34.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016179040000000001 2024-09-17T18:15:34.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.730843+0000", 2024-09-17T18:15:34.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00067662099999999997 2024-09-17T18:15:34.668 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.668 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.669 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.669 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.ds0 38/31 ECSubReadReply(tid=105, attrs_read=0))", 2024-09-17T18:15:34.669 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.728903+0000", 2024-09-17T18:15:34.669 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.84337710899999996, 2024-09-17T18:15:34.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022314930000000002, 2024-09-17T18:15:34.669 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.669 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.669 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:34.669 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728903+0000", 2024-09-17T18:15:34.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728903+0000", 2024-09-17T18:15:34.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728903+0000", 2024-09-17T18:15:34.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728903+0000", 2024-09-17T18:15:34.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728954+0000", 2024-09-17T18:15:34.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1087000000000001e-05 2024-09-17T18:15:34.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728963+0000", 2024-09-17T18:15:34.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0059999999999998e-06 2024-09-17T18:15:34.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.730904+0000", 2024-09-17T18:15:34.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001940762 2024-09-17T18:15:34.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.731135+0000", 2024-09-17T18:15:34.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000230638 2024-09-17T18:15:34.672 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.672 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.673 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.673 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.ds0 38/31 ECSubReadReply(tid=105, attrs_read=0))", 2024-09-17T18:15:34.673 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.729923+0000", 2024-09-17T18:15:34.673 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.84235728399999998, 2024-09-17T18:15:34.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020451190000000002, 2024-09-17T18:15:34.673 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.673 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.673 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:34.673 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.729923+0000", 2024-09-17T18:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.729923+0000", 2024-09-17T18:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.729924+0000", 2024-09-17T18:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8999999999999995e-07 2024-09-17T18:15:34.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.730047+0000", 2024-09-17T18:15:34.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000123564 2024-09-17T18:15:34.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.730062+0000", 2024-09-17T18:15:34.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4080000000000001e-05 2024-09-17T18:15:34.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.730081+0000", 2024-09-17T18:15:34.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9629000000000001e-05 2024-09-17T18:15:34.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.731540+0000", 2024-09-17T18:15:34.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014590040000000001 2024-09-17T18:15:34.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.731968+0000", 2024-09-17T18:15:34.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000427952 2024-09-17T18:15:34.676 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.676 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.677 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.677 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.ds0 38/31 ECSubReadReply(tid=106, attrs_read=0))", 2024-09-17T18:15:34.677 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.731557+0000", 2024-09-17T18:15:34.677 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.84072313899999995, 2024-09-17T18:15:34.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019312520000000001, 2024-09-17T18:15:34.677 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.677 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.677 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:34.677 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.731557+0000", 2024-09-17T18:15:34.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.731557+0000", 2024-09-17T18:15:34.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.731558+0000", 2024-09-17T18:15:34.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3500000000000005e-07 2024-09-17T18:15:34.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.732537+0000", 2024-09-17T18:15:34.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00097899100000000002 2024-09-17T18:15:34.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.732558+0000", 2024-09-17T18:15:34.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0769000000000001e-05 2024-09-17T18:15:34.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.732573+0000", 2024-09-17T18:15:34.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5532999999999998e-05 2024-09-17T18:15:34.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.732893+0000", 2024-09-17T18:15:34.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000319764 2024-09-17T18:15:34.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.733488+0000", 2024-09-17T18:15:34.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00059526000000000002 2024-09-17T18:15:34.680 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpRead(3.ds0 38/31 ECSubRead(tid=108, to_read={3:b554fbc1:::smithi15432074-41:head=32768,380928,0}, subchunks={3:b554fbc1:::smithi15432074-41:head=[0,1]}, attrs_to_read=))", 2024-09-17T18:15:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.732780+0000", 2024-09-17T18:15:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.83950047999999999, 2024-09-17T18:15:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003408023, 2024-09-17T18:15:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.732780+0000", 2024-09-17T18:15:34.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.732780+0000", 2024-09-17T18:15:34.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.732780+0000", 2024-09-17T18:15:34.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.732780+0000", 2024-09-17T18:15:34.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.732828+0000", 2024-09-17T18:15:34.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8649000000000001e-05 2024-09-17T18:15:34.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.732842+0000", 2024-09-17T18:15:34.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3784000000000001e-05 2024-09-17T18:15:34.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.734514+0000", 2024-09-17T18:15:34.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001671818 2024-09-17T18:15:34.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.736188+0000", 2024-09-17T18:15:34.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001673772 2024-09-17T18:15:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(osd.14.23:1 3.ds0 3:b7c9c934:::smithi15432074-8:head [assert-version v6,copy-get max 8388608] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:15:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.734251+0000", 2024-09-17T18:15:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.83802960299999996, 2024-09-17T18:15:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040853690000000002, 2024-09-17T18:15:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.685 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.734251+0000", 2024-09-17T18:15:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.734251+0000", 2024-09-17T18:15:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.734252+0000", 2024-09-17T18:15:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7540000000000001e-06 2024-09-17T18:15:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.734260+0000", 2024-09-17T18:15:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3209999999999999e-06 2024-09-17T18:15:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.734276+0000", 2024-09-17T18:15:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6606999999999999e-05 2024-09-17T18:15:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.734295+0000", 2024-09-17T18:15:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8473000000000001e-05 2024-09-17T18:15:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.736254+0000", 2024-09-17T18:15:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019596230000000002 2024-09-17T18:15:34.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:34.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.736332+0000", 2024-09-17T18:15:34.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7082000000000005e-05 2024-09-17T18:15:34.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.738336+0000", 2024-09-17T18:15:34.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020045089999999998 2024-09-17T18:15:34.689 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.689 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.689 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.690 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.ds0 38/31 ECSubReadReply(tid=108, attrs_read=0))", 2024-09-17T18:15:34.690 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.734647+0000", 2024-09-17T18:15:34.690 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.83763302100000003, 2024-09-17T18:15:34.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029341279999999998, 2024-09-17T18:15:34.690 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:34.690 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:34.690 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:34.690 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:34.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:34.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.734647+0000", 2024-09-17T18:15:34.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:34.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.734647+0000", 2024-09-17T18:15:34.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:34.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:34.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.734648+0000", 2024-09-17T18:15:34.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.156e-06 2024-09-17T18:15:34.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.735824+0000", 2024-09-17T18:15:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011752449999999999 2024-09-17T18:15:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.735835+0000", 2024-09-17T18:15:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1596e-05 2024-09-17T18:15:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.735841+0000", 2024-09-17T18:15:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3480000000000003e-06 2024-09-17T18:15:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.736896+0000", 2024-09-17T18:15:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010552300000000001 2024-09-17T18:15:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.737581+0000", 2024-09-17T18:15:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00068555299999999999 2024-09-17T18:15:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:34.694 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:34.694 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:34.695 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:15:34.695 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:15:34.696 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:15:34.696 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:15:34.697 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T18:15:34.697 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:15:34.698 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:15:34.698 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:15:34.698 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:15:34.698 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:15:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:15:34.699 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:34.693+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:34.702 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:15:34.702 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:15:34.723 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.4 to 1 (10000) 2024-09-17T18:15:34.727 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:15:34.727 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:15:34.729 INFO:tasks.rados.rados.0.smithi154.stdout:99: done (4 left) 2024-09-17T18:15:34.730 INFO:tasks.rados.rados.0.smithi154.stdout:101: done (3 left) 2024-09-17T18:15:34.730 INFO:tasks.rados.rados.0.smithi154.stdout:102: done (2 left) 2024-09-17T18:15:34.730 INFO:tasks.rados.rados.0.smithi154.stdout:103: done (1 left) 2024-09-17T18:15:34.730 INFO:tasks.rados.rados.0.smithi154.stdout:104: done (0 left) 2024-09-17T18:15:34.730 INFO:tasks.rados.rados.0.smithi154.stdout:105: read oid 42 snap -1 2024-09-17T18:15:34.730 INFO:tasks.rados.rados.0.smithi154.stdout:105: expect deleted 2024-09-17T18:15:34.730 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 27 current snap is 5 2024-09-17T18:15:34.730 INFO:tasks.rados.rados.0.smithi154.stdout:106: seq_num 66 ranges {1441792=737280,2179072=376832} 2024-09-17T18:15:34.744 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-17T18:15:34.748 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:15:34.749 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:15:34.757 INFO:tasks.rados.rados.0.smithi154.stdout:106: writing smithi15432074-27 from 1441792 to 2179072 tid 1 2024-09-17T18:15:34.763 INFO:tasks.rados.rados.0.smithi154.stdout:106: writing smithi15432074-27 from 2179072 to 2555904 tid 2 2024-09-17T18:15:34.763 INFO:tasks.rados.rados.0.smithi154.stdout:107: read oid 25 snap -1 2024-09-17T18:15:34.763 INFO:tasks.rados.rados.0.smithi154.stdout:107: expect (ObjNum 58 snap 1 seq_num 58) 2024-09-17T18:15:34.763 INFO:tasks.rados.rados.0.smithi154.stdout:108: read oid 48 snap -1 2024-09-17T18:15:34.763 INFO:tasks.rados.rados.0.smithi154.stdout:108: expect (ObjNum 47 snap 0 seq_num 47) 2024-09-17T18:15:34.763 INFO:tasks.rados.rados.0.smithi154.stdout:109: read oid 35 snap -1 2024-09-17T18:15:34.763 INFO:tasks.rados.rados.0.smithi154.stdout:109: expect (ObjNum 34 snap 0 seq_num 34) 2024-09-17T18:15:34.764 INFO:tasks.rados.rados.0.smithi154.stdout:110: rollback oid 12 current snap is 5 2024-09-17T18:15:34.764 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 12 to 2 2024-09-17T18:15:34.764 INFO:tasks.rados.rados.0.smithi154.stdout:111: rollback oid 16 current snap is 5 2024-09-17T18:15:34.764 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 16 to 4 2024-09-17T18:15:34.764 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 24 current snap is 5 2024-09-17T18:15:34.764 INFO:tasks.rados.rados.0.smithi154.stdout:112: seq_num 67 ranges {393216=753664,1146880=376832} 2024-09-17T18:15:34.770 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:15:34.770 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:15:34.780 INFO:tasks.rados.rados.0.smithi154.stdout:112: writing smithi15432074-24 from 393216 to 1146880 tid 1 2024-09-17T18:15:34.785 INFO:tasks.rados.rados.0.smithi154.stdout:112: writing smithi15432074-24 from 1146880 to 1523712 tid 2 2024-09-17T18:15:34.786 INFO:tasks.rados.rados.0.smithi154.stdout:113: copy_from oid 34 from oid 29 current snap is 5 2024-09-17T18:15:34.786 INFO:tasks.rados.rados.0.smithi154.stdout:114: rollback oid 11 current snap is 5 2024-09-17T18:15:34.786 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 11 to 3 2024-09-17T18:15:34.786 INFO:tasks.rados.rados.0.smithi154.stdout:115: copy_from oid 22 from oid 41 current snap is 5 2024-09-17T18:15:34.786 INFO:tasks.rados.rados.0.smithi154.stdout:116: delete oid 5 current snap is 5 2024-09-17T18:15:34.787 INFO:tasks.rados.rados.0.smithi154.stdout:111: finishing rollback tid 0 to smithi15432074-16 2024-09-17T18:15:34.787 INFO:tasks.rados.rados.0.smithi154.stdout:111: finishing rollback tid 1 to smithi15432074-16 2024-09-17T18:15:34.787 INFO:tasks.rados.rados.0.smithi154.stdout:111: finishing rollback tid 2 to smithi15432074-16 2024-09-17T18:15:34.787 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 16 v 12 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-09-17T18:15:34.787 INFO:tasks.rados.rados.0.smithi154.stdout:106: finishing write tid 1 to smithi15432074-27 2024-09-17T18:15:34.787 INFO:tasks.rados.rados.0.smithi154.stdout:108: expect (ObjNum 47 snap 0 seq_num 47) 2024-09-17T18:15:34.787 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:34.796 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:34.791+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:34.801 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:15:34.801 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:15:34.807 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:34.823 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:15:34.824 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:15:34.824 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:34.837 INFO:tasks.rados.rados.0.smithi154.stdout:106: finishing write tid 2 to smithi15432074-27 2024-09-17T18:15:34.837 INFO:tasks.rados.rados.0.smithi154.stdout:106: finishing write tid 3 to smithi15432074-27 2024-09-17T18:15:34.837 INFO:tasks.rados.rados.0.smithi154.stdout:110: finishing rollback tid 0 to smithi15432074-12 2024-09-17T18:15:34.837 INFO:tasks.rados.rados.0.smithi154.stdout:110: finishing rollback tid 1 to smithi15432074-12 2024-09-17T18:15:34.837 INFO:tasks.rados.rados.0.smithi154.stdout:110: finishing rollback tid 2 to smithi15432074-12 2024-09-17T18:15:34.837 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 12 v 42 (ObjNum 54 snap 0 seq_num 54) dirty exists 2024-09-17T18:15:34.837 INFO:tasks.rados.rados.0.smithi154.stdout:106: finishing write tid 4 to smithi15432074-27 2024-09-17T18:15:34.838 INFO:tasks.rados.rados.0.smithi154.stdout:106: oid 27 updating version 0 to 19 2024-09-17T18:15:34.838 INFO:tasks.rados.rados.0.smithi154.stdout:106: oid 27 version 19 is already newer than 17 2024-09-17T18:15:34.838 INFO:tasks.rados.rados.0.smithi154.stdout:106: oid 27 version 19 is already newer than 18 2024-09-17T18:15:34.838 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 27 v 19 (ObjNum 66 snap 5 seq_num 66) dirty exists 2024-09-17T18:15:34.838 INFO:tasks.rados.rados.0.smithi154.stdout:106: left oid 27 (ObjNum 66 snap 5 seq_num 66) 2024-09-17T18:15:34.838 INFO:tasks.rados.rados.0.smithi154.stdout:109: expect (ObjNum 34 snap 0 seq_num 34) 2024-09-17T18:15:34.838 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 175521 2024-09-17T18:15:34.840 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:34.840 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:34.843 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:15:34.843 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:15:34.844 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:34.851 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 3098 2024-09-17T18:15:34.854 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T18:15:34.858 INFO:tasks.rados.rados.0.smithi154.stdout:107: expect (ObjNum 58 snap 1 seq_num 58) 2024-09-17T18:15:34.860 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:15:34.861 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:15:34.866 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1188881 2024-09-17T18:15:34.868 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:34.881 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:15:34.881 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:15:34.884 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:34.897 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:34.894+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:34.900 INFO:tasks.rados.rados.0.smithi154.stdout:114: finishing rollback tid 0 to smithi15432074-11 2024-09-17T18:15:34.901 INFO:tasks.rados.rados.0.smithi154.stdout:112: finishing write tid 1 to smithi15432074-24 2024-09-17T18:15:34.901 INFO:tasks.rados.rados.0.smithi154.stdout:114: finishing rollback tid 1 to smithi15432074-11 2024-09-17T18:15:34.901 INFO:tasks.rados.rados.0.smithi154.stdout:114: finishing rollback tid 2 to smithi15432074-11 2024-09-17T18:15:34.901 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 11 v 31 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-09-17T18:15:34.901 INFO:tasks.rados.rados.0.smithi154.stdout:112: finishing write tid 2 to smithi15432074-24 2024-09-17T18:15:34.901 INFO:tasks.rados.rados.0.smithi154.stdout:112: finishing write tid 3 to smithi15432074-24 2024-09-17T18:15:34.901 INFO:tasks.rados.rados.0.smithi154.stdout:112: finishing write tid 4 to smithi15432074-24 2024-09-17T18:15:34.901 INFO:tasks.rados.rados.0.smithi154.stdout:112: oid 24 updating version 0 to 17 2024-09-17T18:15:34.901 INFO:tasks.rados.rados.0.smithi154.stdout:112: oid 24 updating version 17 to 19 2024-09-17T18:15:34.901 INFO:tasks.rados.rados.0.smithi154.stdout:112: oid 24 version 19 is already newer than 18 2024-09-17T18:15:34.901 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 24 v 19 (ObjNum 67 snap 5 seq_num 67) dirty exists 2024-09-17T18:15:34.901 INFO:tasks.rados.rados.0.smithi154.stdout:112: left oid 24 (ObjNum 67 snap 5 seq_num 67) 2024-09-17T18:15:34.901 INFO:tasks.rados.rados.0.smithi154.stdout:115: finishing copy_from racing read to smithi15432074-22 2024-09-17T18:15:34.902 INFO:tasks.rados.rados.0.smithi154.stdout:113: finishing copy_from racing read to smithi15432074-34 2024-09-17T18:15:34.902 INFO:tasks.rados.rados.0.smithi154.stdout:115: finishing copy_from to smithi15432074-22 2024-09-17T18:15:34.902 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 22 v 32 (ObjNum 57 snap 1 seq_num 57) dirty exists 2024-09-17T18:15:34.902 INFO:tasks.rados.rados.0.smithi154.stdout:113: finishing copy_from to smithi15432074-34 2024-09-17T18:15:34.902 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 34 v 2 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-09-17T18:15:34.902 INFO:tasks.rados.rados.0.smithi154.stdout:105: done (11 left) 2024-09-17T18:15:34.902 INFO:tasks.rados.rados.0.smithi154.stdout:106: done (10 left) 2024-09-17T18:15:34.902 INFO:tasks.rados.rados.0.smithi154.stdout:107: done (9 left) 2024-09-17T18:15:34.902 INFO:tasks.rados.rados.0.smithi154.stdout:108: done (8 left) 2024-09-17T18:15:34.902 INFO:tasks.rados.rados.0.smithi154.stdout:109: done (7 left) 2024-09-17T18:15:34.902 INFO:tasks.rados.rados.0.smithi154.stdout:110: done (6 left) 2024-09-17T18:15:34.902 INFO:tasks.rados.rados.0.smithi154.stdout:111: done (5 left) 2024-09-17T18:15:34.902 INFO:tasks.rados.rados.0.smithi154.stdout:112: done (4 left) 2024-09-17T18:15:34.902 INFO:tasks.rados.rados.0.smithi154.stdout:113: done (3 left) 2024-09-17T18:15:34.903 INFO:tasks.rados.rados.0.smithi154.stdout:114: done (2 left) 2024-09-17T18:15:34.903 INFO:tasks.rados.rados.0.smithi154.stdout:115: done (1 left) 2024-09-17T18:15:34.903 INFO:tasks.rados.rados.0.smithi154.stdout:116: done (0 left) 2024-09-17T18:15:34.903 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 13 current snap is 5 2024-09-17T18:15:34.903 INFO:tasks.rados.rados.0.smithi154.stdout:117: seq_num 69 ranges {212992=786432,999424=376832} 2024-09-17T18:15:34.903 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:15:34.904 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:15:34.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:15:34.898+0000 7fc1b37fe640 0 -- 172.21.15.87:0/469152557 >> [v2:172.21.15.154:6824/3670919160,v1:172.21.15.154:6825/3670919160] conn(0x7fc1b4220aa0 msgr2=0x7fc1b4222e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T18:15:34.916 INFO:tasks.rados.rados.0.smithi154.stdout:117: writing smithi15432074-13 from 212992 to 999424 tid 1 2024-09-17T18:15:34.923 INFO:tasks.rados.rados.0.smithi154.stdout:117: writing smithi15432074-13 from 999424 to 1376256 tid 2 2024-09-17T18:15:34.923 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 50 current snap is 5 2024-09-17T18:15:34.923 INFO:tasks.rados.rados.0.smithi154.stdout:118: seq_num 70 ranges {835584=802816,1638400=376832} 2024-09-17T18:15:34.948 INFO:tasks.rados.rados.0.smithi154.stdout:118: writing smithi15432074-50 from 835584 to 1638400 tid 1 2024-09-17T18:15:34.953 INFO:tasks.rados.rados.0.smithi154.stdout:118: writing smithi15432074-50 from 1638400 to 2015232 tid 2 2024-09-17T18:15:34.954 INFO:tasks.rados.rados.0.smithi154.stdout:119: rmattr oid 7 current snap is 5 2024-09-17T18:15:34.954 INFO:tasks.rados.rados.0.smithi154.stdout:117: finishing write tid 1 to smithi15432074-13 2024-09-17T18:15:34.954 INFO:tasks.rados.rados.0.smithi154.stdout:117: finishing write tid 2 to smithi15432074-13 2024-09-17T18:15:34.954 INFO:tasks.rados.rados.0.smithi154.stdout:117: finishing write tid 3 to smithi15432074-13 2024-09-17T18:15:34.954 INFO:tasks.rados.rados.0.smithi154.stdout:117: finishing write tid 4 to smithi15432074-13 2024-09-17T18:15:34.954 INFO:tasks.rados.rados.0.smithi154.stdout:117: oid 13 updating version 0 to 8 2024-09-17T18:15:34.954 INFO:tasks.rados.rados.0.smithi154.stdout:117: oid 13 updating version 8 to 9 2024-09-17T18:15:34.954 INFO:tasks.rados.rados.0.smithi154.stdout:117: oid 13 updating version 9 to 10 2024-09-17T18:15:34.954 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 13 v 10 (ObjNum 69 snap 5 seq_num 69) dirty exists 2024-09-17T18:15:34.954 INFO:tasks.rados.rados.0.smithi154.stdout:117: left oid 13 (ObjNum 69 snap 5 seq_num 69) 2024-09-17T18:15:34.954 INFO:tasks.rados.rados.0.smithi154.stdout:117: done (2 left) 2024-09-17T18:15:34.954 INFO:tasks.rados.rados.0.smithi154.stdout:120: rollback oid 10 current snap is 5 2024-09-17T18:15:34.955 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 10 to 1 2024-09-17T18:15:34.955 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 37 current snap is 5 2024-09-17T18:15:34.955 INFO:tasks.rados.rados.0.smithi154.stdout:121: seq_num 71 ranges {606208=425984,1032192=573440,1605632=196608} 2024-09-17T18:15:34.966 INFO:tasks.rados.rados.0.smithi154.stdout:121: writing smithi15432074-37 from 606208 to 1032192 tid 1 2024-09-17T18:15:34.972 INFO:tasks.rados.rados.0.smithi154.stdout:121: writing smithi15432074-37 from 1032192 to 1605632 tid 2 2024-09-17T18:15:34.974 INFO:tasks.rados.rados.0.smithi154.stdout:121: writing smithi15432074-37 from 1605632 to 1802240 tid 3 2024-09-17T18:15:34.974 INFO:tasks.rados.rados.0.smithi154.stdout:122: copy_from oid 20 from oid 12 current snap is 5 2024-09-17T18:15:34.975 INFO:tasks.rados.rados.0.smithi154.stdout:118: finishing write tid 1 to smithi15432074-50 2024-09-17T18:15:34.975 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 18 current snap is 5 2024-09-17T18:15:34.975 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 7 v 22 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-09-17T18:15:34.975 INFO:tasks.rados.rados.0.smithi154.stdout:120: finishing rollback tid 0 to smithi15432074-10 2024-09-17T18:15:34.975 INFO:tasks.rados.rados.0.smithi154.stdout:118: finishing write tid 2 to smithi15432074-50 2024-09-17T18:15:34.975 INFO:tasks.rados.rados.0.smithi154.stdout:123: seq_num 72 ranges {442368=442368,884736=720896,1605632=49152} 2024-09-17T18:15:34.980 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:34.981 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:34.981 INFO:tasks.rados.rados.0.smithi154.stdout:123: writing smithi15432074-18 from 442368 to 884736 tid 1 2024-09-17T18:15:34.988 INFO:tasks.rados.rados.0.smithi154.stdout:123: writing smithi15432074-18 from 884736 to 1605632 tid 2 2024-09-17T18:15:34.989 INFO:tasks.rados.rados.0.smithi154.stdout:123: writing smithi15432074-18 from 1605632 to 1654784 tid 3 2024-09-17T18:15:34.989 INFO:tasks.rados.rados.0.smithi154.stdout:119: done (5 left) 2024-09-17T18:15:34.989 INFO:tasks.rados.rados.0.smithi154.stdout:124: read oid 47 snap 2 2024-09-17T18:15:34.990 INFO:tasks.rados.rados.0.smithi154.stdout:124: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-17T18:15:34.990 INFO:tasks.rados.rados.0.smithi154.stdout:125: delete oid 3 current snap is 5 2024-09-17T18:15:34.990 INFO:tasks.rados.rados.0.smithi154.stdout:120: finishing rollback tid 1 to smithi15432074-10 2024-09-17T18:15:34.990 INFO:tasks.rados.rados.0.smithi154.stdout:118: finishing write tid 3 to smithi15432074-50 2024-09-17T18:15:34.990 INFO:tasks.rados.rados.0.smithi154.stdout:120: finishing rollback tid 2 to smithi15432074-10 2024-09-17T18:15:34.990 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 10 v 48 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-09-17T18:15:34.990 INFO:tasks.rados.rados.0.smithi154.stdout:118: finishing write tid 4 to smithi15432074-50 2024-09-17T18:15:34.990 INFO:tasks.rados.rados.0.smithi154.stdout:118: oid 50 updating version 0 to 7 2024-09-17T18:15:34.990 INFO:tasks.rados.rados.0.smithi154.stdout:118: oid 50 updating version 7 to 8 2024-09-17T18:15:34.990 INFO:tasks.rados.rados.0.smithi154.stdout:118: oid 50 updating version 8 to 9 2024-09-17T18:15:34.990 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 50 v 9 (ObjNum 70 snap 5 seq_num 70) dirty exists 2024-09-17T18:15:34.991 INFO:tasks.rados.rados.0.smithi154.stdout:118: left oid 50 (ObjNum 70 snap 5 seq_num 70) 2024-09-17T18:15:34.991 INFO:tasks.rados.rados.0.smithi154.stdout:121: finishing write tid 1 to smithi15432074-37 2024-09-17T18:15:34.991 INFO:tasks.rados.rados.0.smithi154.stdout:121: finishing write tid 2 to smithi15432074-37 2024-09-17T18:15:34.991 INFO:tasks.rados.rados.0.smithi154.stdout:121: finishing write tid 3 to smithi15432074-37 2024-09-17T18:15:34.991 INFO:tasks.rados.rados.0.smithi154.stdout:121: finishing write tid 4 to smithi15432074-37 2024-09-17T18:15:34.992 INFO:tasks.rados.rados.0.smithi154.stdout:118: done (6 left) 2024-09-17T18:15:34.992 INFO:tasks.rados.rados.0.smithi154.stdout:120: done (5 left) 2024-09-17T18:15:34.992 INFO:tasks.rados.rados.0.smithi154.stdout:125: done (4 left) 2024-09-17T18:15:34.992 INFO:tasks.rados.rados.0.smithi154.stdout:126: snap_create 2024-09-17T18:15:34.995 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T18:15:34.998 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:34.991+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:34.998 INFO:tasks.rados.rados.0.smithi154.stdout:124: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-17T18:15:34.998 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 59102 2024-09-17T18:15:35.013 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:35.033 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 741496 2024-09-17T18:15:35.035 INFO:tasks.rados.rados.0.smithi154.stdout:121: finishing write tid 5 to smithi15432074-37 2024-09-17T18:15:35.035 INFO:tasks.rados.rados.0.smithi154.stdout:121: oid 37 updating version 0 to 51 2024-09-17T18:15:35.036 INFO:tasks.rados.rados.0.smithi154.stdout:121: oid 37 updating version 51 to 52 2024-09-17T18:15:35.036 INFO:tasks.rados.rados.0.smithi154.stdout:121: oid 37 updating version 52 to 53 2024-09-17T18:15:35.036 INFO:tasks.rados.rados.0.smithi154.stdout:121: oid 37 version 53 is already newer than 50 2024-09-17T18:15:35.036 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 37 v 53 (ObjNum 71 snap 5 seq_num 71) dirty exists 2024-09-17T18:15:35.036 INFO:tasks.rados.rados.0.smithi154.stdout:121: left oid 37 (ObjNum 71 snap 5 seq_num 71) 2024-09-17T18:15:35.036 INFO:tasks.rados.rados.0.smithi154.stdout:122: finishing copy_from racing read to smithi15432074-20 2024-09-17T18:15:35.036 INFO:tasks.rados.rados.0.smithi154.stdout:123: finishing write tid 1 to smithi15432074-18 2024-09-17T18:15:35.036 INFO:tasks.rados.rados.0.smithi154.stdout:122: finishing copy_from to smithi15432074-20 2024-09-17T18:15:35.036 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 20 v 42 (ObjNum 54 snap 0 seq_num 54) dirty exists 2024-09-17T18:15:35.040 INFO:tasks.rados.rados.0.smithi154.stdout:123: finishing write tid 2 to smithi15432074-18 2024-09-17T18:15:35.040 INFO:tasks.rados.rados.0.smithi154.stdout:123: finishing write tid 3 to smithi15432074-18 2024-09-17T18:15:35.040 INFO:tasks.rados.rados.0.smithi154.stdout:123: finishing write tid 4 to smithi15432074-18 2024-09-17T18:15:35.041 INFO:tasks.rados.rados.0.smithi154.stdout:123: finishing write tid 5 to smithi15432074-18 2024-09-17T18:15:35.041 INFO:tasks.rados.rados.0.smithi154.stdout:123: oid 18 updating version 0 to 55 2024-09-17T18:15:35.041 INFO:tasks.rados.rados.0.smithi154.stdout:123: oid 18 updating version 55 to 56 2024-09-17T18:15:35.041 INFO:tasks.rados.rados.0.smithi154.stdout:123: oid 18 updating version 56 to 57 2024-09-17T18:15:35.041 INFO:tasks.rados.rados.0.smithi154.stdout:123: oid 18 updating version 57 to 58 2024-09-17T18:15:35.041 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 18 v 58 (ObjNum 72 snap 5 seq_num 72) dirty exists 2024-09-17T18:15:35.041 INFO:tasks.rados.rados.0.smithi154.stdout:123: left oid 18 (ObjNum 72 snap 5 seq_num 72) 2024-09-17T18:15:35.098 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:35.093+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:35.115 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:35.115 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:35.126 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:15:35.126 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:15:35.129 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T18:15:35.199 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:35.193+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:35.253 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:35.253 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:35.267 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T18:15:35.300 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:35.299+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:35.385 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:35.385 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:35.399 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T18:15:35.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:35.399+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:35.501 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:35.497+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:35.520 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:35.520 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:35.534 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T18:15:35.603 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:35.595+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:35.653 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:35.653 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:35.665 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T18:15:35.704 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:35.703+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:35.731 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.5 to 1 (10000) 2024-09-17T18:15:35.735 INFO:tasks.rados.rados.0.smithi154.stdout:121: done (4 left) 2024-09-17T18:15:35.735 INFO:tasks.rados.rados.0.smithi154.stdout:122: done (3 left) 2024-09-17T18:15:35.735 INFO:tasks.rados.rados.0.smithi154.stdout:123: done (2 left) 2024-09-17T18:15:35.735 INFO:tasks.rados.rados.0.smithi154.stdout:124: done (1 left) 2024-09-17T18:15:35.735 INFO:tasks.rados.rados.0.smithi154.stdout:126: done (0 left) 2024-09-17T18:15:35.736 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 12 current snap is 6 2024-09-17T18:15:35.736 INFO:tasks.rados.rados.0.smithi154.stdout:127: seq_num 74 ranges {1114112=475136,1589248=622592,2211840=147456} 2024-09-17T18:15:35.749 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T18:15:35.752 INFO:tasks.rados.rados.0.smithi154.stdout:127: writing smithi15432074-12 from 1114112 to 1589248 tid 1 2024-09-17T18:15:35.755 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-17T18:15:35.758 INFO:tasks.rados.rados.0.smithi154.stdout:127: writing smithi15432074-12 from 1589248 to 2211840 tid 2 2024-09-17T18:15:35.760 INFO:tasks.rados.rados.0.smithi154.stdout:127: writing smithi15432074-12 from 2211840 to 2359296 tid 3 2024-09-17T18:15:35.760 INFO:tasks.rados.rados.0.smithi154.stdout:128: snap_create 2024-09-17T18:15:35.771 INFO:tasks.rados.rados.0.smithi154.stdout:127: finishing write tid 1 to smithi15432074-12 2024-09-17T18:15:35.772 INFO:tasks.rados.rados.0.smithi154.stdout:127: finishing write tid 2 to smithi15432074-12 2024-09-17T18:15:35.774 INFO:tasks.rados.rados.0.smithi154.stdout:127: finishing write tid 3 to smithi15432074-12 2024-09-17T18:15:35.775 INFO:tasks.rados.rados.0.smithi154.stdout:127: finishing write tid 4 to smithi15432074-12 2024-09-17T18:15:35.778 INFO:tasks.rados.rados.0.smithi154.stdout:127: finishing write tid 5 to smithi15432074-12 2024-09-17T18:15:35.778 INFO:tasks.rados.rados.0.smithi154.stdout:127: oid 12 updating version 0 to 62 2024-09-17T18:15:35.778 INFO:tasks.rados.rados.0.smithi154.stdout:127: oid 12 version 62 is already newer than 60 2024-09-17T18:15:35.778 INFO:tasks.rados.rados.0.smithi154.stdout:127: oid 12 version 62 is already newer than 61 2024-09-17T18:15:35.778 INFO:tasks.rados.rados.0.smithi154.stdout:127: oid 12 updating version 62 to 63 2024-09-17T18:15:35.779 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 12 v 63 (ObjNum 74 snap 6 seq_num 74) dirty exists 2024-09-17T18:15:35.779 INFO:tasks.rados.rados.0.smithi154.stdout:127: left oid 12 (ObjNum 74 snap 6 seq_num 74) 2024-09-17T18:15:35.783 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:35.783 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:35.798 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T18:15:35.805 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:35.801+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:35.905 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:35.899+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:35.922 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:35.923 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:35.938 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T18:15:36.006 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:36.001+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:36.099 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:36.100 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:36.107 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:36.106+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:36.114 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T18:15:36.208 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:36.207+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:36.229 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:36.229 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:36.243 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T18:15:36.311 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:36.305+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:36.506 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:36.507 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:36.507 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T18:15:36.508 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:36.502+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:36.607 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:36.607+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:36.637 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:36.638 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:36.651 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T18:15:36.708 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:36.705+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:36.734 INFO:teuthology.orchestra.run.smithi087.stderr:noscrub is set 2024-09-17T18:15:36.734 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.6 to 1 (10000) 2024-09-17T18:15:36.742 INFO:tasks.rados.rados.0.smithi154.stdout:127: done (1 left) 2024-09-17T18:15:36.742 INFO:tasks.rados.rados.0.smithi154.stdout:128: done (0 left) 2024-09-17T18:15:36.742 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 4 current snap is 7 2024-09-17T18:15:36.743 INFO:tasks.rados.rados.0.smithi154.stdout:129: seq_num 75 ranges {65536=491520,557056=770048} 2024-09-17T18:15:36.749 INFO:tasks.rados.rados.0.smithi154.stdout:129: writing smithi15432074-4 from 65536 to 557056 tid 1 2024-09-17T18:15:36.759 INFO:tasks.rados.rados.0.smithi154.stdout:129: writing smithi15432074-4 from 557056 to 1327104 tid 2 2024-09-17T18:15:36.759 INFO:tasks.rados.rados.0.smithi154.stdout:130: rmattr oid 24 current snap is 7 2024-09-17T18:15:36.759 INFO:tasks.rados.rados.0.smithi154.stdout:130: done (1 left) 2024-09-17T18:15:36.759 INFO:tasks.rados.rados.0.smithi154.stdout:131: snap_remove snap 1 2024-09-17T18:15:36.761 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-17T18:15:36.782 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:36.782 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:36.796 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T18:15:36.847 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:36.846+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:36.910 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:36.905+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:36.962 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:36.963 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:36.977 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T18:15:37.012 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:37.007+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:37.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:37.107+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:37.148 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:37.148 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:37.149 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T18:15:37.162 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T18:15:37.213 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:37.207+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:37.281 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:37.281 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:37.295 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T18:15:37.299 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:15:37.300 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:15:37.314 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:37.307+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:37.320 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:15:37.321 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:15:37.343 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:15:37.343 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:15:37.360 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:15:37.361 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:15:37.380 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:15:37.381 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:15:37.400 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:15:37.401 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:15:37.415 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:37.411+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:37.417 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:37.418 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:37.421 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:15:37.421 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:15:37.432 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T18:15:37.443 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:15:37.443 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:15:37.460 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:15:37.461 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:15:37.482 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:15:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:15:37.503 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:15:37.503 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:15:37.517 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:37.511+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:37.520 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:15:37.520 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:15:37.538 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:15:37.538 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:15:37.554 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:37.554 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:15:37.554 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T18:15:37.554 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:37.559 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:15:37.559 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:15:37.568 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T18:15:37.580 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:15:37.580 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:15:37.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:15:37.578+0000 7f9d08dec640 0 -- 172.21.15.87:0/2088947345 >> [v2:172.21.15.154:6824/3670919160,v1:172.21.15.154:6825/3670919160] conn(0x7f9d04221ef0 msgr2=0x7f9d042242e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T18:15:37.617 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:37.614+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:37.685 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:37.685 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:15:37.685 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T18:15:37.685 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T18:15:37.685 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:37.699 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T18:15:37.718 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:37.714+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:37.751 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.7 to 1 (10000) 2024-09-17T18:15:37.760 INFO:tasks.rados.rados.0.smithi154.stdout:131: done (1 left) 2024-09-17T18:15:37.760 INFO:tasks.rados.rados.0.smithi154.stdout:132: setattr oid 41 current snap is 7 2024-09-17T18:15:37.760 INFO:tasks.rados.rados.0.smithi154.stdout:129: finishing write tid 1 to smithi15432074-4 2024-09-17T18:15:37.760 INFO:tasks.rados.rados.0.smithi154.stdout:129: finishing write tid 2 to smithi15432074-4 2024-09-17T18:15:37.760 INFO:tasks.rados.rados.0.smithi154.stdout:129: finishing write tid 3 to smithi15432074-4 2024-09-17T18:15:37.761 INFO:tasks.rados.rados.0.smithi154.stdout:129: finishing write tid 4 to smithi15432074-4 2024-09-17T18:15:37.761 INFO:tasks.rados.rados.0.smithi154.stdout:129: oid 4 updating version 0 to 23 2024-09-17T18:15:37.761 INFO:tasks.rados.rados.0.smithi154.stdout:129: oid 4 version 23 is already newer than 22 2024-09-17T18:15:37.761 INFO:tasks.rados.rados.0.smithi154.stdout:129: oid 4 updating version 23 to 24 2024-09-17T18:15:37.761 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 4 v 24 (ObjNum 75 snap 7 seq_num 75) dirty exists 2024-09-17T18:15:37.761 INFO:tasks.rados.rados.0.smithi154.stdout:129: left oid 4 (ObjNum 75 snap 7 seq_num 75) 2024-09-17T18:15:37.763 INFO:tasks.rados.rados.0.smithi154.stdout:129: done (1 left) 2024-09-17T18:15:37.763 INFO:tasks.rados.rados.0.smithi154.stdout:133: read oid 21 snap 5 2024-09-17T18:15:37.763 INFO:tasks.rados.rados.0.smithi154.stdout:133: expect (ObjNum 35 snap 0 seq_num 35) 2024-09-17T18:15:37.763 INFO:tasks.rados.rados.0.smithi154.stdout:134: rollback oid 35 current snap is 7 2024-09-17T18:15:37.763 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 35 to 4 2024-09-17T18:15:37.763 INFO:tasks.rados.rados.0.smithi154.stdout:135: read oid 13 snap -1 2024-09-17T18:15:37.763 INFO:tasks.rados.rados.0.smithi154.stdout:135: expect (ObjNum 69 snap 5 seq_num 69) 2024-09-17T18:15:37.763 INFO:tasks.rados.rados.0.smithi154.stdout:136: read oid 39 snap -1 2024-09-17T18:15:37.764 INFO:tasks.rados.rados.0.smithi154.stdout:136: expect (ObjNum 62 snap 2 seq_num 62) 2024-09-17T18:15:37.764 INFO:tasks.rados.rados.0.smithi154.stdout:137: rollback oid 32 current snap is 7 2024-09-17T18:15:37.764 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 32 to 3 2024-09-17T18:15:37.764 INFO:tasks.rados.rados.0.smithi154.stdout:138: read oid 11 snap -1 2024-09-17T18:15:37.764 INFO:tasks.rados.rados.0.smithi154.stdout:138: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-17T18:15:37.765 INFO:tasks.rados.rados.0.smithi154.stdout:139: rollback oid 30 current snap is 7 2024-09-17T18:15:37.765 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 30 to 2 2024-09-17T18:15:37.765 INFO:tasks.rados.rados.0.smithi154.stdout:140: copy_from oid 44 from oid 24 current snap is 7 2024-09-17T18:15:37.765 INFO:tasks.rados.rados.0.smithi154.stdout:141: delete oid 25 current snap is 7 2024-09-17T18:15:37.781 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 8 1 2024-09-17T18:15:37.790 INFO:tasks.rados.rados.0.smithi154.stdout:141: done (9 left) 2024-09-17T18:15:37.791 INFO:tasks.rados.rados.0.smithi154.stdout:142: snap_remove snap 0 2024-09-17T18:15:37.812 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:15:37.812 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:15:37.819 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:37.815+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:37.842 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:37.843 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T18:15:37.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T18:15:37.843 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T18:15:37.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.843 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.bs4 37/31 ECSubWrite(tid=60, reqid=client.4565.0:244, at_version=37'18, trim_to=0'0, roll_forward_to=35'16))", 2024-09-17T18:15:37.843 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:32.725074+0000", 2024-09-17T18:15:37.843 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.1145792029999999, 2024-09-17T18:15:37.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050585509999999997, 2024-09-17T18:15:37.843 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.843 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.844 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.844 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.725074+0000", 2024-09-17T18:15:37.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.725074+0000", 2024-09-17T18:15:37.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.725074+0000", 2024-09-17T18:15:37.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7399999999999999e-07 2024-09-17T18:15:37.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.725957+0000", 2024-09-17T18:15:37.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00088222799999999998 2024-09-17T18:15:37.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.725983+0000", 2024-09-17T18:15:37.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6129e-05 2024-09-17T18:15:37.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.726001+0000", 2024-09-17T18:15:37.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7694e-05 2024-09-17T18:15:37.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.726148+0000", 2024-09-17T18:15:37.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000147472 2024-09-17T18:15:37.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.726162+0000", 2024-09-17T18:15:37.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3631999999999999e-05 2024-09-17T18:15:37.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.730083+0000", 2024-09-17T18:15:37.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0039209129999999998 2024-09-17T18:15:37.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.730133+0000", 2024-09-17T18:15:37.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0108999999999997e-05 2024-09-17T18:15:37.848 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.848 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.848 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.849 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.bs4 37/31 ECSubWrite(tid=61, reqid=client.4565.0:245, at_version=37'19, trim_to=0'0, roll_forward_to=35'16))", 2024-09-17T18:15:37.849 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:32.727737+0000", 2024-09-17T18:15:37.849 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.1119158819999999, 2024-09-17T18:15:37.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026442670000000001, 2024-09-17T18:15:37.849 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.849 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.849 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.849 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.727737+0000", 2024-09-17T18:15:37.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.727737+0000", 2024-09-17T18:15:37.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.727739+0000", 2024-09-17T18:15:37.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.996e-06 2024-09-17T18:15:37.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.728061+0000", 2024-09-17T18:15:37.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032203899999999998 2024-09-17T18:15:37.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.728094+0000", 2024-09-17T18:15:37.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2852000000000003e-05 2024-09-17T18:15:37.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.728118+0000", 2024-09-17T18:15:37.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3456999999999999e-05 2024-09-17T18:15:37.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.728346+0000", 2024-09-17T18:15:37.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022864700000000001 2024-09-17T18:15:37.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.728371+0000", 2024-09-17T18:15:37.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4406e-05 2024-09-17T18:15:37.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.730315+0000", 2024-09-17T18:15:37.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001944241 2024-09-17T18:15:37.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.730382+0000", 2024-09-17T18:15:37.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T18:15:37.853 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.853 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.853 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.853 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s2 37/31 ECSubWrite(tid=130, reqid=client.4565.0:251, at_version=37'13, trim_to=0'0, roll_forward_to=36'11))", 2024-09-17T18:15:37.853 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:32.733486+0000", 2024-09-17T18:15:37.854 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.1061675729999996, 2024-09-17T18:15:37.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003093059, 2024-09-17T18:15:37.854 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.854 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.854 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.854 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.733486+0000", 2024-09-17T18:15:37.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.733486+0000", 2024-09-17T18:15:37.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.733486+0000", 2024-09-17T18:15:37.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4000000000000001e-07 2024-09-17T18:15:37.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.733534+0000", 2024-09-17T18:15:37.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7539e-05 2024-09-17T18:15:37.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.733578+0000", 2024-09-17T18:15:37.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4085000000000002e-05 2024-09-17T18:15:37.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.733603+0000", 2024-09-17T18:15:37.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5123e-05 2024-09-17T18:15:37.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.733776+0000", 2024-09-17T18:15:37.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000172969 2024-09-17T18:15:37.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.733801+0000", 2024-09-17T18:15:37.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4556e-05 2024-09-17T18:15:37.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.736497+0000", 2024-09-17T18:15:37.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026959589999999999 2024-09-17T18:15:37.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.736579+0000", 2024-09-17T18:15:37.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2088000000000004e-05 2024-09-17T18:15:37.858 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.858 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.858 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.858 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.5s6 38/31 ECSubWrite(tid=34, reqid=client.4565.0:261, at_version=38'6, trim_to=0'0, roll_forward_to=36'4))", 2024-09-17T18:15:37.858 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:33.725900+0000", 2024-09-17T18:15:37.858 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1137537540000002, 2024-09-17T18:15:37.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044015390000000003, 2024-09-17T18:15:37.859 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.859 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.859 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.859 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:33.725900+0000", 2024-09-17T18:15:37.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:33.725900+0000", 2024-09-17T18:15:37.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:33.725900+0000", 2024-09-17T18:15:37.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6400000000000002e-07 2024-09-17T18:15:37.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:33.725961+0000", 2024-09-17T18:15:37.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1062000000000006e-05 2024-09-17T18:15:37.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:33.725993+0000", 2024-09-17T18:15:37.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1312000000000001e-05 2024-09-17T18:15:37.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:33.726017+0000", 2024-09-17T18:15:37.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4816000000000001e-05 2024-09-17T18:15:37.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:33.726248+0000", 2024-09-17T18:15:37.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000230528 2024-09-17T18:15:37.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:33.726272+0000", 2024-09-17T18:15:37.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4315999999999999e-05 2024-09-17T18:15:37.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:33.730253+0000", 2024-09-17T18:15:37.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0039802789999999998 2024-09-17T18:15:37.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:33.730301+0000", 2024-09-17T18:15:37.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8562e-05 2024-09-17T18:15:37.863 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.863 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.863 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.863 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 39/31 ECSubWrite(tid=68, reqid=client.4565.0:268, at_version=39'17, trim_to=0'0, roll_forward_to=36'15))", 2024-09-17T18:15:37.863 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.762405+0000", 2024-09-17T18:15:37.863 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.0772487320000002, 2024-09-17T18:15:37.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0074066089999999998, 2024-09-17T18:15:37.863 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.863 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.863 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.864 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.762405+0000", 2024-09-17T18:15:37.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.762405+0000", 2024-09-17T18:15:37.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.762406+0000", 2024-09-17T18:15:37.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.477e-06 2024-09-17T18:15:37.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.763182+0000", 2024-09-17T18:15:37.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077567599999999999 2024-09-17T18:15:37.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.763219+0000", 2024-09-17T18:15:37.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7299999999999999e-05 2024-09-17T18:15:37.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.763247+0000", 2024-09-17T18:15:37.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7746000000000002e-05 2024-09-17T18:15:37.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.763414+0000", 2024-09-17T18:15:37.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016694799999999999 2024-09-17T18:15:37.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.763435+0000", 2024-09-17T18:15:37.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0809999999999999e-05 2024-09-17T18:15:37.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.769765+0000", 2024-09-17T18:15:37.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0063300650000000002 2024-09-17T18:15:37.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.769811+0000", 2024-09-17T18:15:37.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6587e-05 2024-09-17T18:15:37.868 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.868 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.868 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.868 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 39/31 ECSubWrite(tid=69, reqid=client.4565.0:269, at_version=39'18, trim_to=0'0, roll_forward_to=36'15))", 2024-09-17T18:15:37.868 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.765975+0000", 2024-09-17T18:15:37.868 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.0736785219999998, 2024-09-17T18:15:37.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011777833, 2024-09-17T18:15:37.868 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.868 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.868 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.868 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.765975+0000", 2024-09-17T18:15:37.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.765975+0000", 2024-09-17T18:15:37.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.765977+0000", 2024-09-17T18:15:37.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1799999999999999e-06 2024-09-17T18:15:37.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766243+0000", 2024-09-17T18:15:37.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026578000000000002 2024-09-17T18:15:37.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766276+0000", 2024-09-17T18:15:37.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3646000000000003e-05 2024-09-17T18:15:37.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766299+0000", 2024-09-17T18:15:37.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2263e-05 2024-09-17T18:15:37.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766566+0000", 2024-09-17T18:15:37.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026779100000000003 2024-09-17T18:15:37.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766583+0000", 2024-09-17T18:15:37.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6521999999999999e-05 2024-09-17T18:15:37.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.777685+0000", 2024-09-17T18:15:37.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011102231000000001 2024-09-17T18:15:37.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.777753+0000", 2024-09-17T18:15:37.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7420000000000002e-05 2024-09-17T18:15:37.872 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.872 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.872 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.873 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 39/31 ECSubWrite(tid=70, reqid=client.4565.0:270, at_version=39'19, trim_to=0'0, roll_forward_to=36'15))", 2024-09-17T18:15:37.873 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.766377+0000", 2024-09-17T18:15:37.873 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.0732766520000001, 2024-09-17T18:15:37.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011485324999999999, 2024-09-17T18:15:37.873 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.873 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.873 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.873 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766377+0000", 2024-09-17T18:15:37.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766377+0000", 2024-09-17T18:15:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766378+0000", 2024-09-17T18:15:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1999999999999999e-06 2024-09-17T18:15:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766415+0000", 2024-09-17T18:15:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6708999999999997e-05 2024-09-17T18:15:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766439+0000", 2024-09-17T18:15:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4363e-05 2024-09-17T18:15:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766479+0000", 2024-09-17T18:15:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9986e-05 2024-09-17T18:15:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.767681+0000", 2024-09-17T18:15:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0012016660000000001 2024-09-17T18:15:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.767705+0000", 2024-09-17T18:15:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4403e-05 2024-09-17T18:15:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.777803+0000", 2024-09-17T18:15:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01009794 2024-09-17T18:15:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.777862+0000", 2024-09-17T18:15:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9058000000000003e-05 2024-09-17T18:15:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.877 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpRead(3.9s3 39/31 ECSubRead(tid=25, to_read={3:9d124c8a:::smithi15432074-25:head=294912,53248,0}, subchunks={3:9d124c8a:::smithi15432074-25:head=[0,1]}, attrs_to_read=))", 2024-09-17T18:15:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.771479+0000", 2024-09-17T18:15:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.0681747800000001, 2024-09-17T18:15:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076972899999999999, 2024-09-17T18:15:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.771479+0000", 2024-09-17T18:15:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.771479+0000", 2024-09-17T18:15:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.771480+0000", 2024-09-17T18:15:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1200000000000001e-06 2024-09-17T18:15:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.771495+0000", 2024-09-17T18:15:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5747e-05 2024-09-17T18:15:37.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.771573+0000", 2024-09-17T18:15:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7373999999999995e-05 2024-09-17T18:15:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.775830+0000", 2024-09-17T18:15:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042570669999999998 2024-09-17T18:15:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776858+0000", 2024-09-17T18:15:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001027797 2024-09-17T18:15:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.779176+0000", 2024-09-17T18:15:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002318185 2024-09-17T18:15:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpRead(3.9s3 39/31 ECSubRead(tid=26, to_read={3:9d124c8a:::smithi15432074-25:head=0,348160,0}, subchunks={3:9d124c8a:::smithi15432074-25:head=[0,1]}, attrs_to_read=))", 2024-09-17T18:15:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.775931+0000", 2024-09-17T18:15:37.881 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.0637218380000002, 2024-09-17T18:15:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062787490000000001, 2024-09-17T18:15:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.775931+0000", 2024-09-17T18:15:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.775931+0000", 2024-09-17T18:15:37.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.775933+0000", 2024-09-17T18:15:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4330000000000001e-06 2024-09-17T18:15:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.775952+0000", 2024-09-17T18:15:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.929e-05 2024-09-17T18:15:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.775993+0000", 2024-09-17T18:15:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0329e-05 2024-09-17T18:15:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776026+0000", 2024-09-17T18:15:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3719e-05 2024-09-17T18:15:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.779307+0000", 2024-09-17T18:15:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0032804710000000001 2024-09-17T18:15:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.782210+0000", 2024-09-17T18:15:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002903507 2024-09-17T18:15:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpRead(3.9s3 39/31 ECSubRead(tid=27, to_read={3:9d124c8a:::smithi15432074-25:head=0,348160,0}, subchunks={3:9d124c8a:::smithi15432074-25:head=[0,1]}, attrs_to_read=))", 2024-09-17T18:15:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.776065+0000", 2024-09-17T18:15:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.063587928, 2024-09-17T18:15:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065887410000000004, 2024-09-17T18:15:37.885 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776065+0000", 2024-09-17T18:15:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776065+0000", 2024-09-17T18:15:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776066+0000", 2024-09-17T18:15:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8299999999999995e-07 2024-09-17T18:15:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776079+0000", 2024-09-17T18:15:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2670000000000001e-05 2024-09-17T18:15:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776112+0000", 2024-09-17T18:15:37.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3142000000000002e-05 2024-09-17T18:15:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776135+0000", 2024-09-17T18:15:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2555999999999999e-05 2024-09-17T18:15:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.782310+0000", 2024-09-17T18:15:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061757219999999998 2024-09-17T18:15:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.782654+0000", 2024-09-17T18:15:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034366799999999999 2024-09-17T18:15:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 39/31 ECSubWrite(tid=110, reqid=client.4565.0:281, at_version=39'40, trim_to=0'0, roll_forward_to=36'38))", 2024-09-17T18:15:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.776276+0000", 2024-09-17T18:15:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.063377247, 2024-09-17T18:15:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006396583, 2024-09-17T18:15:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.889 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776276+0000", 2024-09-17T18:15:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776276+0000", 2024-09-17T18:15:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776277+0000", 2024-09-17T18:15:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9400000000000005e-07 2024-09-17T18:15:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776331+0000", 2024-09-17T18:15:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4617999999999998e-05 2024-09-17T18:15:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776393+0000", 2024-09-17T18:15:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2021999999999997e-05 2024-09-17T18:15:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776415+0000", 2024-09-17T18:15:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1826000000000001e-05 2024-09-17T18:15:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.777236+0000", 2024-09-17T18:15:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082082599999999998 2024-09-17T18:15:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.777269+0000", 2024-09-17T18:15:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2985999999999999e-05 2024-09-17T18:15:37.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.782613+0000", 2024-09-17T18:15:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005343609 2024-09-17T18:15:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.782673+0000", 2024-09-17T18:15:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0102000000000002e-05 2024-09-17T18:15:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 39/31 ECSubWrite(tid=111, reqid=client.4565.0:282, at_version=39'41, trim_to=0'0, roll_forward_to=36'38))", 2024-09-17T18:15:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.776466+0000", 2024-09-17T18:15:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.0631875979999998, 2024-09-17T18:15:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0068584300000000004, 2024-09-17T18:15:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776466+0000", 2024-09-17T18:15:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776466+0000", 2024-09-17T18:15:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776467+0000", 2024-09-17T18:15:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2999999999999999e-07 2024-09-17T18:15:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776506+0000", 2024-09-17T18:15:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9085000000000003e-05 2024-09-17T18:15:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776529+0000", 2024-09-17T18:15:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3655999999999998e-05 2024-09-17T18:15:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776548+0000", 2024-09-17T18:15:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8150000000000001e-05 2024-09-17T18:15:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.780007+0000", 2024-09-17T18:15:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003459433 2024-09-17T18:15:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.780030+0000", 2024-09-17T18:15:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3329999999999999e-05 2024-09-17T18:15:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.783268+0000", 2024-09-17T18:15:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003237377 2024-09-17T18:15:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.783324+0000", 2024-09-17T18:15:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6468999999999998e-05 2024-09-17T18:15:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 39/31 ECSubWrite(tid=112, reqid=client.4565.0:283, at_version=39'42, trim_to=0'0, roll_forward_to=36'38))", 2024-09-17T18:15:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.776587+0000", 2024-09-17T18:15:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.0630664479999998, 2024-09-17T18:15:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0067821009999999996, 2024-09-17T18:15:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776587+0000", 2024-09-17T18:15:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776587+0000", 2024-09-17T18:15:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776588+0000", 2024-09-17T18:15:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8700000000000004e-07 2024-09-17T18:15:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776624+0000", 2024-09-17T18:15:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6168999999999999e-05 2024-09-17T18:15:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776646+0000", 2024-09-17T18:15:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1766000000000001e-05 2024-09-17T18:15:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.776663+0000", 2024-09-17T18:15:37.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6773e-05 2024-09-17T18:15:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.782081+0000", 2024-09-17T18:15:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054181339999999998 2024-09-17T18:15:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.782097+0000", 2024-09-17T18:15:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6765999999999998e-05 2024-09-17T18:15:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.783332+0000", 2024-09-17T18:15:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001234289 2024-09-17T18:15:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.783369+0000", 2024-09-17T18:15:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7217e-05 2024-09-17T18:15:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 39/31 ECSubWrite(tid=77, reqid=client.4565.0:270, at_version=0'0, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:37.906 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.778455+0000", 2024-09-17T18:15:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.0611982150000001, 2024-09-17T18:15:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038466080000000001, 2024-09-17T18:15:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.778455+0000", 2024-09-17T18:15:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.778455+0000", 2024-09-17T18:15:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.778457+0000", 2024-09-17T18:15:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9470000000000002e-06 2024-09-17T18:15:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.778501+0000", 2024-09-17T18:15:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4239000000000001e-05 2024-09-17T18:15:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.778535+0000", 2024-09-17T18:15:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3259000000000001e-05 2024-09-17T18:15:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.778557+0000", 2024-09-17T18:15:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2092000000000001e-05 2024-09-17T18:15:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.779025+0000", 2024-09-17T18:15:37.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00046833200000000001 2024-09-17T18:15:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.779042+0000", 2024-09-17T18:15:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7427000000000001e-05 2024-09-17T18:15:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.782234+0000", 2024-09-17T18:15:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003191349 2024-09-17T18:15:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.782302+0000", 2024-09-17T18:15:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7963e-05 2024-09-17T18:15:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 39/31 ECSubWrite(tid=113, reqid=client.4565.0:283, at_version=0'0, trim_to=0'0, roll_forward_to=39'42))", 2024-09-17T18:15:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.784572+0000", 2024-09-17T18:15:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.0550817979999998, 2024-09-17T18:15:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0066380980000000003, 2024-09-17T18:15:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784572+0000", 2024-09-17T18:15:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784572+0000", 2024-09-17T18:15:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784574+0000", 2024-09-17T18:15:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4530000000000001e-06 2024-09-17T18:15:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784602+0000", 2024-09-17T18:15:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7895999999999999e-05 2024-09-17T18:15:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784641+0000", 2024-09-17T18:15:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9282000000000001e-05 2024-09-17T18:15:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784665+0000", 2024-09-17T18:15:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3479e-05 2024-09-17T18:15:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785016+0000", 2024-09-17T18:15:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035162600000000001 2024-09-17T18:15:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785032+0000", 2024-09-17T18:15:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5713e-05 2024-09-17T18:15:37.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.791167+0000", 2024-09-17T18:15:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061352899999999998 2024-09-17T18:15:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.791210+0000", 2024-09-17T18:15:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2358999999999999e-05 2024-09-17T18:15:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s3 39/31 ECSubWrite(tid=28, reqid=client.4565.0:287, at_version=39'17, trim_to=0'0, roll_forward_to=36'15))", 2024-09-17T18:15:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.785226+0000", 2024-09-17T18:15:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.054427682, 2024-09-17T18:15:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085490730000000008, 2024-09-17T18:15:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785226+0000", 2024-09-17T18:15:37.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785226+0000", 2024-09-17T18:15:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785227+0000", 2024-09-17T18:15:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.33e-06 2024-09-17T18:15:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785498+0000", 2024-09-17T18:15:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027117100000000001 2024-09-17T18:15:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785521+0000", 2024-09-17T18:15:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2717999999999998e-05 2024-09-17T18:15:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785536+0000", 2024-09-17T18:15:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5113000000000001e-05 2024-09-17T18:15:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785714+0000", 2024-09-17T18:15:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017830799999999999 2024-09-17T18:15:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785729+0000", 2024-09-17T18:15:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5116000000000001e-05 2024-09-17T18:15:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.793712+0000", 2024-09-17T18:15:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079822509999999992 2024-09-17T18:15:37.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.793775+0000", 2024-09-17T18:15:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3065999999999996e-05 2024-09-17T18:15:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.fs5 epoch 39/31 rep_tid 115 entries 39'6 (0'0) error 3:fdcac804:::smithi15432074-5:head by client.4565.0:298 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 34'4)", 2024-09-17T18:15:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.789759+0000", 2024-09-17T18:15:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.0498942690000002, 2024-09-17T18:15:37.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062235240000000002, 2024-09-17T18:15:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.789759+0000", 2024-09-17T18:15:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.789759+0000", 2024-09-17T18:15:37.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.789761+0000", 2024-09-17T18:15:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9429999999999999e-06 2024-09-17T18:15:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.789781+0000", 2024-09-17T18:15:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9570000000000001e-05 2024-09-17T18:15:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.789919+0000", 2024-09-17T18:15:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013868999999999999 2024-09-17T18:15:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.789992+0000", 2024-09-17T18:15:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2344999999999999e-05 2024-09-17T18:15:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.790636+0000", 2024-09-17T18:15:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00064406700000000001 2024-09-17T18:15:37.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.795983+0000", 2024-09-17T18:15:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053469090000000004 2024-09-17T18:15:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s3 39/31 ECSubWrite(tid=29, reqid=client.4565.0:288, at_version=39'18, trim_to=0'0, roll_forward_to=36'15))", 2024-09-17T18:15:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.797219+0000", 2024-09-17T18:15:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.0424343130000002, 2024-09-17T18:15:37.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002926091, 2024-09-17T18:15:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.797219+0000", 2024-09-17T18:15:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.797219+0000", 2024-09-17T18:15:37.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.797221+0000", 2024-09-17T18:15:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8339999999999999e-06 2024-09-17T18:15:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.797346+0000", 2024-09-17T18:15:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012538299999999999 2024-09-17T18:15:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.797408+0000", 2024-09-17T18:15:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1759000000000003e-05 2024-09-17T18:15:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.797456+0000", 2024-09-17T18:15:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8031999999999997e-05 2024-09-17T18:15:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.797599+0000", 2024-09-17T18:15:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014280099999999999 2024-09-17T18:15:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.797622+0000", 2024-09-17T18:15:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2702999999999999e-05 2024-09-17T18:15:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.800063+0000", 2024-09-17T18:15:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024412700000000002 2024-09-17T18:15:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.800145+0000", 2024-09-17T18:15:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2309000000000001e-05 2024-09-17T18:15:37.928 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 39/31 ECSubWrite(tid=119, reqid=client.4565.0:296, at_version=39'44, trim_to=0'0, roll_forward_to=39'42))", 2024-09-17T18:15:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.806551+0000", 2024-09-17T18:15:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.0331022870000002, 2024-09-17T18:15:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059269580000000004, 2024-09-17T18:15:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.806551+0000", 2024-09-17T18:15:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.806551+0000", 2024-09-17T18:15:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.806571+0000", 2024-09-17T18:15:37.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0466e-05 2024-09-17T18:15:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.807962+0000", 2024-09-17T18:15:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0013907329999999999 2024-09-17T18:15:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.807998+0000", 2024-09-17T18:15:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6074000000000001e-05 2024-09-17T18:15:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.808019+0000", 2024-09-17T18:15:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0214999999999999e-05 2024-09-17T18:15:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.808164+0000", 2024-09-17T18:15:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000145649 2024-09-17T18:15:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.808180+0000", 2024-09-17T18:15:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6022e-05 2024-09-17T18:15:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.812389+0000", 2024-09-17T18:15:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042083590000000001 2024-09-17T18:15:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.812478+0000", 2024-09-17T18:15:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9439999999999997e-05 2024-09-17T18:15:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s3 39/31 ECSubWrite(tid=33, reqid=client.4565.0:291, at_version=39'20, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.810254+0000", 2024-09-17T18:15:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.0293990009999998, 2024-09-17T18:15:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028125350000000001, 2024-09-17T18:15:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.810254+0000", 2024-09-17T18:15:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.810254+0000", 2024-09-17T18:15:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.810256+0000", 2024-09-17T18:15:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9549999999999999e-06 2024-09-17T18:15:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.810480+0000", 2024-09-17T18:15:37.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022353799999999999 2024-09-17T18:15:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.810506+0000", 2024-09-17T18:15:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6253000000000001e-05 2024-09-17T18:15:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.810525+0000", 2024-09-17T18:15:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9394000000000001e-05 2024-09-17T18:15:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.810662+0000", 2024-09-17T18:15:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013683099999999999 2024-09-17T18:15:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.810683+0000", 2024-09-17T18:15:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0893000000000001e-05 2024-09-17T18:15:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.813008+0000", 2024-09-17T18:15:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023252899999999998 2024-09-17T18:15:37.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.813067+0000", 2024-09-17T18:15:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8381000000000002e-05 2024-09-17T18:15:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:37.938 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:37.938 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:37.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T18:15:37.940 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:37.935+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:38.041 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:38.035+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:38.067 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:38.067 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:15:38.067 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T18:15:38.067 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:38.083 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T18:15:38.143 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:38.139+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:38.203 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:38.203 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:15:38.203 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T18:15:38.203 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T18:15:38.203 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:38.217 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T18:15:38.243 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:38.239+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:38.343 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T18:15:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T18:15:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T18:15:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:72 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'50, mlcod=24'44)", 2024-09-17T18:15:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.188634+0000", 2024-09-17T18:15:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.150834182000001, 2024-09-17T18:15:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062661820000000003, 2024-09-17T18:15:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.188634+0000", 2024-09-17T18:15:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.188634+0000", 2024-09-17T18:15:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.188642+0000", 2024-09-17T18:15:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8040000000000007e-06 2024-09-17T18:15:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.188789+0000", 2024-09-17T18:15:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014632600000000001 2024-09-17T18:15:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.188814+0000", 2024-09-17T18:15:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5755999999999999e-05 2024-09-17T18:15:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.188833+0000", 2024-09-17T18:15:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8433000000000001e-05 2024-09-17T18:15:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.188920+0000", 2024-09-17T18:15:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7174000000000003e-05 2024-09-17T18:15:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.188949+0000", 2024-09-17T18:15:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8843000000000002e-05 2024-09-17T18:15:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.194809+0000", 2024-09-17T18:15:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005859988 2024-09-17T18:15:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.194900+0000", 2024-09-17T18:15:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0858000000000003e-05 2024-09-17T18:15:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:73 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'51, mlcod=24'44)", 2024-09-17T18:15:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.191292+0000", 2024-09-17T18:15:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.148175725000002, 2024-09-17T18:15:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060868129999999999, 2024-09-17T18:15:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.191292+0000", 2024-09-17T18:15:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.191292+0000", 2024-09-17T18:15:38.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.191294+0000", 2024-09-17T18:15:38.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2800000000000002e-06 2024-09-17T18:15:38.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.191309+0000", 2024-09-17T18:15:38.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.433e-05 2024-09-17T18:15:38.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.191338+0000", 2024-09-17T18:15:38.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9584999999999999e-05 2024-09-17T18:15:38.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.191355+0000", 2024-09-17T18:15:38.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.717e-05 2024-09-17T18:15:38.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.191468+0000", 2024-09-17T18:15:38.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112817 2024-09-17T18:15:38.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.191504+0000", 2024-09-17T18:15:38.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5883000000000002e-05 2024-09-17T18:15:38.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.197315+0000", 2024-09-17T18:15:38.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058104990000000002 2024-09-17T18:15:38.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.197379+0000", 2024-09-17T18:15:38.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4249000000000001e-05 2024-09-17T18:15:38.355 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.355 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.355 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.355 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:75 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'53, mlcod=24'46)", 2024-09-17T18:15:38.355 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.193792+0000", 2024-09-17T18:15:38.355 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.145676168000001, 2024-09-17T18:15:38.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0066147000000000003, 2024-09-17T18:15:38.355 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.356 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.356 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.356 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.193792+0000", 2024-09-17T18:15:38.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.193792+0000", 2024-09-17T18:15:38.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.193793+0000", 2024-09-17T18:15:38.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1799999999999999e-06 2024-09-17T18:15:38.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.193927+0000", 2024-09-17T18:15:38.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013381600000000001 2024-09-17T18:15:38.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.193945+0000", 2024-09-17T18:15:38.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8763e-05 2024-09-17T18:15:38.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.193955+0000", 2024-09-17T18:15:38.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7799999999999995e-06 2024-09-17T18:15:38.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.194053+0000", 2024-09-17T18:15:38.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8203999999999997e-05 2024-09-17T18:15:38.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.194087+0000", 2024-09-17T18:15:38.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4159000000000003e-05 2024-09-17T18:15:38.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.200320+0000", 2024-09-17T18:15:38.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062328399999999999 2024-09-17T18:15:38.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.200406+0000", 2024-09-17T18:15:38.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5958000000000006e-05 2024-09-17T18:15:38.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.360 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.361 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:89 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'63, mlcod=24'60)", 2024-09-17T18:15:38.361 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.280444+0000", 2024-09-17T18:15:38.361 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.059023331999999, 2024-09-17T18:15:38.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082048439999999993, 2024-09-17T18:15:38.361 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.361 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.361 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.361 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.280444+0000", 2024-09-17T18:15:38.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.280444+0000", 2024-09-17T18:15:38.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.280446+0000", 2024-09-17T18:15:38.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8840000000000001e-06 2024-09-17T18:15:38.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.280460+0000", 2024-09-17T18:15:38.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3239e-05 2024-09-17T18:15:38.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.280481+0000", 2024-09-17T18:15:38.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.143e-05 2024-09-17T18:15:38.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.280497+0000", 2024-09-17T18:15:38.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5662e-05 2024-09-17T18:15:38.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.280805+0000", 2024-09-17T18:15:38.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030822299999999999 2024-09-17T18:15:38.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.280840+0000", 2024-09-17T18:15:38.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5275999999999999e-05 2024-09-17T18:15:38.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.288584+0000", 2024-09-17T18:15:38.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0077438280000000003 2024-09-17T18:15:38.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.288649+0000", 2024-09-17T18:15:38.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5302000000000006e-05 2024-09-17T18:15:38.366 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.366 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.366 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.366 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:90 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'64, mlcod=24'60)", 2024-09-17T18:15:38.366 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.281166+0000", 2024-09-17T18:15:38.366 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.058301799999999, 2024-09-17T18:15:38.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095065170000000008, 2024-09-17T18:15:38.367 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.367 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.367 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.367 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281166+0000", 2024-09-17T18:15:38.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281166+0000", 2024-09-17T18:15:38.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281167+0000", 2024-09-17T18:15:38.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0899999999999999e-06 2024-09-17T18:15:38.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281237+0000", 2024-09-17T18:15:38.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9974999999999993e-05 2024-09-17T18:15:38.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281258+0000", 2024-09-17T18:15:38.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0948999999999999e-05 2024-09-17T18:15:38.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281273+0000", 2024-09-17T18:15:38.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4844000000000001e-05 2024-09-17T18:15:38.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281378+0000", 2024-09-17T18:15:38.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104987 2024-09-17T18:15:38.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281407+0000", 2024-09-17T18:15:38.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8841999999999999e-05 2024-09-17T18:15:38.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290614+0000", 2024-09-17T18:15:38.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092069390000000008 2024-09-17T18:15:38.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290672+0000", 2024-09-17T18:15:38.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8891000000000002e-05 2024-09-17T18:15:38.372 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.372 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.372 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.372 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:91 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'65, mlcod=24'60)", 2024-09-17T18:15:38.372 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.281625+0000", 2024-09-17T18:15:38.372 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.057843174999999, 2024-09-17T18:15:38.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090883079999999998, 2024-09-17T18:15:38.372 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.373 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.373 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.373 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281625+0000", 2024-09-17T18:15:38.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281625+0000", 2024-09-17T18:15:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281626+0000", 2024-09-17T18:15:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.184e-06 2024-09-17T18:15:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281637+0000", 2024-09-17T18:15:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1153e-05 2024-09-17T18:15:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281657+0000", 2024-09-17T18:15:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0446e-05 2024-09-17T18:15:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281673+0000", 2024-09-17T18:15:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6042999999999999e-05 2024-09-17T18:15:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284250+0000", 2024-09-17T18:15:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002576212 2024-09-17T18:15:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284279+0000", 2024-09-17T18:15:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9788999999999999e-05 2024-09-17T18:15:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290678+0000", 2024-09-17T18:15:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006399035 2024-09-17T18:15:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290713+0000", 2024-09-17T18:15:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4446000000000002e-05 2024-09-17T18:15:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:92 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'66, mlcod=24'60)", 2024-09-17T18:15:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.282093+0000", 2024-09-17T18:15:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.057374563, 2024-09-17T18:15:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086526520000000003, 2024-09-17T18:15:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282093+0000", 2024-09-17T18:15:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282093+0000", 2024-09-17T18:15:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282094+0000", 2024-09-17T18:15:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7300000000000004e-07 2024-09-17T18:15:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282102+0000", 2024-09-17T18:15:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9869999999999999e-06 2024-09-17T18:15:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282120+0000", 2024-09-17T18:15:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7753000000000001e-05 2024-09-17T18:15:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282135+0000", 2024-09-17T18:15:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5216e-05 2024-09-17T18:15:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284810+0000", 2024-09-17T18:15:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026748789999999998 2024-09-17T18:15:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284862+0000", 2024-09-17T18:15:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1668000000000001e-05 2024-09-17T18:15:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290715+0000", 2024-09-17T18:15:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058529369999999999 2024-09-17T18:15:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290746+0000", 2024-09-17T18:15:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1238999999999997e-05 2024-09-17T18:15:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:93 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'67, mlcod=24'60)", 2024-09-17T18:15:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.282567+0000", 2024-09-17T18:15:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.056901065000002, 2024-09-17T18:15:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082126530000000003, 2024-09-17T18:15:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282567+0000", 2024-09-17T18:15:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282567+0000", 2024-09-17T18:15:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282568+0000", 2024-09-17T18:15:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0299999999999997e-07 2024-09-17T18:15:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282641+0000", 2024-09-17T18:15:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3515000000000003e-05 2024-09-17T18:15:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282658+0000", 2024-09-17T18:15:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6976000000000001e-05 2024-09-17T18:15:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282671+0000", 2024-09-17T18:15:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3144e-05 2024-09-17T18:15:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.285432+0000", 2024-09-17T18:15:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0027608400000000001 2024-09-17T18:15:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.285486+0000", 2024-09-17T18:15:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4364999999999999e-05 2024-09-17T18:15:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290747+0000", 2024-09-17T18:15:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052609509999999998 2024-09-17T18:15:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290779+0000", 2024-09-17T18:15:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1958999999999997e-05 2024-09-17T18:15:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:94 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'68, mlcod=24'60)", 2024-09-17T18:15:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.283160+0000", 2024-09-17T18:15:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.056307477000001, 2024-09-17T18:15:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076627600000000002, 2024-09-17T18:15:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283160+0000", 2024-09-17T18:15:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283160+0000", 2024-09-17T18:15:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283161+0000", 2024-09-17T18:15:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.077e-06 2024-09-17T18:15:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283170+0000", 2024-09-17T18:15:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T18:15:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283188+0000", 2024-09-17T18:15:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8006e-05 2024-09-17T18:15:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283203+0000", 2024-09-17T18:15:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5119e-05 2024-09-17T18:15:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286124+0000", 2024-09-17T18:15:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029209499999999998 2024-09-17T18:15:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286178+0000", 2024-09-17T18:15:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4478999999999998e-05 2024-09-17T18:15:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290781+0000", 2024-09-17T18:15:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046022509999999999 2024-09-17T18:15:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290823+0000", 2024-09-17T18:15:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2308000000000002e-05 2024-09-17T18:15:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:95 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'69, mlcod=24'60)", 2024-09-17T18:15:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.283758+0000", 2024-09-17T18:15:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.055710032, 2024-09-17T18:15:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090648919999999997, 2024-09-17T18:15:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283758+0000", 2024-09-17T18:15:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283758+0000", 2024-09-17T18:15:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283760+0000", 2024-09-17T18:15:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9599999999999999e-06 2024-09-17T18:15:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283771+0000", 2024-09-17T18:15:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1487e-05 2024-09-17T18:15:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283800+0000", 2024-09-17T18:15:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9164999999999999e-05 2024-09-17T18:15:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283818+0000", 2024-09-17T18:15:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8067000000000002e-05 2024-09-17T18:15:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286791+0000", 2024-09-17T18:15:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029726010000000001 2024-09-17T18:15:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286832+0000", 2024-09-17T18:15:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0723000000000003e-05 2024-09-17T18:15:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292715+0000", 2024-09-17T18:15:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058835650000000003 2024-09-17T18:15:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292823+0000", 2024-09-17T18:15:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000107324 2024-09-17T18:15:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:96 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'70, mlcod=24'60)", 2024-09-17T18:15:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.284198+0000", 2024-09-17T18:15:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.055269790000001, 2024-09-17T18:15:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086761919999999992, 2024-09-17T18:15:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284198+0000", 2024-09-17T18:15:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284198+0000", 2024-09-17T18:15:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284205+0000", 2024-09-17T18:15:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7039999999999997e-06 2024-09-17T18:15:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284273+0000", 2024-09-17T18:15:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8454000000000006e-05 2024-09-17T18:15:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284297+0000", 2024-09-17T18:15:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3847000000000001e-05 2024-09-17T18:15:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284310+0000", 2024-09-17T18:15:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2826000000000001e-05 2024-09-17T18:15:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.287308+0000", 2024-09-17T18:15:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029979109999999998 2024-09-17T18:15:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.287336+0000", 2024-09-17T18:15:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8073e-05 2024-09-17T18:15:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292826+0000", 2024-09-17T18:15:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054905249999999996 2024-09-17T18:15:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292874+0000", 2024-09-17T18:15:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7852000000000002e-05 2024-09-17T18:15:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:97 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'71, mlcod=24'60)", 2024-09-17T18:15:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.284817+0000", 2024-09-17T18:15:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.054650759000001, 2024-09-17T18:15:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0081181629999999994, 2024-09-17T18:15:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284817+0000", 2024-09-17T18:15:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284817+0000", 2024-09-17T18:15:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284818+0000", 2024-09-17T18:15:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.474e-06 2024-09-17T18:15:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284831+0000", 2024-09-17T18:15:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2186e-05 2024-09-17T18:15:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284851+0000", 2024-09-17T18:15:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0415999999999999e-05 2024-09-17T18:15:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284866+0000", 2024-09-17T18:15:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4496e-05 2024-09-17T18:15:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.288103+0000", 2024-09-17T18:15:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0032376620000000001 2024-09-17T18:15:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.288140+0000", 2024-09-17T18:15:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6486000000000003e-05 2024-09-17T18:15:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292877+0000", 2024-09-17T18:15:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047368640000000004 2024-09-17T18:15:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292935+0000", 2024-09-17T18:15:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579000000000003e-05 2024-09-17T18:15:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:98 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'72, mlcod=24'60)", 2024-09-17T18:15:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.285333+0000", 2024-09-17T18:15:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.054134858000001, 2024-09-17T18:15:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076428240000000003, 2024-09-17T18:15:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.285333+0000", 2024-09-17T18:15:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.285333+0000", 2024-09-17T18:15:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.285334+0000", 2024-09-17T18:15:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3859999999999999e-06 2024-09-17T18:15:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.285346+0000", 2024-09-17T18:15:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2193e-05 2024-09-17T18:15:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.285375+0000", 2024-09-17T18:15:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8952999999999999e-05 2024-09-17T18:15:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.285391+0000", 2024-09-17T18:15:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5993000000000001e-05 2024-09-17T18:15:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.288744+0000", 2024-09-17T18:15:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033529419999999998 2024-09-17T18:15:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.288781+0000", 2024-09-17T18:15:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6678999999999999e-05 2024-09-17T18:15:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292939+0000", 2024-09-17T18:15:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004158152 2024-09-17T18:15:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292976+0000", 2024-09-17T18:15:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6526000000000002e-05 2024-09-17T18:15:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:99 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'73, mlcod=24'61)", 2024-09-17T18:15:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.286027+0000", 2024-09-17T18:15:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.053440332000001, 2024-09-17T18:15:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076313839999999997, 2024-09-17T18:15:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286027+0000", 2024-09-17T18:15:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286027+0000", 2024-09-17T18:15:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286035+0000", 2024-09-17T18:15:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.233e-06 2024-09-17T18:15:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286195+0000", 2024-09-17T18:15:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015997200000000001 2024-09-17T18:15:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286222+0000", 2024-09-17T18:15:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7093e-05 2024-09-17T18:15:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286263+0000", 2024-09-17T18:15:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1171999999999998e-05 2024-09-17T18:15:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.289285+0000", 2024-09-17T18:15:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030219040000000002 2024-09-17T18:15:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.289315+0000", 2024-09-17T18:15:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0209000000000002e-05 2024-09-17T18:15:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.293575+0000", 2024-09-17T18:15:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042604899999999996 2024-09-17T18:15:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.293659+0000", 2024-09-17T18:15:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3311000000000002e-05 2024-09-17T18:15:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:100 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'74, mlcod=24'61)", 2024-09-17T18:15:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.286650+0000", 2024-09-17T18:15:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.052817332, 2024-09-17T18:15:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0070585889999999997, 2024-09-17T18:15:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286650+0000", 2024-09-17T18:15:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286650+0000", 2024-09-17T18:15:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286652+0000", 2024-09-17T18:15:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.514e-06 2024-09-17T18:15:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286665+0000", 2024-09-17T18:15:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3509999999999999e-05 2024-09-17T18:15:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286688+0000", 2024-09-17T18:15:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2804999999999999e-05 2024-09-17T18:15:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286704+0000", 2024-09-17T18:15:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6154000000000002e-05 2024-09-17T18:15:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290156+0000", 2024-09-17T18:15:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034519260000000001 2024-09-17T18:15:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290189+0000", 2024-09-17T18:15:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2489e-05 2024-09-17T18:15:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.293663+0000", 2024-09-17T18:15:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034738719999999998 2024-09-17T18:15:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.293709+0000", 2024-09-17T18:15:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6319000000000002e-05 2024-09-17T18:15:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:141 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'107, mlcod=24'100)", 2024-09-17T18:15:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:15.234244+0000", 2024-09-17T18:15:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.105223377000002, 2024-09-17T18:15:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059822829999999997, 2024-09-17T18:15:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:15.234244+0000", 2024-09-17T18:15:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:15.234244+0000", 2024-09-17T18:15:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:15.234245+0000", 2024-09-17T18:15:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.06e-06 2024-09-17T18:15:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:15.234364+0000", 2024-09-17T18:15:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118307 2024-09-17T18:15:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:15.234411+0000", 2024-09-17T18:15:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7608999999999998e-05 2024-09-17T18:15:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:15.234427+0000", 2024-09-17T18:15:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5353e-05 2024-09-17T18:15:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:15.234962+0000", 2024-09-17T18:15:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053573300000000004 2024-09-17T18:15:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:15.235005+0000", 2024-09-17T18:15:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2196000000000001e-05 2024-09-17T18:15:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:15.240134+0000", 2024-09-17T18:15:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051292270000000001 2024-09-17T18:15:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:15.240227+0000", 2024-09-17T18:15:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2798000000000002e-05 2024-09-17T18:15:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.fs2 33/31 ECSubWrite(tid=3, reqid=client.4565.0:13, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-17T18:15:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:29.687662+0000", 2024-09-17T18:15:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.6518054450000008, 2024-09-17T18:15:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065620050000000001, 2024-09-17T18:15:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:29.687662+0000", 2024-09-17T18:15:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:29.687662+0000", 2024-09-17T18:15:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:29.687663+0000", 2024-09-17T18:15:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.47e-07 2024-09-17T18:15:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:29.687722+0000", 2024-09-17T18:15:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8789999999999998e-05 2024-09-17T18:15:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:29.687743+0000", 2024-09-17T18:15:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1407999999999999e-05 2024-09-17T18:15:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:29.687755+0000", 2024-09-17T18:15:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1228e-05 2024-09-17T18:15:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:29.687836+0000", 2024-09-17T18:15:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.153e-05 2024-09-17T18:15:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:29.687845+0000", 2024-09-17T18:15:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7909999999999993e-06 2024-09-17T18:15:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:29.694189+0000", 2024-09-17T18:15:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0063444649999999997 2024-09-17T18:15:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:29.694224+0000", 2024-09-17T18:15:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4946000000000001e-05 2024-09-17T18:15:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 39/31 ECSubWrite(tid=113, reqid=client.4565.0:283, at_version=0'0, trim_to=0'0, roll_forward_to=39'42))", 2024-09-17T18:15:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.784542+0000", 2024-09-17T18:15:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.554925565, 2024-09-17T18:15:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084139260000000004, 2024-09-17T18:15:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784542+0000", 2024-09-17T18:15:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784542+0000", 2024-09-17T18:15:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784545+0000", 2024-09-17T18:15:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0340000000000001e-06 2024-09-17T18:15:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784583+0000", 2024-09-17T18:15:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7394999999999997e-05 2024-09-17T18:15:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784763+0000", 2024-09-17T18:15:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018085599999999999 2024-09-17T18:15:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784791+0000", 2024-09-17T18:15:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7152999999999999e-05 2024-09-17T18:15:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785281+0000", 2024-09-17T18:15:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049054100000000005 2024-09-17T18:15:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785602+0000", 2024-09-17T18:15:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032048500000000002 2024-09-17T18:15:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.792898+0000", 2024-09-17T18:15:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072960669999999998 2024-09-17T18:15:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.792956+0000", 2024-09-17T18:15:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8394999999999999e-05 2024-09-17T18:15:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.as5 39/31 ECSubWrite(tid=117, reqid=client.4565.0:294, at_version=39'30, trim_to=0'0, roll_forward_to=37'27))", 2024-09-17T18:15:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.791226+0000", 2024-09-17T18:15:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.5482419620000001, 2024-09-17T18:15:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076870389999999997, 2024-09-17T18:15:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.791226+0000", 2024-09-17T18:15:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.791226+0000", 2024-09-17T18:15:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.791228+0000", 2024-09-17T18:15:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9e-06 2024-09-17T18:15:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.791273+0000", 2024-09-17T18:15:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5148999999999998e-05 2024-09-17T18:15:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.791303+0000", 2024-09-17T18:15:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0399000000000002e-05 2024-09-17T18:15:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.791324+0000", 2024-09-17T18:15:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1236000000000001e-05 2024-09-17T18:15:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.792148+0000", 2024-09-17T18:15:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082367300000000003 2024-09-17T18:15:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.792169+0000", 2024-09-17T18:15:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0418999999999999e-05 2024-09-17T18:15:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.798848+0000", 2024-09-17T18:15:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0066791079999999996 2024-09-17T18:15:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.798913+0000", 2024-09-17T18:15:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5154999999999995e-05 2024-09-17T18:15:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.0s5 39/31 ECSubWrite(tid=9, reqid=client.4565.0:303, at_version=39'7, trim_to=0'0, roll_forward_to=34'5))", 2024-09-17T18:15:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.953156+0000", 2024-09-17T18:15:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.3863119149999998, 2024-09-17T18:15:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061332000000000001, 2024-09-17T18:15:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.953156+0000", 2024-09-17T18:15:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.953156+0000", 2024-09-17T18:15:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.953158+0000", 2024-09-17T18:15:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9400000000000001e-06 2024-09-17T18:15:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.953375+0000", 2024-09-17T18:15:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021752800000000001 2024-09-17T18:15:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.953423+0000", 2024-09-17T18:15:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7879e-05 2024-09-17T18:15:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.953447+0000", 2024-09-17T18:15:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4046e-05 2024-09-17T18:15:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.953704+0000", 2024-09-17T18:15:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025713 2024-09-17T18:15:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.953730+0000", 2024-09-17T18:15:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5403000000000001e-05 2024-09-17T18:15:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.959209+0000", 2024-09-17T18:15:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005479449 2024-09-17T18:15:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.959289+0000", 2024-09-17T18:15:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9825000000000002e-05 2024-09-17T18:15:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:38.457 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:38.459 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T18:15:38.459 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:38.455+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:38.559 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:38.558+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:38.590 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:38.590 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:38.590 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-17T18:15:38.590 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:38.605 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T18:15:38.660 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:38.659+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:38.761 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T18:15:38.761 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:38.755+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:38.762 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.8 to 1 (10000) 2024-09-17T18:15:38.766 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:38.767 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:38.767 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-17T18:15:38.767 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-17T18:15:38.767 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:38.770 INFO:tasks.rados.rados.0.smithi154.stdout:142: done (9 left) 2024-09-17T18:15:38.770 INFO:tasks.rados.rados.0.smithi154.stdout:143: rmattr oid 38 current snap is 7 2024-09-17T18:15:38.770 INFO:tasks.rados.rados.0.smithi154.stdout:143: done (9 left) 2024-09-17T18:15:38.770 INFO:tasks.rados.rados.0.smithi154.stdout:144: copy_from oid 18 from oid 6 current snap is 7 2024-09-17T18:15:38.770 INFO:tasks.rados.rados.0.smithi154.stdout:134: finishing rollback tid 0 to smithi15432074-35 2024-09-17T18:15:38.771 INFO:tasks.rados.rados.0.smithi154.stdout:139: finishing rollback tid 0 to smithi15432074-30 2024-09-17T18:15:38.771 INFO:tasks.rados.rados.0.smithi154.stdout:139: finishing rollback tid 1 to smithi15432074-30 2024-09-17T18:15:38.771 INFO:tasks.rados.rados.0.smithi154.stdout:135: expect (ObjNum 69 snap 5 seq_num 69) 2024-09-17T18:15:38.774 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 243193 2024-09-17T18:15:38.796 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T18:15:38.798 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 9 1 2024-09-17T18:15:38.826 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:38.852 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:38.862 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:38.855+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:38.868 INFO:tasks.rados.rados.0.smithi154.stdout:134: finishing rollback tid 1 to smithi15432074-35 2024-09-17T18:15:38.869 INFO:tasks.rados.rados.0.smithi154.stdout:139: finishing rollback tid 2 to smithi15432074-30 2024-09-17T18:15:38.869 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 30 v 45 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-09-17T18:15:38.869 INFO:tasks.rados.rados.0.smithi154.stdout:134: finishing rollback tid 2 to smithi15432074-35 2024-09-17T18:15:38.869 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 35 v 23 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-09-17T18:15:38.869 INFO:tasks.rados.rados.0.smithi154.stdout:137: finishing rollback tid 0 to smithi15432074-32 2024-09-17T18:15:38.869 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 41 v 65 (ObjNum 57 snap 1 seq_num 57) dirty exists 2024-09-17T18:15:38.869 INFO:tasks.rados.rados.0.smithi154.stdout:133: expect (ObjNum 35 snap 0 seq_num 35) 2024-09-17T18:15:38.872 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 535691 2024-09-17T18:15:38.872 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:38.878 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:38.884 INFO:tasks.rados.rados.0.smithi154.stdout:137: finishing rollback tid 1 to smithi15432074-32 2024-09-17T18:15:38.884 INFO:tasks.rados.rados.0.smithi154.stdout:137: finishing rollback tid 2 to smithi15432074-32 2024-09-17T18:15:38.884 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 32 v 27 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-09-17T18:15:38.884 INFO:tasks.rados.rados.0.smithi154.stdout:136: expect (ObjNum 62 snap 2 seq_num 62) 2024-09-17T18:15:38.884 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:38.918 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:38.951 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:38.961 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-17T18:15:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-17T18:15:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-17T18:15:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 37/31 ECSubWrite(tid=60, reqid=client.4565.0:244, at_version=37'18, trim_to=0'0, roll_forward_to=35'16))", 2024-09-17T18:15:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.725322+0000", 2024-09-17T18:15:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.2339676869999998, 2024-09-17T18:15:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00552097, 2024-09-17T18:15:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725322+0000", 2024-09-17T18:15:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725322+0000", 2024-09-17T18:15:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725323+0000", 2024-09-17T18:15:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0600000000000001e-07 2024-09-17T18:15:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725509+0000", 2024-09-17T18:15:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00018667299999999999 2024-09-17T18:15:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725531+0000", 2024-09-17T18:15:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1265000000000001e-05 2024-09-17T18:15:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725618+0000", 2024-09-17T18:15:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7414e-05 2024-09-17T18:15:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725732+0000", 2024-09-17T18:15:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113935 2024-09-17T18:15:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725742+0000", 2024-09-17T18:15:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7459999999999995e-06 2024-09-17T18:15:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.730767+0000", 2024-09-17T18:15:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0050255389999999999 2024-09-17T18:15:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.730843+0000", 2024-09-17T18:15:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5992e-05 2024-09-17T18:15:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 37/31 ECSubWrite(tid=61, reqid=client.4565.0:245, at_version=37'19, trim_to=0'0, roll_forward_to=35'16))", 2024-09-17T18:15:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.727853+0000", 2024-09-17T18:15:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.2314369169999999, 2024-09-17T18:15:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047767160000000003, 2024-09-17T18:15:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.727853+0000", 2024-09-17T18:15:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.727853+0000", 2024-09-17T18:15:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.727854+0000", 2024-09-17T18:15:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.133e-06 2024-09-17T18:15:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.727916+0000", 2024-09-17T18:15:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2006000000000002e-05 2024-09-17T18:15:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.727929+0000", 2024-09-17T18:15:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3237e-05 2024-09-17T18:15:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.727941+0000", 2024-09-17T18:15:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1252e-05 2024-09-17T18:15:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728028+0000", 2024-09-17T18:15:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7115999999999997e-05 2024-09-17T18:15:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728034+0000", 2024-09-17T18:15:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2280000000000003e-06 2024-09-17T18:15:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.732599+0000", 2024-09-17T18:15:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045651620000000002 2024-09-17T18:15:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.732630+0000", 2024-09-17T18:15:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0582e-05 2024-09-17T18:15:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 37/31 ECSubWrite(tid=62, reqid=client.4565.0:246, at_version=37'20, trim_to=0'0, roll_forward_to=35'16))", 2024-09-17T18:15:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.728677+0000", 2024-09-17T18:15:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.2306129659999998, 2024-09-17T18:15:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003967099, 2024-09-17T18:15:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728677+0000", 2024-09-17T18:15:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728677+0000", 2024-09-17T18:15:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728678+0000", 2024-09-17T18:15:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9400000000000005e-07 2024-09-17T18:15:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728697+0000", 2024-09-17T18:15:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9040999999999999e-05 2024-09-17T18:15:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728713+0000", 2024-09-17T18:15:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6024000000000001e-05 2024-09-17T18:15:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728721+0000", 2024-09-17T18:15:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3440000000000001e-06 2024-09-17T18:15:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.730055+0000", 2024-09-17T18:15:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013340419999999999 2024-09-17T18:15:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.730066+0000", 2024-09-17T18:15:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0825999999999999e-05 2024-09-17T18:15:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.732633+0000", 2024-09-17T18:15:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0025674790000000001 2024-09-17T18:15:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.732644+0000", 2024-09-17T18:15:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0648999999999999e-05 2024-09-17T18:15:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.5s5 38/31 ECSubWrite(tid=34, reqid=client.4565.0:261, at_version=38'6, trim_to=0'0, roll_forward_to=36'4))", 2024-09-17T18:15:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:33.724992+0000", 2024-09-17T18:15:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.2342981589999997, 2024-09-17T18:15:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0025352299999999999, 2024-09-17T18:15:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.724992+0000", 2024-09-17T18:15:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.724992+0000", 2024-09-17T18:15:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.724992+0000", 2024-09-17T18:15:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6899999999999998e-07 2024-09-17T18:15:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.725021+0000", 2024-09-17T18:15:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8424000000000001e-05 2024-09-17T18:15:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.725036+0000", 2024-09-17T18:15:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5818e-05 2024-09-17T18:15:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.725049+0000", 2024-09-17T18:15:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2495e-05 2024-09-17T18:15:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.725198+0000", 2024-09-17T18:15:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000148925 2024-09-17T18:15:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.725210+0000", 2024-09-17T18:15:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2325e-05 2024-09-17T18:15:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.727484+0000", 2024-09-17T18:15:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002274037 2024-09-17T18:15:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.727527+0000", 2024-09-17T18:15:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2837000000000003e-05 2024-09-17T18:15:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 42/31 ECSubWrite(tid=87, reqid=client.4565.0:358, at_version=42'26, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.771519+0000", 2024-09-17T18:15:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.1877704790000001, 2024-09-17T18:15:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090010019999999993, 2024-09-17T18:15:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771519+0000", 2024-09-17T18:15:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771519+0000", 2024-09-17T18:15:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771521+0000", 2024-09-17T18:15:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.528e-06 2024-09-17T18:15:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771559+0000", 2024-09-17T18:15:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7567000000000001e-05 2024-09-17T18:15:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771587+0000", 2024-09-17T18:15:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8561e-05 2024-09-17T18:15:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771603+0000", 2024-09-17T18:15:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5654e-05 2024-09-17T18:15:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771678+0000", 2024-09-17T18:15:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630999999999995e-05 2024-09-17T18:15:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771687+0000", 2024-09-17T18:15:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9809999999999992e-06 2024-09-17T18:15:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780476+0000", 2024-09-17T18:15:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087883019999999996 2024-09-17T18:15:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780520+0000", 2024-09-17T18:15:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4777999999999997e-05 2024-09-17T18:15:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.7s3 42/31 ECSubWrite(tid=88, reqid=client.4565.0:344, at_version=42'22, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.771639+0000", 2024-09-17T18:15:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.187650546, 2024-09-17T18:15:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0089162240000000004, 2024-09-17T18:15:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771639+0000", 2024-09-17T18:15:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771639+0000", 2024-09-17T18:15:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:38.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771640+0000", 2024-09-17T18:15:38.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.68e-07 2024-09-17T18:15:38.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:38.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771697+0000", 2024-09-17T18:15:38.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6586000000000003e-05 2024-09-17T18:15:38.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771714+0000", 2024-09-17T18:15:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7269e-05 2024-09-17T18:15:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771728+0000", 2024-09-17T18:15:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3777999999999999e-05 2024-09-17T18:15:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771858+0000", 2024-09-17T18:15:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013013400000000001 2024-09-17T18:15:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771871+0000", 2024-09-17T18:15:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3609e-05 2024-09-17T18:15:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780540+0000", 2024-09-17T18:15:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086685059999999994 2024-09-17T18:15:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780556+0000", 2024-09-17T18:15:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5673999999999999e-05 2024-09-17T18:15:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.8s1 42/31 ECSubWrite(tid=134, reqid=osd.6.0:133, at_version=0'0, trim_to=0'0, roll_forward_to=42'17))", 2024-09-17T18:15:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.773401+0000", 2024-09-17T18:15:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.1858886900000001, 2024-09-17T18:15:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0098034449999999992, 2024-09-17T18:15:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773401+0000", 2024-09-17T18:15:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773401+0000", 2024-09-17T18:15:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773403+0000", 2024-09-17T18:15:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.75e-06 2024-09-17T18:15:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773424+0000", 2024-09-17T18:15:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1339e-05 2024-09-17T18:15:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773455+0000", 2024-09-17T18:15:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0539e-05 2024-09-17T18:15:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773471+0000", 2024-09-17T18:15:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6453e-05 2024-09-17T18:15:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773629+0000", 2024-09-17T18:15:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015783099999999999 2024-09-17T18:15:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773645+0000", 2024-09-17T18:15:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5882000000000001e-05 2024-09-17T18:15:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783144+0000", 2024-09-17T18:15:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094992210000000004 2024-09-17T18:15:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783205+0000", 2024-09-17T18:15:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0430000000000002e-05 2024-09-17T18:15:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.5s5 42/31 ECSubWrite(tid=39, reqid=osd.5.0:39, at_version=42'10, trim_to=0'0, roll_forward_to=38'8))", 2024-09-17T18:15:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.775279+0000", 2024-09-17T18:15:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.1840113889999999, 2024-09-17T18:15:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0079475259999999999, 2024-09-17T18:15:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775279+0000", 2024-09-17T18:15:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775279+0000", 2024-09-17T18:15:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775279+0000", 2024-09-17T18:15:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3700000000000001e-07 2024-09-17T18:15:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775306+0000", 2024-09-17T18:15:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7109000000000001e-05 2024-09-17T18:15:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775325+0000", 2024-09-17T18:15:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8603000000000001e-05 2024-09-17T18:15:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775334+0000", 2024-09-17T18:15:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0750000000000004e-06 2024-09-17T18:15:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775675+0000", 2024-09-17T18:15:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034130500000000003 2024-09-17T18:15:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775683+0000", 2024-09-17T18:15:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2919999999999996e-06 2024-09-17T18:15:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783169+0000", 2024-09-17T18:15:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074853339999999997 2024-09-17T18:15:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783226+0000", 2024-09-17T18:15:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7470999999999999e-05 2024-09-17T18:15:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.7s3 42/31 ECSubWrite(tid=89, reqid=client.4565.0:345, at_version=42'23, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.775369+0000", 2024-09-17T18:15:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.1839207789999999, 2024-09-17T18:15:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0079552900000000003, 2024-09-17T18:15:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775369+0000", 2024-09-17T18:15:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775369+0000", 2024-09-17T18:15:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775370+0000", 2024-09-17T18:15:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8699999999999995e-07 2024-09-17T18:15:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775393+0000", 2024-09-17T18:15:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3896e-05 2024-09-17T18:15:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775403+0000", 2024-09-17T18:15:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1169999999999993e-06 2024-09-17T18:15:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775409+0000", 2024-09-17T18:15:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.861e-06 2024-09-17T18:15:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775615+0000", 2024-09-17T18:15:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000205145 2024-09-17T18:15:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775631+0000", 2024-09-17T18:15:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6631999999999999e-05 2024-09-17T18:15:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783300+0000", 2024-09-17T18:15:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0076691390000000002 2024-09-17T18:15:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783324+0000", 2024-09-17T18:15:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4012999999999999e-05 2024-09-17T18:15:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 42/31 ECSubWrite(tid=90, reqid=client.4565.0:359, at_version=42'27, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.775430+0000", 2024-09-17T18:15:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.183860197, 2024-09-17T18:15:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078051919999999999, 2024-09-17T18:15:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775430+0000", 2024-09-17T18:15:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775430+0000", 2024-09-17T18:15:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775430+0000", 2024-09-17T18:15:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.53e-07 2024-09-17T18:15:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775451+0000", 2024-09-17T18:15:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1013e-05 2024-09-17T18:15:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775458+0000", 2024-09-17T18:15:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.277e-06 2024-09-17T18:15:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775464+0000", 2024-09-17T18:15:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8950000000000003e-06 2024-09-17T18:15:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775930+0000", 2024-09-17T18:15:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00046549800000000001 2024-09-17T18:15:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775938+0000", 2024-09-17T18:15:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4649999999999994e-06 2024-09-17T18:15:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783193+0000", 2024-09-17T18:15:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0072553180000000002 2024-09-17T18:15:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783235+0000", 2024-09-17T18:15:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1473000000000001e-05 2024-09-17T18:15:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.7s3 42/31 ECSubWrite(tid=91, reqid=client.4565.0:352, at_version=42'25, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.775481+0000", 2024-09-17T18:15:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.1838092659999999, 2024-09-17T18:15:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085477750000000005, 2024-09-17T18:15:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775481+0000", 2024-09-17T18:15:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775481+0000", 2024-09-17T18:15:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775481+0000", 2024-09-17T18:15:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2099999999999998e-07 2024-09-17T18:15:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775517+0000", 2024-09-17T18:15:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6279000000000003e-05 2024-09-17T18:15:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775526+0000", 2024-09-17T18:15:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9129999999999992e-06 2024-09-17T18:15:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775533+0000", 2024-09-17T18:15:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4760000000000003e-06 2024-09-17T18:15:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776055+0000", 2024-09-17T18:15:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052192199999999997 2024-09-17T18:15:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776069+0000", 2024-09-17T18:15:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4749999999999999e-05 2024-09-17T18:15:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783980+0000", 2024-09-17T18:15:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0079110670000000008 2024-09-17T18:15:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.784028+0000", 2024-09-17T18:15:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8047000000000003e-05 2024-09-17T18:15:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 42/31 ECSubWrite(tid=92, reqid=client.4565.0:360, at_version=42'28, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.775543+0000", 2024-09-17T18:15:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.183746526, 2024-09-17T18:15:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077258910000000004, 2024-09-17T18:15:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775543+0000", 2024-09-17T18:15:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775543+0000", 2024-09-17T18:15:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775544+0000", 2024-09-17T18:15:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8200000000000001e-07 2024-09-17T18:15:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775556+0000", 2024-09-17T18:15:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1963999999999999e-05 2024-09-17T18:15:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775562+0000", 2024-09-17T18:15:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4099999999999996e-06 2024-09-17T18:15:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775574+0000", 2024-09-17T18:15:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2401e-05 2024-09-17T18:15:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776274+0000", 2024-09-17T18:15:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00069985000000000002 2024-09-17T18:15:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776281+0000", 2024-09-17T18:15:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0160000000000003e-06 2024-09-17T18:15:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783239+0000", 2024-09-17T18:15:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069581920000000002 2024-09-17T18:15:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783269+0000", 2024-09-17T18:15:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9776000000000001e-05 2024-09-17T18:15:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.7s3 42/31 ECSubWrite(tid=94, reqid=client.4565.0:353, at_version=42'26, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.777557+0000", 2024-09-17T18:15:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.1817330610000001, 2024-09-17T18:15:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0067564749999999996, 2024-09-17T18:15:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.777557+0000", 2024-09-17T18:15:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.777557+0000", 2024-09-17T18:15:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.777558+0000", 2024-09-17T18:15:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2160000000000001e-06 2024-09-17T18:15:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.777583+0000", 2024-09-17T18:15:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4615000000000001e-05 2024-09-17T18:15:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.777600+0000", 2024-09-17T18:15:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7045999999999999e-05 2024-09-17T18:15:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.777612+0000", 2024-09-17T18:15:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2079000000000001e-05 2024-09-17T18:15:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780581+0000", 2024-09-17T18:15:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0029696760000000001 2024-09-17T18:15:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780587+0000", 2024-09-17T18:15:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1599999999999997e-06 2024-09-17T18:15:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.784288+0000", 2024-09-17T18:15:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037012130000000001 2024-09-17T18:15:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.784313+0000", 2024-09-17T18:15:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5469999999999998e-05 2024-09-17T18:15:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 42/31 ECSubWrite(tid=93, reqid=osd.4.0:93, at_version=42'30, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.777865+0000", 2024-09-17T18:15:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.181424598, 2024-09-17T18:15:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057986649999999997, 2024-09-17T18:15:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.777865+0000", 2024-09-17T18:15:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.777865+0000", 2024-09-17T18:15:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.777866+0000", 2024-09-17T18:15:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7300000000000004e-07 2024-09-17T18:15:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.777892+0000", 2024-09-17T18:15:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5633999999999999e-05 2024-09-17T18:15:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.777907+0000", 2024-09-17T18:15:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5098e-05 2024-09-17T18:15:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.777918+0000", 2024-09-17T18:15:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1345000000000001e-05 2024-09-17T18:15:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778010+0000", 2024-09-17T18:15:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1957000000000001e-05 2024-09-17T18:15:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778018+0000", 2024-09-17T18:15:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5560000000000002e-06 2024-09-17T18:15:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783638+0000", 2024-09-17T18:15:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056196869999999999 2024-09-17T18:15:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783664+0000", 2024-09-17T18:15:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6415e-05 2024-09-17T18:15:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.7s3 42/31 ECSubWrite(tid=95, reqid=client.4565.0:354, at_version=42'27, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.781077+0000", 2024-09-17T18:15:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.1782130790000001, 2024-09-17T18:15:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032496270000000002, 2024-09-17T18:15:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781077+0000", 2024-09-17T18:15:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781077+0000", 2024-09-17T18:15:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781078+0000", 2024-09-17T18:15:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1909999999999999e-06 2024-09-17T18:15:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781097+0000", 2024-09-17T18:15:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8630999999999998e-05 2024-09-17T18:15:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781106+0000", 2024-09-17T18:15:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4790000000000002e-06 2024-09-17T18:15:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781112+0000", 2024-09-17T18:15:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3439999999999997e-06 2024-09-17T18:15:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783109+0000", 2024-09-17T18:15:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019961179999999999 2024-09-17T18:15:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783116+0000", 2024-09-17T18:15:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2640000000000002e-06 2024-09-17T18:15:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.784316+0000", 2024-09-17T18:15:39.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001200099 2024-09-17T18:15:39.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.784326+0000", 2024-09-17T18:15:39.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0501e-05 2024-09-17T18:15:39.035 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.035 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.035 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.035 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 42/31 ECSubWrite(tid=96, reqid=osd.4.0:96, at_version=42'32, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.781131+0000", 2024-09-17T18:15:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.1781593269999999, 2024-09-17T18:15:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045872589999999998, 2024-09-17T18:15:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781131+0000", 2024-09-17T18:15:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781131+0000", 2024-09-17T18:15:39.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781131+0000", 2024-09-17T18:15:39.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0900000000000002e-07 2024-09-17T18:15:39.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781151+0000", 2024-09-17T18:15:39.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0384e-05 2024-09-17T18:15:39.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781157+0000", 2024-09-17T18:15:39.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3900000000000001e-06 2024-09-17T18:15:39.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781161+0000", 2024-09-17T18:15:39.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2679999999999996e-06 2024-09-17T18:15:39.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781221+0000", 2024-09-17T18:15:39.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0182000000000001e-05 2024-09-17T18:15:39.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781230+0000", 2024-09-17T18:15:39.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.166e-06 2024-09-17T18:15:39.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.785669+0000", 2024-09-17T18:15:39.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00443874 2024-09-17T18:15:39.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.785718+0000", 2024-09-17T18:15:39.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8720000000000001e-05 2024-09-17T18:15:39.040 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.040 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.040 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.040 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.7s3 42/31 ECSubWrite(tid=97, reqid=osd.4.0:97, at_version=42'29, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:39.040 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.782479+0000", 2024-09-17T18:15:39.040 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.176810522, 2024-09-17T18:15:39.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031434459999999998, 2024-09-17T18:15:39.041 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.041 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.041 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:39.041 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.782479+0000", 2024-09-17T18:15:39.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.782479+0000", 2024-09-17T18:15:39.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.782481+0000", 2024-09-17T18:15:39.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.508e-06 2024-09-17T18:15:39.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.782521+0000", 2024-09-17T18:15:39.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9938999999999998e-05 2024-09-17T18:15:39.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.782544+0000", 2024-09-17T18:15:39.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2770999999999999e-05 2024-09-17T18:15:39.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.782559+0000", 2024-09-17T18:15:39.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5656999999999999e-05 2024-09-17T18:15:39.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783381+0000", 2024-09-17T18:15:39.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000822129 2024-09-17T18:15:39.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783389+0000", 2024-09-17T18:15:39.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9750000000000007e-06 2024-09-17T18:15:39.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.785585+0000", 2024-09-17T18:15:39.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021955630000000002 2024-09-17T18:15:39.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.785623+0000", 2024-09-17T18:15:39.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7904000000000002e-05 2024-09-17T18:15:39.045 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.045 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.045 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.045 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 42/31 ECSubWrite(tid=99, reqid=osd.4.0:99, at_version=42'34, trim_to=0'0, roll_forward_to=42'32))", 2024-09-17T18:15:39.045 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.800203+0000", 2024-09-17T18:15:39.045 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.1590863929999999, 2024-09-17T18:15:39.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034234930000000001, 2024-09-17T18:15:39.046 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.046 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.046 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:39.046 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.800203+0000", 2024-09-17T18:15:39.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.800203+0000", 2024-09-17T18:15:39.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.800204+0000", 2024-09-17T18:15:39.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8400000000000003e-07 2024-09-17T18:15:39.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.800221+0000", 2024-09-17T18:15:39.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6532999999999999e-05 2024-09-17T18:15:39.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.800232+0000", 2024-09-17T18:15:39.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1297999999999999e-05 2024-09-17T18:15:39.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.800241+0000", 2024-09-17T18:15:39.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8359999999999998e-06 2024-09-17T18:15:39.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.800317+0000", 2024-09-17T18:15:39.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5834000000000006e-05 2024-09-17T18:15:39.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.800345+0000", 2024-09-17T18:15:39.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8459e-05 2024-09-17T18:15:39.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.803586+0000", 2024-09-17T18:15:39.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032411459999999999 2024-09-17T18:15:39.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.803627+0000", 2024-09-17T18:15:39.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0602999999999997e-05 2024-09-17T18:15:39.050 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.050 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.050 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.050 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.7s3 42/31 ECSubWrite(tid=100, reqid=osd.4.0:97, at_version=0'0, trim_to=0'0, roll_forward_to=42'29))", 2024-09-17T18:15:39.050 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.801759+0000", 2024-09-17T18:15:39.050 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.1575313439999999, 2024-09-17T18:15:39.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046142400000000004, 2024-09-17T18:15:39.051 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.051 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.051 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:39.051 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801759+0000", 2024-09-17T18:15:39.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801759+0000", 2024-09-17T18:15:39.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801760+0000", 2024-09-17T18:15:39.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-06 2024-09-17T18:15:39.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801780+0000", 2024-09-17T18:15:39.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9510000000000001e-05 2024-09-17T18:15:39.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801809+0000", 2024-09-17T18:15:39.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9904999999999999e-05 2024-09-17T18:15:39.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801827+0000", 2024-09-17T18:15:39.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7419e-05 2024-09-17T18:15:39.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801903+0000", 2024-09-17T18:15:39.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6107999999999997e-05 2024-09-17T18:15:39.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801913+0000", 2024-09-17T18:15:39.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5640000000000002e-06 2024-09-17T18:15:39.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.806336+0000", 2024-09-17T18:15:39.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044236099999999997 2024-09-17T18:15:39.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.806373+0000", 2024-09-17T18:15:39.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6613999999999999e-05 2024-09-17T18:15:39.055 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.055 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.055 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.055 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 42/31 ECSubWrite(tid=101, reqid=osd.4.0:99, at_version=0'0, trim_to=0'0, roll_forward_to=42'34))", 2024-09-17T18:15:39.055 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.804262+0000", 2024-09-17T18:15:39.055 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.15502766, 2024-09-17T18:15:39.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078186479999999992, 2024-09-17T18:15:39.055 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.055 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.055 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:39.056 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804262+0000", 2024-09-17T18:15:39.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804262+0000", 2024-09-17T18:15:39.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804263+0000", 2024-09-17T18:15:39.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4700000000000001e-07 2024-09-17T18:15:39.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804271+0000", 2024-09-17T18:15:39.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4330000000000004e-06 2024-09-17T18:15:39.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804284+0000", 2024-09-17T18:15:39.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2228e-05 2024-09-17T18:15:39.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804292+0000", 2024-09-17T18:15:39.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1380000000000007e-06 2024-09-17T18:15:39.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804368+0000", 2024-09-17T18:15:39.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6019999999999994e-05 2024-09-17T18:15:39.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804379+0000", 2024-09-17T18:15:39.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1484000000000001e-05 2024-09-17T18:15:39.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.812043+0000", 2024-09-17T18:15:39.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0076641010000000004 2024-09-17T18:15:39.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.812081+0000", 2024-09-17T18:15:39.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7496999999999997e-05 2024-09-17T18:15:39.059 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.060 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.060 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.060 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.060 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.060 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:39.062 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T18:15:39.063 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:39.058+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:39.063 INFO:tasks.rados.rados.0.smithi154.stdout:138: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-17T18:15:39.064 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:39.064 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 137278 2024-09-17T18:15:39.064 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:39.064 INFO:tasks.rados.rados.0.smithi154.stdout:140: finishing copy_from racing read to smithi15432074-44 2024-09-17T18:15:39.064 INFO:tasks.rados.rados.0.smithi154.stdout:140: finishing copy_from to smithi15432074-44 2024-09-17T18:15:39.064 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 44 v 19 (ObjNum 67 snap 5 seq_num 67) dirty exists 2024-09-17T18:15:39.064 INFO:tasks.rados.rados.0.smithi154.stdout:144: finishing copy_from racing read to smithi15432074-18 2024-09-17T18:15:39.064 INFO:tasks.rados.rados.0.smithi154.stdout:144: finishing copy_from to smithi15432074-18 2024-09-17T18:15:39.064 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 18 v 38 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-09-17T18:15:39.064 INFO:tasks.rados.rados.0.smithi154.stdout:132: done (9 left) 2024-09-17T18:15:39.065 INFO:tasks.rados.rados.0.smithi154.stdout:133: done (8 left) 2024-09-17T18:15:39.065 INFO:tasks.rados.rados.0.smithi154.stdout:134: done (7 left) 2024-09-17T18:15:39.065 INFO:tasks.rados.rados.0.smithi154.stdout:135: done (6 left) 2024-09-17T18:15:39.065 INFO:tasks.rados.rados.0.smithi154.stdout:136: done (5 left) 2024-09-17T18:15:39.065 INFO:tasks.rados.rados.0.smithi154.stdout:137: done (4 left) 2024-09-17T18:15:39.065 INFO:tasks.rados.rados.0.smithi154.stdout:138: done (3 left) 2024-09-17T18:15:39.065 INFO:tasks.rados.rados.0.smithi154.stdout:139: done (2 left) 2024-09-17T18:15:39.065 INFO:tasks.rados.rados.0.smithi154.stdout:140: done (1 left) 2024-09-17T18:15:39.065 INFO:tasks.rados.rados.0.smithi154.stdout:144: done (0 left) 2024-09-17T18:15:39.065 INFO:tasks.rados.rados.0.smithi154.stdout:145: rollback oid 29 current snap is 7 2024-09-17T18:15:39.065 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 29 to 5 2024-09-17T18:15:39.065 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 27 current snap is 7 2024-09-17T18:15:39.065 INFO:tasks.rados.rados.0.smithi154.stdout:146: seq_num 77 ranges {2555904=524288,3080192=524288,3604480=245760} 2024-09-17T18:15:39.066 INFO:tasks.rados.rados.0.smithi154.stdout:146: writing smithi15432074-27 from 2555904 to 3080192 tid 1 2024-09-17T18:15:39.066 INFO:tasks.rados.rados.0.smithi154.stdout:146: writing smithi15432074-27 from 3080192 to 3604480 tid 2 2024-09-17T18:15:39.066 INFO:tasks.rados.rados.0.smithi154.stdout:146: writing smithi15432074-27 from 3604480 to 3850240 tid 3 2024-09-17T18:15:39.066 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 43 current snap is 7 2024-09-17T18:15:39.066 INFO:tasks.rados.rados.0.smithi154.stdout:147: seq_num 78 ranges {720896=557056,1277952=671744,1949696=98304} 2024-09-17T18:15:39.066 INFO:tasks.rados.rados.0.smithi154.stdout:147: writing smithi15432074-43 from 720896 to 1277952 tid 1 2024-09-17T18:15:39.068 INFO:tasks.rados.rados.0.smithi154.stdout:147: writing smithi15432074-43 from 1277952 to 1949696 tid 2 2024-09-17T18:15:39.070 INFO:tasks.rados.rados.0.smithi154.stdout:147: writing smithi15432074-43 from 1949696 to 2048000 tid 3 2024-09-17T18:15:39.070 INFO:tasks.rados.rados.0.smithi154.stdout:148: snap_create 2024-09-17T18:15:39.070 INFO:tasks.rados.rados.0.smithi154.stdout:145: finishing rollback tid 0 to smithi15432074-29 2024-09-17T18:15:39.070 INFO:tasks.rados.rados.0.smithi154.stdout:145: finishing rollback tid 1 to smithi15432074-29 2024-09-17T18:15:39.070 INFO:tasks.rados.rados.0.smithi154.stdout:145: finishing rollback tid 2 to smithi15432074-29 2024-09-17T18:15:39.070 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 29 v 16 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-09-17T18:15:39.070 INFO:tasks.rados.rados.0.smithi154.stdout:146: finishing write tid 1 to smithi15432074-27 2024-09-17T18:15:39.070 INFO:tasks.rados.rados.0.smithi154.stdout:146: finishing write tid 2 to smithi15432074-27 2024-09-17T18:15:39.070 INFO:tasks.rados.rados.0.smithi154.stdout:146: finishing write tid 3 to smithi15432074-27 2024-09-17T18:15:39.071 INFO:tasks.rados.rados.0.smithi154.stdout:146: finishing write tid 4 to smithi15432074-27 2024-09-17T18:15:39.071 INFO:tasks.rados.rados.0.smithi154.stdout:146: finishing write tid 5 to smithi15432074-27 2024-09-17T18:15:39.071 INFO:tasks.rados.rados.0.smithi154.stdout:146: oid 27 updating version 0 to 38 2024-09-17T18:15:39.071 INFO:tasks.rados.rados.0.smithi154.stdout:146: oid 27 updating version 38 to 40 2024-09-17T18:15:39.071 INFO:tasks.rados.rados.0.smithi154.stdout:146: oid 27 version 40 is already newer than 39 2024-09-17T18:15:39.071 INFO:tasks.rados.rados.0.smithi154.stdout:146: oid 27 version 40 is already newer than 37 2024-09-17T18:15:39.071 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 27 v 40 (ObjNum 77 snap 7 seq_num 77) dirty exists 2024-09-17T18:15:39.071 INFO:tasks.rados.rados.0.smithi154.stdout:146: left oid 27 (ObjNum 77 snap 7 seq_num 77) 2024-09-17T18:15:39.071 INFO:tasks.rados.rados.0.smithi154.stdout:147: finishing write tid 1 to smithi15432074-43 2024-09-17T18:15:39.079 INFO:tasks.rados.rados.0.smithi154.stdout:147: finishing write tid 2 to smithi15432074-43 2024-09-17T18:15:39.081 INFO:tasks.rados.rados.0.smithi154.stdout:147: finishing write tid 3 to smithi15432074-43 2024-09-17T18:15:39.083 INFO:tasks.rados.rados.0.smithi154.stdout:147: finishing write tid 4 to smithi15432074-43 2024-09-17T18:15:39.085 INFO:tasks.rados.rados.0.smithi154.stdout:147: finishing write tid 5 to smithi15432074-43 2024-09-17T18:15:39.085 INFO:tasks.rados.rados.0.smithi154.stdout:147: oid 43 updating version 0 to 18 2024-09-17T18:15:39.085 INFO:tasks.rados.rados.0.smithi154.stdout:147: oid 43 updating version 18 to 20 2024-09-17T18:15:39.085 INFO:tasks.rados.rados.0.smithi154.stdout:147: oid 43 updating version 20 to 21 2024-09-17T18:15:39.085 INFO:tasks.rados.rados.0.smithi154.stdout:147: oid 43 version 21 is already newer than 19 2024-09-17T18:15:39.085 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 43 v 21 (ObjNum 78 snap 7 seq_num 78) dirty exists 2024-09-17T18:15:39.086 INFO:tasks.rados.rados.0.smithi154.stdout:147: left oid 43 (ObjNum 78 snap 7 seq_num 78) 2024-09-17T18:15:39.162 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:39.158+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:39.219 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:39.219 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:39.219 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-17T18:15:39.219 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:39.234 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T18:15:39.264 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:39.263+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:39.365 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:39.361+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:39.394 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:39.394 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:39.394 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-17T18:15:39.394 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-17T18:15:39.395 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:39.407 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T18:15:39.465 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:39.462+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:39.533 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:39.533 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-17T18:15:39.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-17T18:15:39.534 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-17T18:15:39.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.534 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:244 3.bs0 3:df05abfe:::smithi15432074-30:head [append 0~704512] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-17T18:15:39.534 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.722442+0000", 2024-09-17T18:15:39.534 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.8071682520000003, 2024-09-17T18:15:39.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0097415169999999999, 2024-09-17T18:15:39.534 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.534 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.534 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:39.534 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.534 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.535 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.535 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 244 2024-09-17T18:15:39.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.535 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.722442+0000", 2024-09-17T18:15:39.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.722442+0000", 2024-09-17T18:15:39.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.722446+0000", 2024-09-17T18:15:39.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.331e-06 2024-09-17T18:15:39.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.724140+0000", 2024-09-17T18:15:39.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001694657 2024-09-17T18:15:39.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.724176+0000", 2024-09-17T18:15:39.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6103999999999999e-05 2024-09-17T18:15:39.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.724193+0000", 2024-09-17T18:15:39.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6195999999999999e-05 2024-09-17T18:15:39.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.724275+0000", 2024-09-17T18:15:39.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2599e-05 2024-09-17T18:15:39.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.724355+0000", 2024-09-17T18:15:39.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9742999999999999e-05 2024-09-17T18:15:39.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725248+0000", 2024-09-17T18:15:39.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089344999999999995 2024-09-17T18:15:39.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728840+0000", 2024-09-17T18:15:39.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035920090000000002 2024-09-17T18:15:39.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:39.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.732106+0000", 2024-09-17T18:15:39.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003265511 2024-09-17T18:15:39.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.732184+0000", 2024-09-17T18:15:39.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7917000000000006e-05 2024-09-17T18:15:39.546 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.546 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.546 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.546 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:247 3.bs0 3:df05abfe:::smithi15432074-30:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-09-17T18:15:39.546 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.727312+0000", 2024-09-17T18:15:39.547 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.8022982220000001, 2024-09-17T18:15:39.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078027879999999997, 2024-09-17T18:15:39.547 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.547 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.547 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:15:39.548 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.548 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.548 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.548 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 247 2024-09-17T18:15:39.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.549 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.727312+0000", 2024-09-17T18:15:39.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.727312+0000", 2024-09-17T18:15:39.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.727313+0000", 2024-09-17T18:15:39.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.54e-07 2024-09-17T18:15:39.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.727317+0000", 2024-09-17T18:15:39.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6030000000000001e-06 2024-09-17T18:15:39.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.727328+0000", 2024-09-17T18:15:39.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1008e-05 2024-09-17T18:15:39.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.727334+0000", 2024-09-17T18:15:39.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-09-17T18:15:39.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728914+0000", 2024-09-17T18:15:39.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001579158 2024-09-17T18:15:39.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for rw locks", 2024-09-17T18:15:39.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.729124+0000", 2024-09-17T18:15:39.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000210612 2024-09-17T18:15:39.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.734006+0000", 2024-09-17T18:15:39.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048817399999999999 2024-09-17T18:15:39.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.734092+0000", 2024-09-17T18:15:39.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6273000000000006e-05 2024-09-17T18:15:39.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.735115+0000", 2024-09-17T18:15:39.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010229830000000001 2024-09-17T18:15:39.553 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.553 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.553 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.553 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:256 3.7s0 3:e2d87ed6:::smithi15432074-32:head [read 0~524288,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:15:39.553 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:33.723485+0000", 2024-09-17T18:15:39.553 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.8061256639999996, 2024-09-17T18:15:39.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007184597, 2024-09-17T18:15:39.553 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.553 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.554 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:15:39.554 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.554 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.554 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.554 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 256 2024-09-17T18:15:39.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.554 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723485+0000", 2024-09-17T18:15:39.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723485+0000", 2024-09-17T18:15:39.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723488+0000", 2024-09-17T18:15:39.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.74e-06 2024-09-17T18:15:39.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723499+0000", 2024-09-17T18:15:39.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1409e-05 2024-09-17T18:15:39.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723522+0000", 2024-09-17T18:15:39.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2558e-05 2024-09-17T18:15:39.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723532+0000", 2024-09-17T18:15:39.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0674e-05 2024-09-17T18:15:39.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723621+0000", 2024-09-17T18:15:39.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8504000000000005e-05 2024-09-17T18:15:39.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-17T18:15:39.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723630+0000", 2024-09-17T18:15:39.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8429999999999999e-06 2024-09-17T18:15:39.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.726763+0000", 2024-09-17T18:15:39.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031328520000000002 2024-09-17T18:15:39.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.726886+0000", 2024-09-17T18:15:39.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012359799999999999 2024-09-17T18:15:39.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.730670+0000", 2024-09-17T18:15:39.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037834190000000001 2024-09-17T18:15:39.559 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.559 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.559 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.559 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:257 3.7s0 3:e2d87ed6:::smithi15432074-32:head [read 0~524288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:15:39.560 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:33.723555+0000", 2024-09-17T18:15:39.560 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.8060559000000005, 2024-09-17T18:15:39.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077934429999999997, 2024-09-17T18:15:39.560 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.560 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.560 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:15:39.560 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.560 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.560 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.560 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 257 2024-09-17T18:15:39.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.560 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723555+0000", 2024-09-17T18:15:39.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723555+0000", 2024-09-17T18:15:39.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723555+0000", 2024-09-17T18:15:39.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.96e-07 2024-09-17T18:15:39.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723559+0000", 2024-09-17T18:15:39.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2470000000000002e-06 2024-09-17T18:15:39.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723564+0000", 2024-09-17T18:15:39.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6489999999999999e-06 2024-09-17T18:15:39.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723567+0000", 2024-09-17T18:15:39.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1269999999999999e-06 2024-09-17T18:15:39.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723700+0000", 2024-09-17T18:15:39.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133332 2024-09-17T18:15:39.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:39.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723705+0000", 2024-09-17T18:15:39.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6269999999999999e-06 2024-09-17T18:15:39.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.727429+0000", 2024-09-17T18:15:39.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037240939999999998 2024-09-17T18:15:39.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.727533+0000", 2024-09-17T18:15:39.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010367200000000001 2024-09-17T18:15:39.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.731348+0000", 2024-09-17T18:15:39.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038152989999999999 2024-09-17T18:15:39.565 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.565 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.565 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.565 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:258 3.7s0 3:e2d87ed6:::smithi15432074-32:head [read 0~524288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:15:39.565 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:33.723600+0000", 2024-09-17T18:15:39.565 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.8060108459999995, 2024-09-17T18:15:39.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087382680000000004, 2024-09-17T18:15:39.566 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.566 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.566 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:15:39.566 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.566 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.566 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.566 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 258 2024-09-17T18:15:39.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.566 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723600+0000", 2024-09-17T18:15:39.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723600+0000", 2024-09-17T18:15:39.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723600+0000", 2024-09-17T18:15:39.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3200000000000001e-07 2024-09-17T18:15:39.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723602+0000", 2024-09-17T18:15:39.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.978e-06 2024-09-17T18:15:39.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723607+0000", 2024-09-17T18:15:39.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6519999999999997e-06 2024-09-17T18:15:39.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723610+0000", 2024-09-17T18:15:39.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9450000000000002e-06 2024-09-17T18:15:39.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723727+0000", 2024-09-17T18:15:39.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117638 2024-09-17T18:15:39.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:39.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.723731+0000", 2024-09-17T18:15:39.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7000000000000002e-06 2024-09-17T18:15:39.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.729426+0000", 2024-09-17T18:15:39.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056950380000000004 2024-09-17T18:15:39.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.729532+0000", 2024-09-17T18:15:39.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105808 2024-09-17T18:15:39.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:33.732338+0000", 2024-09-17T18:15:39.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002806177 2024-09-17T18:15:39.570 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.570 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.570 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.571 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:343 3.7s0 3:ef12b1fb:::smithi15432074-35:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:39.571 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763631+0000", 2024-09-17T18:15:39.571 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.7659792919999999, 2024-09-17T18:15:39.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028740952, 2024-09-17T18:15:39.571 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.571 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.571 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:39.571 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.571 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.571 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.571 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 343 2024-09-17T18:15:39.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.572 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763631+0000", 2024-09-17T18:15:39.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763631+0000", 2024-09-17T18:15:39.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763634+0000", 2024-09-17T18:15:39.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8700000000000001e-06 2024-09-17T18:15:39.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763644+0000", 2024-09-17T18:15:39.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4800000000000007e-06 2024-09-17T18:15:39.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763670+0000", 2024-09-17T18:15:39.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6499000000000002e-05 2024-09-17T18:15:39.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763684+0000", 2024-09-17T18:15:39.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.342e-05 2024-09-17T18:15:39.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763779+0000", 2024-09-17T18:15:39.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5001999999999996e-05 2024-09-17T18:15:39.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-17T18:15:39.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763788+0000", 2024-09-17T18:15:39.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4490000000000005e-06 2024-09-17T18:15:39.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.768186+0000", 2024-09-17T18:15:39.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043976350000000004 2024-09-17T18:15:39.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.768335+0000", 2024-09-17T18:15:39.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014973800000000001 2024-09-17T18:15:39.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.769389+0000", 2024-09-17T18:15:39.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010536409999999999 2024-09-17T18:15:39.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778459+0000", 2024-09-17T18:15:39.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090703020000000006 2024-09-17T18:15:39.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:39.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792276+0000", 2024-09-17T18:15:39.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013816716 2024-09-17T18:15:39.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792372+0000", 2024-09-17T18:15:39.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6199999999999994e-05 2024-09-17T18:15:39.578 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.578 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.578 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.578 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:344 3.7s0 3:ef12b1fb:::smithi15432074-35:head [rollback 6] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:39.578 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763714+0000", 2024-09-17T18:15:39.578 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.765896897, 2024-09-17T18:15:39.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.031319132999999999, 2024-09-17T18:15:39.578 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.578 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.578 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:39.578 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.579 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.579 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.579 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 344 2024-09-17T18:15:39.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.579 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763714+0000", 2024-09-17T18:15:39.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763714+0000", 2024-09-17T18:15:39.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763714+0000", 2024-09-17T18:15:39.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5099999999999999e-07 2024-09-17T18:15:39.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763718+0000", 2024-09-17T18:15:39.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4970000000000001e-06 2024-09-17T18:15:39.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763729+0000", 2024-09-17T18:15:39.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0736e-05 2024-09-17T18:15:39.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763735+0000", 2024-09-17T18:15:39.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8229999999999997e-06 2024-09-17T18:15:39.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763871+0000", 2024-09-17T18:15:39.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013522100000000001 2024-09-17T18:15:39.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:39.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763876+0000", 2024-09-17T18:15:39.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.558e-06 2024-09-17T18:15:39.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.770394+0000", 2024-09-17T18:15:39.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065179189999999996 2024-09-17T18:15:39.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.770558+0000", 2024-09-17T18:15:39.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016384900000000001 2024-09-17T18:15:39.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771591+0000", 2024-09-17T18:15:39.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001033525 2024-09-17T18:15:39.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778461+0000", 2024-09-17T18:15:39.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068693390000000003 2024-09-17T18:15:39.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:39.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.794971+0000", 2024-09-17T18:15:39.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016509751 2024-09-17T18:15:39.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795033+0000", 2024-09-17T18:15:39.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2263999999999999e-05 2024-09-17T18:15:39.584 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.584 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.584 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.585 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:345 3.7s0 3:ef12b1fb:::smithi15432074-35:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:39.585 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763766+0000", 2024-09-17T18:15:39.585 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.765844738, 2024-09-17T18:15:39.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.031400627, 2024-09-17T18:15:39.585 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.585 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.585 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:39.585 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.585 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.585 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.585 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 345 2024-09-17T18:15:39.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.586 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763766+0000", 2024-09-17T18:15:39.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763766+0000", 2024-09-17T18:15:39.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763766+0000", 2024-09-17T18:15:39.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-17T18:15:39.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763780+0000", 2024-09-17T18:15:39.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3183000000000001e-05 2024-09-17T18:15:39.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763809+0000", 2024-09-17T18:15:39.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9167999999999999e-05 2024-09-17T18:15:39.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763816+0000", 2024-09-17T18:15:39.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7700000000000004e-06 2024-09-17T18:15:39.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763948+0000", 2024-09-17T18:15:39.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013241500000000001 2024-09-17T18:15:39.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:39.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763952+0000", 2024-09-17T18:15:39.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9949999999999999e-06 2024-09-17T18:15:39.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772256+0000", 2024-09-17T18:15:39.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0083035609999999992 2024-09-17T18:15:39.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772431+0000", 2024-09-17T18:15:39.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000175864 2024-09-17T18:15:39.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773218+0000", 2024-09-17T18:15:39.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00078638500000000001 2024-09-17T18:15:39.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778464+0000", 2024-09-17T18:15:39.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052463689999999999 2024-09-17T18:15:39.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:39.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795129+0000", 2024-09-17T18:15:39.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016664447999999998 2024-09-17T18:15:39.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795166+0000", 2024-09-17T18:15:39.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7880000000000003e-05 2024-09-17T18:15:39.591 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.591 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.591 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.591 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:352 3.7s0 3:e2d87ed6:::smithi15432074-32:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:39.591 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763830+0000", 2024-09-17T18:15:39.591 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.7657803439999999, 2024-09-17T18:15:39.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.031647704999999998, 2024-09-17T18:15:39.591 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.592 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.592 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:39.592 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.592 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.592 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.592 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 352 2024-09-17T18:15:39.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.592 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763830+0000", 2024-09-17T18:15:39.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763830+0000", 2024-09-17T18:15:39.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763831+0000", 2024-09-17T18:15:39.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3300000000000002e-07 2024-09-17T18:15:39.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763834+0000", 2024-09-17T18:15:39.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1480000000000002e-06 2024-09-17T18:15:39.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763844+0000", 2024-09-17T18:15:39.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8740000000000007e-06 2024-09-17T18:15:39.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763861+0000", 2024-09-17T18:15:39.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7380999999999998e-05 2024-09-17T18:15:39.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763994+0000", 2024-09-17T18:15:39.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013322900000000001 2024-09-17T18:15:39.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:39.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763998+0000", 2024-09-17T18:15:39.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6770000000000001e-06 2024-09-17T18:15:39.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773657+0000", 2024-09-17T18:15:39.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0096587779999999998 2024-09-17T18:15:39.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773769+0000", 2024-09-17T18:15:39.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000112469 2024-09-17T18:15:39.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775181+0000", 2024-09-17T18:15:39.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00141125 2024-09-17T18:15:39.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.782500+0000", 2024-09-17T18:15:39.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0073196290000000002 2024-09-17T18:15:39.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:39.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795418+0000", 2024-09-17T18:15:39.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012917699 2024-09-17T18:15:39.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795478+0000", 2024-09-17T18:15:39.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0037999999999997e-05 2024-09-17T18:15:39.598 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.598 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.599 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.599 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:353 3.7s0 3:e2d87ed6:::smithi15432074-32:head [rollback 5] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:39.599 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763899+0000", 2024-09-17T18:15:39.599 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.765711448, 2024-09-17T18:15:39.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.037287898, 2024-09-17T18:15:39.599 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.599 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.599 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:39.599 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.599 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.599 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.599 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 353 2024-09-17T18:15:39.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.600 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763899+0000", 2024-09-17T18:15:39.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763899+0000", 2024-09-17T18:15:39.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763900+0000", 2024-09-17T18:15:39.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6499999999999999e-07 2024-09-17T18:15:39.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763903+0000", 2024-09-17T18:15:39.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4089999999999999e-06 2024-09-17T18:15:39.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763915+0000", 2024-09-17T18:15:39.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1377e-05 2024-09-17T18:15:39.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763921+0000", 2024-09-17T18:15:39.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6619999999999999e-06 2024-09-17T18:15:39.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764038+0000", 2024-09-17T18:15:39.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117268 2024-09-17T18:15:39.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:39.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764045+0000", 2024-09-17T18:15:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2519999999999996e-06 2024-09-17T18:15:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776881+0000", 2024-09-17T18:15:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012836683999999999 2024-09-17T18:15:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776973+0000", 2024-09-17T18:15:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1181999999999995e-05 2024-09-17T18:15:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.777499+0000", 2024-09-17T18:15:39.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052648199999999999 2024-09-17T18:15:39.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.782503+0000", 2024-09-17T18:15:39.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0050035330000000001 2024-09-17T18:15:39.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:39.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801117+0000", 2024-09-17T18:15:39.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018614557 2024-09-17T18:15:39.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801187+0000", 2024-09-17T18:15:39.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9926999999999996e-05 2024-09-17T18:15:39.606 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.607 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.607 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.607 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:354 3.7s0 3:e2d87ed6:::smithi15432074-32:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:39.607 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763944+0000", 2024-09-17T18:15:39.607 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.7656669219999999, 2024-09-17T18:15:39.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.037407294000000001, 2024-09-17T18:15:39.607 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.607 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.607 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:39.607 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.607 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.608 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.608 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 354 2024-09-17T18:15:39.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.608 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763944+0000", 2024-09-17T18:15:39.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763944+0000", 2024-09-17T18:15:39.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763944+0000", 2024-09-17T18:15:39.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0699999999999997e-07 2024-09-17T18:15:39.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763947+0000", 2024-09-17T18:15:39.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1379999999999999e-06 2024-09-17T18:15:39.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763956+0000", 2024-09-17T18:15:39.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3340000000000002e-06 2024-09-17T18:15:39.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763962+0000", 2024-09-17T18:15:39.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9070000000000004e-06 2024-09-17T18:15:39.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764112+0000", 2024-09-17T18:15:39.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000150359 2024-09-17T18:15:39.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:39.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764120+0000", 2024-09-17T18:15:39.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9300000000000003e-06 2024-09-17T18:15:39.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778500+0000", 2024-09-17T18:15:39.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014380469 2024-09-17T18:15:39.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778584+0000", 2024-09-17T18:15:39.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3978000000000001e-05 2024-09-17T18:15:39.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778997+0000", 2024-09-17T18:15:39.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000413075 2024-09-17T18:15:39.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.782506+0000", 2024-09-17T18:15:39.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035086150000000001 2024-09-17T18:15:39.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:39.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801311+0000", 2024-09-17T18:15:39.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018804647000000001 2024-09-17T18:15:39.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801351+0000", 2024-09-17T18:15:39.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0334999999999999e-05 2024-09-17T18:15:39.616 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.616 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.616 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.616 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:358 3.bs0 3:df05abfe:::smithi15432074-30:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:39.617 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.764224+0000", 2024-09-17T18:15:39.617 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.765386481, 2024-09-17T18:15:39.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028742235000000001, 2024-09-17T18:15:39.617 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.617 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.617 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:39.617 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.617 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.617 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.617 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 358 2024-09-17T18:15:39.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.618 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764224+0000", 2024-09-17T18:15:39.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764224+0000", 2024-09-17T18:15:39.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764226+0000", 2024-09-17T18:15:39.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7439999999999999e-06 2024-09-17T18:15:39.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764233+0000", 2024-09-17T18:15:39.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.294e-06 2024-09-17T18:15:39.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764251+0000", 2024-09-17T18:15:39.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8096000000000001e-05 2024-09-17T18:15:39.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764261+0000", 2024-09-17T18:15:39.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5089999999999999e-06 2024-09-17T18:15:39.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764381+0000", 2024-09-17T18:15:39.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000119911 2024-09-17T18:15:39.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-17T18:15:39.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764389+0000", 2024-09-17T18:15:39.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1489999999999994e-06 2024-09-17T18:15:39.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.770178+0000", 2024-09-17T18:15:39.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057893149999999997 2024-09-17T18:15:39.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.770354+0000", 2024-09-17T18:15:39.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017578200000000001 2024-09-17T18:15:39.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771556+0000", 2024-09-17T18:15:39.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012016399999999999 2024-09-17T18:15:39.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773874+0000", 2024-09-17T18:15:39.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023185810000000001 2024-09-17T18:15:39.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:39.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792865+0000", 2024-09-17T18:15:39.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018991340999999998 2024-09-17T18:15:39.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792966+0000", 2024-09-17T18:15:39.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010087299999999999 2024-09-17T18:15:39.623 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.624 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.624 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.624 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:359 3.bs0 3:df05abfe:::smithi15432074-30:head [rollback 4] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:39.624 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.764292+0000", 2024-09-17T18:15:39.624 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.7653185549999999, 2024-09-17T18:15:39.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028870689000000001, 2024-09-17T18:15:39.624 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.624 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.624 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:39.624 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.624 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.625 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.625 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 359 2024-09-17T18:15:39.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.625 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764292+0000", 2024-09-17T18:15:39.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764292+0000", 2024-09-17T18:15:39.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764293+0000", 2024-09-17T18:15:39.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8000000000000004e-07 2024-09-17T18:15:39.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764299+0000", 2024-09-17T18:15:39.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0719999999999996e-06 2024-09-17T18:15:39.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764325+0000", 2024-09-17T18:15:39.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6489e-05 2024-09-17T18:15:39.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764337+0000", 2024-09-17T18:15:39.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1096e-05 2024-09-17T18:15:39.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764445+0000", 2024-09-17T18:15:39.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000108256 2024-09-17T18:15:39.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:39.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764453+0000", 2024-09-17T18:15:39.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5799999999999992e-06 2024-09-17T18:15:39.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772725+0000", 2024-09-17T18:15:39.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082712089999999999 2024-09-17T18:15:39.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772821+0000", 2024-09-17T18:15:39.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6620999999999995e-05 2024-09-17T18:15:39.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773493+0000", 2024-09-17T18:15:39.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00067135899999999995 2024-09-17T18:15:39.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781853+0000", 2024-09-17T18:15:39.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0083605039999999995 2024-09-17T18:15:39.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:39.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.793103+0000", 2024-09-17T18:15:39.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011249687 2024-09-17T18:15:39.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.793163+0000", 2024-09-17T18:15:39.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9935999999999997e-05 2024-09-17T18:15:39.630 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.631 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.631 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.631 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:360 3.bs0 3:df05abfe:::smithi15432074-30:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:39.631 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.764354+0000", 2024-09-17T18:15:39.631 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.765256599, 2024-09-17T18:15:39.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.030712617000000001, 2024-09-17T18:15:39.631 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.631 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.631 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:39.632 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.632 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.632 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.632 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 360 2024-09-17T18:15:39.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.632 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764354+0000", 2024-09-17T18:15:39.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764354+0000", 2024-09-17T18:15:39.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764355+0000", 2024-09-17T18:15:39.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1200000000000001e-07 2024-09-17T18:15:39.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764359+0000", 2024-09-17T18:15:39.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5179999999999998e-06 2024-09-17T18:15:39.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764372+0000", 2024-09-17T18:15:39.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2284e-05 2024-09-17T18:15:39.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764383+0000", 2024-09-17T18:15:39.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1687e-05 2024-09-17T18:15:39.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764511+0000", 2024-09-17T18:15:39.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012773799999999999 2024-09-17T18:15:39.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:39.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764522+0000", 2024-09-17T18:15:39.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0898e-05 2024-09-17T18:15:39.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774059+0000", 2024-09-17T18:15:39.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0095365880000000004 2024-09-17T18:15:39.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774152+0000", 2024-09-17T18:15:39.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3352999999999999e-05 2024-09-17T18:15:39.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774946+0000", 2024-09-17T18:15:39.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00079374800000000004 2024-09-17T18:15:39.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781856+0000", 2024-09-17T18:15:39.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006910406 2024-09-17T18:15:39.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:39.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795004+0000", 2024-09-17T18:15:39.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01314805 2024-09-17T18:15:39.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795067+0000", 2024-09-17T18:15:39.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2434999999999994e-05 2024-09-17T18:15:39.639 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.639 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.639 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.639 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.as6 42/31 ECSubWrite(tid=168, reqid=osd.13.0:168, at_version=42'33, trim_to=0'0, roll_forward_to=39'31))", 2024-09-17T18:15:39.639 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.811050+0000", 2024-09-17T18:15:39.640 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.7185609340000001, 2024-09-17T18:15:39.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007199647, 2024-09-17T18:15:39.640 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.640 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.640 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:39.640 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.811050+0000", 2024-09-17T18:15:39.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.811050+0000", 2024-09-17T18:15:39.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.811050+0000", 2024-09-17T18:15:39.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8999999999999996e-07 2024-09-17T18:15:39.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.811067+0000", 2024-09-17T18:15:39.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6365e-05 2024-09-17T18:15:39.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.811077+0000", 2024-09-17T18:15:39.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9189999999999994e-06 2024-09-17T18:15:39.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.811082+0000", 2024-09-17T18:15:39.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.356e-06 2024-09-17T18:15:39.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.811133+0000", 2024-09-17T18:15:39.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1094000000000002e-05 2024-09-17T18:15:39.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.811140+0000", 2024-09-17T18:15:39.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-09-17T18:15:39.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.818197+0000", 2024-09-17T18:15:39.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0070569439999999999 2024-09-17T18:15:39.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.818249+0000", 2024-09-17T18:15:39.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2605999999999997e-05 2024-09-17T18:15:39.645 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.645 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.645 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.645 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds6 42/31 ECSubWrite(tid=172, reqid=osd.13.0:172, at_version=42'77, trim_to=0'0, roll_forward_to=42'73))", 2024-09-17T18:15:39.645 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.820165+0000", 2024-09-17T18:15:39.645 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.7094451660000001, 2024-09-17T18:15:39.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071302780000000003, 2024-09-17T18:15:39.646 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.646 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.646 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:39.646 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820165+0000", 2024-09-17T18:15:39.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820165+0000", 2024-09-17T18:15:39.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820166+0000", 2024-09-17T18:15:39.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9700000000000005e-07 2024-09-17T18:15:39.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820192+0000", 2024-09-17T18:15:39.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5803999999999999e-05 2024-09-17T18:15:39.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820207+0000", 2024-09-17T18:15:39.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5228000000000001e-05 2024-09-17T18:15:39.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820218+0000", 2024-09-17T18:15:39.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0190000000000001e-05 2024-09-17T18:15:39.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820275+0000", 2024-09-17T18:15:39.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7142999999999998e-05 2024-09-17T18:15:39.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820279+0000", 2024-09-17T18:15:39.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7219999999999999e-06 2024-09-17T18:15:39.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.827251+0000", 2024-09-17T18:15:39.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006972064 2024-09-17T18:15:39.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.827296+0000", 2024-09-17T18:15:39.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4230000000000002e-05 2024-09-17T18:15:39.650 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.650 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.650 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.651 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:370 3.7s0 3:ea689e14:::smithi15432074-27:head [append 0~524288] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:15:39.651 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.039539+0000", 2024-09-17T18:15:39.651 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.49007170500000002, 2024-09-17T18:15:39.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010125532, 2024-09-17T18:15:39.651 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.651 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.651 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:39.651 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.651 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.651 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.651 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 370 2024-09-17T18:15:39.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.651 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.039539+0000", 2024-09-17T18:15:39.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.039539+0000", 2024-09-17T18:15:39.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.039541+0000", 2024-09-17T18:15:39.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.306e-06 2024-09-17T18:15:39.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.040600+0000", 2024-09-17T18:15:39.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001058315 2024-09-17T18:15:39.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.040639+0000", 2024-09-17T18:15:39.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9168999999999997e-05 2024-09-17T18:15:39.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.040657+0000", 2024-09-17T18:15:39.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8235000000000001e-05 2024-09-17T18:15:39.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.040760+0000", 2024-09-17T18:15:39.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000103515 2024-09-17T18:15:39.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.040892+0000", 2024-09-17T18:15:39.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013173300000000001 2024-09-17T18:15:39.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.042027+0000", 2024-09-17T18:15:39.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001135149 2024-09-17T18:15:39.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.043794+0000", 2024-09-17T18:15:39.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017666890000000001 2024-09-17T18:15:39.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:39.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.049444+0000", 2024-09-17T18:15:39.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056499580000000001 2024-09-17T18:15:39.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.049664+0000", 2024-09-17T18:15:39.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00022046300000000001 2024-09-17T18:15:39.656 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.656 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.656 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.656 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:371 3.7s0 3:ea689e14:::smithi15432074-27:head [append 0~524288] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:15:39.656 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.046713+0000", 2024-09-17T18:15:39.656 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.48289781900000001, 2024-09-17T18:15:39.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077311330000000003, 2024-09-17T18:15:39.657 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.657 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.657 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:39.657 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.657 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.657 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.657 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 371 2024-09-17T18:15:39.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.657 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.046713+0000", 2024-09-17T18:15:39.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.046713+0000", 2024-09-17T18:15:39.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.046715+0000", 2024-09-17T18:15:39.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9800000000000001e-06 2024-09-17T18:15:39.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.047444+0000", 2024-09-17T18:15:39.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000728811 2024-09-17T18:15:39.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.047466+0000", 2024-09-17T18:15:39.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2858999999999999e-05 2024-09-17T18:15:39.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.047481+0000", 2024-09-17T18:15:39.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4382999999999999e-05 2024-09-17T18:15:39.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.047556+0000", 2024-09-17T18:15:39.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5098999999999994e-05 2024-09-17T18:15:39.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.047664+0000", 2024-09-17T18:15:39.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000108545 2024-09-17T18:15:39.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.048502+0000", 2024-09-17T18:15:39.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00083764099999999997 2024-09-17T18:15:39.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.052682+0000", 2024-09-17T18:15:39.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0041796560000000003 2024-09-17T18:15:39.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:39.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.054271+0000", 2024-09-17T18:15:39.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015890170000000001 2024-09-17T18:15:39.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.054444+0000", 2024-09-17T18:15:39.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017314199999999999 2024-09-17T18:15:39.662 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.662 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.662 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.662 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:373 3.7s0 3:ea689e14:::smithi15432074-27:head [setxattr _header (56) in=7b] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:15:39.662 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.049996+0000", 2024-09-17T18:15:39.662 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.47961472300000002, 2024-09-17T18:15:39.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007182786, 2024-09-17T18:15:39.662 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.663 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.663 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:39.663 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.663 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.663 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.663 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 373 2024-09-17T18:15:39.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.663 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.049996+0000", 2024-09-17T18:15:39.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.049996+0000", 2024-09-17T18:15:39.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.049997+0000", 2024-09-17T18:15:39.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1999999999999999e-07 2024-09-17T18:15:39.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.050000+0000", 2024-09-17T18:15:39.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5640000000000001e-06 2024-09-17T18:15:39.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.050009+0000", 2024-09-17T18:15:39.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0799999999999995e-06 2024-09-17T18:15:39.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.050015+0000", 2024-09-17T18:15:39.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7060000000000001e-06 2024-09-17T18:15:39.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.052843+0000", 2024-09-17T18:15:39.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028282009999999998 2024-09-17T18:15:39.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.052936+0000", 2024-09-17T18:15:39.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2793000000000004e-05 2024-09-17T18:15:39.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:39.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.053362+0000", 2024-09-17T18:15:39.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042593200000000001 2024-09-17T18:15:39.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:39.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.056714+0000", 2024-09-17T18:15:39.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033523250000000002 2024-09-17T18:15:39.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:39.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.057095+0000", 2024-09-17T18:15:39.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038044000000000001 2024-09-17T18:15:39.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.057179+0000", 2024-09-17T18:15:39.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4024999999999996e-05 2024-09-17T18:15:39.668 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.669 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.669 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.669 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:374 3.7s0 3:ea689e14:::smithi15432074-27:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:15:39.669 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.050047+0000", 2024-09-17T18:15:39.669 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.479563882, 2024-09-17T18:15:39.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087585419999999994, 2024-09-17T18:15:39.669 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:39.669 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:39.669 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:15:39.670 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:39.670 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:39.670 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:39.670 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 374 2024-09-17T18:15:39.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.670 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:39.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:39.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.050047+0000", 2024-09-17T18:15:39.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:39.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.050047+0000", 2024-09-17T18:15:39.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:39.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:39.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.050047+0000", 2024-09-17T18:15:39.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7899999999999998e-07 2024-09-17T18:15:39.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:39.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.050051+0000", 2024-09-17T18:15:39.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6090000000000001e-06 2024-09-17T18:15:39.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:39.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.050059+0000", 2024-09-17T18:15:39.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5040000000000002e-06 2024-09-17T18:15:39.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:39.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.050065+0000", 2024-09-17T18:15:39.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7769999999999999e-06 2024-09-17T18:15:39.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.053707+0000", 2024-09-17T18:15:39.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036417860000000002 2024-09-17T18:15:39.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for rw locks", 2024-09-17T18:15:39.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.053971+0000", 2024-09-17T18:15:39.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026394800000000001 2024-09-17T18:15:39.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:39.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.057594+0000", 2024-09-17T18:15:39.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036232590000000002 2024-09-17T18:15:39.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:39.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.057868+0000", 2024-09-17T18:15:39.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027335800000000002 2024-09-17T18:15:39.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:39.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:39.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:39.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.058805+0000", 2024-09-17T18:15:39.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00093772199999999999 2024-09-17T18:15:39.675 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.675 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.675 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.675 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:39.675 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:39.675 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:39.678 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T18:15:39.678 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:39.674+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:39.770 INFO:teuthology.orchestra.run.smithi087.stderr:nodeep-scrub is set 2024-09-17T18:15:39.770 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.9 to 1 (10000) 2024-09-17T18:15:39.778 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:39.773+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:39.779 INFO:tasks.rados.rados.0.smithi154.stdout:145: done (3 left) 2024-09-17T18:15:39.779 INFO:tasks.rados.rados.0.smithi154.stdout:146: done (2 left) 2024-09-17T18:15:39.779 INFO:tasks.rados.rados.0.smithi154.stdout:147: done (1 left) 2024-09-17T18:15:39.779 INFO:tasks.rados.rados.0.smithi154.stdout:148: done (0 left) 2024-09-17T18:15:39.779 INFO:tasks.rados.rados.0.smithi154.stdout:149: snap_create 2024-09-17T18:15:39.798 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 10 1 2024-09-17T18:15:39.836 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T18:15:39.851 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:39.852 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:39.852 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-17T18:15:39.852 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:39.867 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T18:15:39.879 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:39.875+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:39.980 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:39.977+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:39.988 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:15:39.988 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:15:40.009 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:15:40.009 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:15:40.029 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:15:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:15:40.031 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:40.031 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:40.031 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-17T18:15:40.032 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-17T18:15:40.032 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:40.046 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T18:15:40.049 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:15:40.050 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:15:40.066 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:15:40.066 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:15:40.081 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:40.079+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:40.085 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:15:40.086 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:15:40.106 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:15:40.107 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:15:40.129 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:15:40.129 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:15:40.145 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:15:40.145 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:15:40.157 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:40.157 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:40.165 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:15:40.165 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:15:40.167 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T18:15:40.182 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:40.179+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:40.185 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:15:40.185 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:15:40.207 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:15:40.207 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:15:40.224 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:15:40.224 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:15:40.245 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:15:40.245 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:15:40.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:15:40.242+0000 7fcec7fff640 0 -- 172.21.15.87:0/1873087524 >> [v2:172.21.15.146:6808/950976813,v1:172.21.15.146:6809/950976813] conn(0x7fced021d030 msgr2=0x7fced021f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T18:15:40.283 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:40.279+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:40.289 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:40.290 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:40.302 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T18:15:40.387 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:40.386+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:40.455 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:40.455 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:40.470 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T18:15:40.485 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:40.483+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:40.586 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:40.581+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:40.617 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:40.617 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:40.630 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T18:15:40.687 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:40.683+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:40.763 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:40.763 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:40.773 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.10 to 1 (10000) 2024-09-17T18:15:40.777 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T18:15:40.779 INFO:tasks.rados.rados.0.smithi154.stdout:149: done (0 left) 2024-09-17T18:15:40.780 INFO:tasks.rados.rados.0.smithi154.stdout:150: snap_create 2024-09-17T18:15:40.796 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 11 1 2024-09-17T18:15:40.823 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:40.819+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:40.874 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:15:40.874 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:15:40.890 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:40.883+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:40.894 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:40.894 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:40.904 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:15:40.904 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:15:40.908 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T18:15:40.995 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:40.991+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:41.077 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:41.078 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:41.091 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:41.090+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:41.093 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T18:15:41.191 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:41.191+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:41.260 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:41.260 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:41.275 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T18:15:41.319 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:41.315+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:41.393 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:41.389+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:41.398 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:41.398 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:41.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T18:15:41.508 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:41.503+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:41.584 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:41.584 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:41.596 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:41.594+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:41.598 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T18:15:41.697 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:41.694+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:41.769 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:41.770 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:41.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T18:15:41.785 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.11 to 1 (10000) 2024-09-17T18:15:41.791 INFO:tasks.rados.rados.0.smithi154.stdout:150: done (0 left) 2024-09-17T18:15:41.792 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 33 current snap is 10 2024-09-17T18:15:41.792 INFO:tasks.rados.rados.0.smithi154.stdout:151: seq_num 79 ranges {540672=573440,1114112=425984,1540096=344064} 2024-09-17T18:15:41.797 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:41.794+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:41.801 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T18:15:41.807 INFO:tasks.rados.rados.0.smithi154.stdout:151: writing smithi15432074-33 from 540672 to 1114112 tid 1 2024-09-17T18:15:41.812 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 12 1 2024-09-17T18:15:41.813 INFO:tasks.rados.rados.0.smithi154.stdout:151: writing smithi15432074-33 from 1114112 to 1540096 tid 2 2024-09-17T18:15:41.818 INFO:tasks.rados.rados.0.smithi154.stdout:151: writing smithi15432074-33 from 1540096 to 1884160 tid 3 2024-09-17T18:15:41.819 INFO:tasks.rados.rados.0.smithi154.stdout:152: rollback oid 44 current snap is 10 2024-09-17T18:15:41.819 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 44 to 8 2024-09-17T18:15:41.819 INFO:tasks.rados.rados.0.smithi154.stdout:153: snap_create 2024-09-17T18:15:41.825 INFO:tasks.rados.rados.0.smithi154.stdout:151: finishing write tid 1 to smithi15432074-33 2024-09-17T18:15:41.826 INFO:tasks.rados.rados.0.smithi154.stdout:151: finishing write tid 2 to smithi15432074-33 2024-09-17T18:15:41.827 INFO:tasks.rados.rados.0.smithi154.stdout:151: finishing write tid 3 to smithi15432074-33 2024-09-17T18:15:41.827 INFO:tasks.rados.rados.0.smithi154.stdout:151: finishing write tid 4 to smithi15432074-33 2024-09-17T18:15:41.829 INFO:tasks.rados.rados.0.smithi154.stdout:151: finishing write tid 5 to smithi15432074-33 2024-09-17T18:15:41.829 INFO:tasks.rados.rados.0.smithi154.stdout:151: oid 33 updating version 0 to 46 2024-09-17T18:15:41.829 INFO:tasks.rados.rados.0.smithi154.stdout:151: oid 33 updating version 46 to 47 2024-09-17T18:15:41.829 INFO:tasks.rados.rados.0.smithi154.stdout:151: oid 33 updating version 47 to 48 2024-09-17T18:15:41.829 INFO:tasks.rados.rados.0.smithi154.stdout:151: oid 33 updating version 48 to 49 2024-09-17T18:15:41.829 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 33 v 49 (ObjNum 79 snap 10 seq_num 79) dirty exists 2024-09-17T18:15:41.829 INFO:tasks.rados.rados.0.smithi154.stdout:151: left oid 33 (ObjNum 79 snap 10 seq_num 79) 2024-09-17T18:15:41.830 INFO:tasks.rados.rados.0.smithi154.stdout:152: finishing rollback tid 0 to smithi15432074-44 2024-09-17T18:15:41.830 INFO:tasks.rados.rados.0.smithi154.stdout:152: finishing rollback tid 1 to smithi15432074-44 2024-09-17T18:15:41.835 INFO:tasks.rados.rados.0.smithi154.stdout:152: finishing rollback tid 2 to smithi15432074-44 2024-09-17T18:15:41.835 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 44 v 29 (ObjNum 67 snap 5 seq_num 67) dirty exists 2024-09-17T18:15:41.900 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:41.898+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:41.906 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:41.906 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:41.921 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T18:15:41.999 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:41.997+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:42.038 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:42.053 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T18:15:42.099 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:42.095+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:42.169 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:42.169 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:42.183 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T18:15:42.228 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:42.223+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:42.300 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:42.300 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:42.301 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:42.298+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:42.314 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T18:15:42.402 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:42.398+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:42.481 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:42.481 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:42.496 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T18:15:42.503 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:42.499+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:42.604 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:42.599+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:42.628 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:42.628 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:42.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T18:15:42.705 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:42.701+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:42.803 INFO:teuthology.orchestra.run.smithi087.stderr:noscrub is unset 2024-09-17T18:15:42.804 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.12 to 1 (10000) 2024-09-17T18:15:42.806 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:42.802+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:42.816 INFO:tasks.rados.rados.0.smithi154.stdout:151: done (2 left) 2024-09-17T18:15:42.816 INFO:tasks.rados.rados.0.smithi154.stdout:152: done (1 left) 2024-09-17T18:15:42.816 INFO:tasks.rados.rados.0.smithi154.stdout:153: done (0 left) 2024-09-17T18:15:42.816 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 10 current snap is 11 2024-09-17T18:15:42.816 INFO:tasks.rados.rados.0.smithi154.stdout:154: seq_num 80 ranges {589824=589824,1179648=573440,1753088=196608} 2024-09-17T18:15:42.825 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T18:15:42.828 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 13 1 2024-09-17T18:15:42.834 INFO:tasks.rados.rados.0.smithi154.stdout:154: writing smithi15432074-10 from 589824 to 1179648 tid 1 2024-09-17T18:15:42.843 INFO:tasks.rados.rados.0.smithi154.stdout:154: writing smithi15432074-10 from 1179648 to 1753088 tid 2 2024-09-17T18:15:42.846 INFO:tasks.rados.rados.0.smithi154.stdout:154: writing smithi15432074-10 from 1753088 to 1949696 tid 3 2024-09-17T18:15:42.846 INFO:tasks.rados.rados.0.smithi154.stdout:155: snap_create 2024-09-17T18:15:42.851 INFO:tasks.rados.rados.0.smithi154.stdout:154: finishing write tid 1 to smithi15432074-10 2024-09-17T18:15:42.855 INFO:tasks.rados.rados.0.smithi154.stdout:154: finishing write tid 2 to smithi15432074-10 2024-09-17T18:15:42.858 INFO:tasks.rados.rados.0.smithi154.stdout:154: finishing write tid 3 to smithi15432074-10 2024-09-17T18:15:42.859 INFO:tasks.rados.rados.0.smithi154.stdout:154: finishing write tid 4 to smithi15432074-10 2024-09-17T18:15:42.863 INFO:tasks.rados.rados.0.smithi154.stdout:154: finishing write tid 5 to smithi15432074-10 2024-09-17T18:15:42.863 INFO:tasks.rados.rados.0.smithi154.stdout:154: oid 10 updating version 0 to 100 2024-09-17T18:15:42.863 INFO:tasks.rados.rados.0.smithi154.stdout:154: oid 10 version 100 is already newer than 98 2024-09-17T18:15:42.863 INFO:tasks.rados.rados.0.smithi154.stdout:154: oid 10 version 100 is already newer than 99 2024-09-17T18:15:42.863 INFO:tasks.rados.rados.0.smithi154.stdout:154: oid 10 version 100 is already newer than 97 2024-09-17T18:15:42.863 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 10 v 100 (ObjNum 80 snap 11 seq_num 80) dirty exists 2024-09-17T18:15:42.864 INFO:tasks.rados.rados.0.smithi154.stdout:154: left oid 10 (ObjNum 80 snap 11 seq_num 80) 2024-09-17T18:15:42.908 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:42.905+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:42.925 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T18:15:42.945 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:42.946 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:42.959 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T18:15:43.009 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:43.003+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:43.077 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:15:43.077 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:15:43.082 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:43.082 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:43.097 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T18:15:43.097 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:15:43.098 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:15:43.110 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:43.105+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:43.115 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:15:43.115 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:15:43.136 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:15:43.136 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:15:43.155 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:15:43.155 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:15:43.175 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:15:43.175 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:15:43.192 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:15:43.192 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:15:43.210 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:43.205+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:43.212 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:15:43.213 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:15:43.229 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:15:43.229 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:15:43.248 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:15:43.249 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:15:43.265 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:43.265 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:43.265 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:15:43.265 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:15:43.265 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:43.270 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:15:43.270 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:15:43.280 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T18:15:43.291 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:15:43.291 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:15:43.311 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:15:43.312 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:15:43.312 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:43.310+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:43.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:15:43.330+0000 7f9a6ffff640 0 -- 172.21.15.87:0/2224586731 >> [v2:172.21.15.134:6800/3397465529,v1:172.21.15.134:6801/3397465529] conn(0x7f9a7021c2f0 msgr2=0x7f9a7021e6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T18:15:43.336 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:15:43.358 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:15:43.358 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:15:43.380 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:15:43.380 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:15:43.408 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:43.409 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:15:43.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:15:43.409 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-17T18:15:43.409 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.409 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.409 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:13.571510+0000", 2024-09-17T18:15:43.409 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.833315716000001, 2024-09-17T18:15:43.409 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.35549906399999998, 2024-09-17T18:15:43.409 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.409 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.409 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.409 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.410 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.410 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.410 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 1 2024-09-17T18:15:43.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.410 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571510+0000", 2024-09-17T18:15:43.410 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.410 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.410 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.410 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571510+0000", 2024-09-17T18:15:43.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571513+0000", 2024-09-17T18:15:43.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5900000000000002e-06 2024-09-17T18:15:43.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.411 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.411 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571526+0000", 2024-09-17T18:15:43.411 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3106e-05 2024-09-17T18:15:43.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.411 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571548+0000", 2024-09-17T18:15:43.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1832999999999999e-05 2024-09-17T18:15:43.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571568+0000", 2024-09-17T18:15:43.412 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0446e-05 2024-09-17T18:15:43.412 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.412 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.412 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.412 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571715+0000", 2024-09-17T18:15:43.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000146475 2024-09-17T18:15:43.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-17T18:15:43.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571741+0000", 2024-09-17T18:15:43.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6009000000000001e-05 2024-09-17T18:15:43.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.413 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.413 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.413 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.922992+0000", 2024-09-17T18:15:43.413 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.35125145800000002 2024-09-17T18:15:43.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.923283+0000", 2024-09-17T18:15:43.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00029046999999999998 2024-09-17T18:15:43.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.923607+0000", 2024-09-17T18:15:43.414 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00032395200000000002 2024-09-17T18:15:43.414 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.414 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.414 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.414 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.924798+0000", 2024-09-17T18:15:43.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011917329999999999 2024-09-17T18:15:43.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.926847+0000", 2024-09-17T18:15:43.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020485009999999999 2024-09-17T18:15:43.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.415 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.415 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.926945+0000", 2024-09-17T18:15:43.415 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7750000000000004e-05 2024-09-17T18:15:43.415 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.415 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.416 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.416 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.927009+0000", 2024-09-17T18:15:43.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4740999999999996e-05 2024-09-17T18:15:43.416 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.416 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.416 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.416 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.416 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.416 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.416 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073054+0000", 2024-09-17T18:15:43.416 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.331772129000001, 2024-09-17T18:15:43.416 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017781126000000001, 2024-09-17T18:15:43.417 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.417 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.417 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.417 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.417 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.417 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.417 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 47 2024-09-17T18:15:43.417 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.417 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.417 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.417 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.417 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073054+0000", 2024-09-17T18:15:43.417 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073054+0000", 2024-09-17T18:15:43.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.418 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073055+0000", 2024-09-17T18:15:43.418 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4700000000000001e-07 2024-09-17T18:15:43.418 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.418 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.418 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073138+0000", 2024-09-17T18:15:43.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3607000000000001e-05 2024-09-17T18:15:43.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073153+0000", 2024-09-17T18:15:43.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4969e-05 2024-09-17T18:15:43.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.419 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.419 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.419 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073161+0000", 2024-09-17T18:15:43.419 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6000000000000001e-06 2024-09-17T18:15:43.419 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.084558+0000", 2024-09-17T18:15:43.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011397457999999999 2024-09-17T18:15:43.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.084732+0000", 2024-09-17T18:15:43.420 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000173401 2024-09-17T18:15:43.420 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.420 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.420 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.420 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.084940+0000", 2024-09-17T18:15:43.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020803400000000001 2024-09-17T18:15:43.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090671+0000", 2024-09-17T18:15:43.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0057309450000000003 2024-09-17T18:15:43.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.421 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.421 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090695+0000", 2024-09-17T18:15:43.421 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3932000000000001e-05 2024-09-17T18:15:43.421 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.421 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090771+0000", 2024-09-17T18:15:43.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6014999999999996e-05 2024-09-17T18:15:43.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.422 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.422 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090835+0000", 2024-09-17T18:15:43.422 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4418000000000006e-05 2024-09-17T18:15:43.422 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.422 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.422 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.422 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.422 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.423 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.423 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073198+0000", 2024-09-17T18:15:43.423 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.331627907000001, 2024-09-17T18:15:43.423 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018005944999999999, 2024-09-17T18:15:43.423 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.423 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.423 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.423 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.423 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.423 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.423 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 48 2024-09-17T18:15:43.423 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.423 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073198+0000", 2024-09-17T18:15:43.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073198+0000", 2024-09-17T18:15:43.424 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.424 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.424 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.424 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.424 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073199+0000", 2024-09-17T18:15:43.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7599999999999996e-07 2024-09-17T18:15:43.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073205+0000", 2024-09-17T18:15:43.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2840000000000003e-06 2024-09-17T18:15:43.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.425 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.425 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073221+0000", 2024-09-17T18:15:43.425 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5498999999999998e-05 2024-09-17T18:15:43.425 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.425 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073246+0000", 2024-09-17T18:15:43.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4793000000000001e-05 2024-09-17T18:15:43.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.085863+0000", 2024-09-17T18:15:43.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012617033 2024-09-17T18:15:43.426 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.426 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.426 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.426 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.085983+0000", 2024-09-17T18:15:43.426 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012071299999999999 2024-09-17T18:15:43.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.086174+0000", 2024-09-17T18:15:43.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000190457 2024-09-17T18:15:43.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.427 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.427 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090925+0000", 2024-09-17T18:15:43.427 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047513659999999999 2024-09-17T18:15:43.427 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.427 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091032+0000", 2024-09-17T18:15:43.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106933 2024-09-17T18:15:43.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091143+0000", 2024-09-17T18:15:43.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111197 2024-09-17T18:15:43.428 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.428 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.428 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091204+0000", 2024-09-17T18:15:43.428 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0794000000000001e-05 2024-09-17T18:15:43.429 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.429 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.429 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.429 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.429 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.429 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073262+0000", 2024-09-17T18:15:43.429 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.331564418999999, 2024-09-17T18:15:43.429 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018090469000000001, 2024-09-17T18:15:43.429 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.429 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.429 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.430 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.430 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.430 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.430 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 49 2024-09-17T18:15:43.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.430 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.430 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073262+0000", 2024-09-17T18:15:43.430 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.430 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073262+0000", 2024-09-17T18:15:43.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073263+0000", 2024-09-17T18:15:43.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0160000000000001e-06 2024-09-17T18:15:43.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.431 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.431 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073269+0000", 2024-09-17T18:15:43.431 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0039999999999996e-06 2024-09-17T18:15:43.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.432 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073283+0000", 2024-09-17T18:15:43.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4559000000000001e-05 2024-09-17T18:15:43.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.432 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.432 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073291+0000", 2024-09-17T18:15:43.432 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7200000000000006e-06 2024-09-17T18:15:43.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.432 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.433 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.087142+0000", 2024-09-17T18:15:43.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013850987 2024-09-17T18:15:43.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.433 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.433 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.087298+0000", 2024-09-17T18:15:43.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015572900000000001 2024-09-17T18:15:43.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.433 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.433 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.087485+0000", 2024-09-17T18:15:43.433 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018764399999999999 2024-09-17T18:15:43.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091014+0000", 2024-09-17T18:15:43.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035285780000000001 2024-09-17T18:15:43.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091217+0000", 2024-09-17T18:15:43.434 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020357 2024-09-17T18:15:43.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.434 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.434 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091302+0000", 2024-09-17T18:15:43.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4614e-05 2024-09-17T18:15:43.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.435 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.435 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091352+0000", 2024-09-17T18:15:43.435 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0047999999999999e-05 2024-09-17T18:15:43.435 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.435 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.435 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.435 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.435 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073303+0000", 2024-09-17T18:15:43.436 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.331523137000001, 2024-09-17T18:15:43.436 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.020201742000000002, 2024-09-17T18:15:43.436 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.436 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.436 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.436 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.436 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.436 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.436 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 50 2024-09-17T18:15:43.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.436 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073303+0000", 2024-09-17T18:15:43.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073303+0000", 2024-09-17T18:15:43.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.437 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.437 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073304+0000", 2024-09-17T18:15:43.437 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1699999999999997e-07 2024-09-17T18:15:43.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073388+0000", 2024-09-17T18:15:43.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4222999999999996e-05 2024-09-17T18:15:43.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.438 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073403+0000", 2024-09-17T18:15:43.438 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.488e-05 2024-09-17T18:15:43.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.438 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073411+0000", 2024-09-17T18:15:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0660000000000004e-06 2024-09-17T18:15:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.089184+0000", 2024-09-17T18:15:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015773646999999998 2024-09-17T18:15:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.089309+0000", 2024-09-17T18:15:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000124809 2024-09-17T18:15:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.089514+0000", 2024-09-17T18:15:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000204871 2024-09-17T18:15:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093318+0000", 2024-09-17T18:15:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038034050000000002 2024-09-17T18:15:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093337+0000", 2024-09-17T18:15:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9839000000000001e-05 2024-09-17T18:15:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093412+0000", 2024-09-17T18:15:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5012000000000006e-05 2024-09-17T18:15:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093505+0000", 2024-09-17T18:15:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2273000000000002e-05 2024-09-17T18:15:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:15:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.331400491, 2024-09-17T18:15:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.020790197, 2024-09-17T18:15:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 51 2024-09-17T18:15:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:15:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:15:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:15:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5000000000000001e-07 2024-09-17T18:15:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073432+0000", 2024-09-17T18:15:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7030000000000003e-06 2024-09-17T18:15:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073445+0000", 2024-09-17T18:15:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.239e-05 2024-09-17T18:15:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073452+0000", 2024-09-17T18:15:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8460000000000008e-06 2024-09-17T18:15:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091415+0000", 2024-09-17T18:15:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017962982999999998 2024-09-17T18:15:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091545+0000", 2024-09-17T18:15:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013008599999999999 2024-09-17T18:15:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091736+0000", 2024-09-17T18:15:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019030100000000001 2024-09-17T18:15:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093524+0000", 2024-09-17T18:15:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017882060000000001 2024-09-17T18:15:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094070+0000", 2024-09-17T18:15:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00054624999999999997 2024-09-17T18:15:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094156+0000", 2024-09-17T18:15:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5446999999999997e-05 2024-09-17T18:15:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094216+0000", 2024-09-17T18:15:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0134999999999999e-05 2024-09-17T18:15:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073465+0000", 2024-09-17T18:15:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.331361155, 2024-09-17T18:15:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021176878, 2024-09-17T18:15:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 52 2024-09-17T18:15:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.450 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.450 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073465+0000", 2024-09-17T18:15:43.450 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.450 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.450 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073465+0000", 2024-09-17T18:15:43.450 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.450 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.450 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073466+0000", 2024-09-17T18:15:43.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3e-07 2024-09-17T18:15:43.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073472+0000", 2024-09-17T18:15:43.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0519999999999998e-06 2024-09-17T18:15:43.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.451 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.451 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073483+0000", 2024-09-17T18:15:43.451 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1586999999999999e-05 2024-09-17T18:15:43.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.451 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073490+0000", 2024-09-17T18:15:43.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8229999999999997e-06 2024-09-17T18:15:43.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.452 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.092415+0000", 2024-09-17T18:15:43.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018924926000000002 2024-09-17T18:15:43.452 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.452 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.452 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.452 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.092535+0000", 2024-09-17T18:15:43.452 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012039 2024-09-17T18:15:43.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.453 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.453 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.092739+0000", 2024-09-17T18:15:43.453 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000203926 2024-09-17T18:15:43.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.453 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.453 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094258+0000", 2024-09-17T18:15:43.453 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015184689999999999 2024-09-17T18:15:43.453 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.453 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.453 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094513+0000", 2024-09-17T18:15:43.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00025523199999999998 2024-09-17T18:15:43.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094590+0000", 2024-09-17T18:15:43.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6743999999999996e-05 2024-09-17T18:15:43.454 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.454 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.454 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094642+0000", 2024-09-17T18:15:43.454 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1999000000000001e-05 2024-09-17T18:15:43.454 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180665+0000", 2024-09-17T18:15:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.224160869999999, 2024-09-17T18:15:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.014802907000000001, 2024-09-17T18:15:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.456 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 70 2024-09-17T18:15:43.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.456 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180665+0000", 2024-09-17T18:15:43.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.456 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.456 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.456 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.456 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180665+0000", 2024-09-17T18:15:43.456 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180666+0000", 2024-09-17T18:15:43.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1200000000000001e-06 2024-09-17T18:15:43.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180673+0000", 2024-09-17T18:15:43.457 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2140000000000001e-06 2024-09-17T18:15:43.457 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.457 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.457 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.457 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180682+0000", 2024-09-17T18:15:43.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8360000000000004e-06 2024-09-17T18:15:43.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180690+0000", 2024-09-17T18:15:43.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2060000000000001e-06 2024-09-17T18:15:43.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.458 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.458 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.458 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.186564+0000", 2024-09-17T18:15:43.458 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0058741669999999996 2024-09-17T18:15:43.458 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.186728+0000", 2024-09-17T18:15:43.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000163852 2024-09-17T18:15:43.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.186907+0000", 2024-09-17T18:15:43.459 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000179801 2024-09-17T18:15:43.459 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.459 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.459 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.459 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.192695+0000", 2024-09-17T18:15:43.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0057873860000000003 2024-09-17T18:15:43.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195312+0000", 2024-09-17T18:15:43.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026170239999999999 2024-09-17T18:15:43.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.460 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.460 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195399+0000", 2024-09-17T18:15:43.460 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6984000000000006e-05 2024-09-17T18:15:43.460 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.460 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.461 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.461 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195468+0000", 2024-09-17T18:15:43.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9317000000000001e-05 2024-09-17T18:15:43.461 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.461 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.461 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.461 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.461 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.461 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.461 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180702+0000", 2024-09-17T18:15:43.461 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.224123983999998, 2024-09-17T18:15:43.461 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.01511287, 2024-09-17T18:15:43.461 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.462 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.462 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.462 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.462 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.462 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.462 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 71 2024-09-17T18:15:43.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.462 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.462 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.462 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180702+0000", 2024-09-17T18:15:43.462 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.462 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.462 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180702+0000", 2024-09-17T18:15:43.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180703+0000", 2024-09-17T18:15:43.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0100000000000001e-06 2024-09-17T18:15:43.463 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.463 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.463 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.463 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180709+0000", 2024-09-17T18:15:43.463 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0000000000000002e-06 2024-09-17T18:15:43.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180718+0000", 2024-09-17T18:15:43.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.969e-06 2024-09-17T18:15:43.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.464 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180725+0000", 2024-09-17T18:15:43.464 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9199999999999998e-06 2024-09-17T18:15:43.464 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.464 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.464 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.187527+0000", 2024-09-17T18:15:43.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0068019179999999997 2024-09-17T18:15:43.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.187641+0000", 2024-09-17T18:15:43.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011426599999999999 2024-09-17T18:15:43.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.465 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.465 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.465 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.187819+0000", 2024-09-17T18:15:43.465 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017757800000000001 2024-09-17T18:15:43.465 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.192702+0000", 2024-09-17T18:15:43.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0048828880000000002 2024-09-17T18:15:43.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195593+0000", 2024-09-17T18:15:43.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028913150000000002 2024-09-17T18:15:43.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.466 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.466 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.466 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195730+0000", 2024-09-17T18:15:43.466 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013735900000000001 2024-09-17T18:15:43.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.467 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.467 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195815+0000", 2024-09-17T18:15:43.467 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4647000000000005e-05 2024-09-17T18:15:43.467 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.467 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.467 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.467 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.467 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.467 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.467 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180737+0000", 2024-09-17T18:15:43.467 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.224089398, 2024-09-17T18:15:43.468 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016428557999999999, 2024-09-17T18:15:43.468 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.468 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.468 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.468 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.468 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.468 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.468 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 72 2024-09-17T18:15:43.468 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.468 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.468 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.468 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180737+0000", 2024-09-17T18:15:43.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180737+0000", 2024-09-17T18:15:43.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.469 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.469 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.469 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180738+0000", 2024-09-17T18:15:43.469 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.006e-06 2024-09-17T18:15:43.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180875+0000", 2024-09-17T18:15:43.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000136952 2024-09-17T18:15:43.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180887+0000", 2024-09-17T18:15:43.470 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2636999999999999e-05 2024-09-17T18:15:43.470 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.470 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.470 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.470 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180896+0000", 2024-09-17T18:15:43.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3860000000000007e-06 2024-09-17T18:15:43.471 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.471 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.471 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.188650+0000", 2024-09-17T18:15:43.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0077543810000000003 2024-09-17T18:15:43.471 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.471 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.471 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.188761+0000", 2024-09-17T18:15:43.471 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011128699999999999 2024-09-17T18:15:43.471 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.471 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.471 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.472 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.188934+0000", 2024-09-17T18:15:43.472 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000172817 2024-09-17T18:15:43.472 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.472 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.472 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195490+0000", 2024-09-17T18:15:43.472 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0065560360000000003 2024-09-17T18:15:43.472 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.472 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.472 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.472 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.196887+0000", 2024-09-17T18:15:43.472 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001397138 2024-09-17T18:15:43.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.197049+0000", 2024-09-17T18:15:43.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000161628 2024-09-17T18:15:43.473 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.473 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.473 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.473 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.197165+0000", 2024-09-17T18:15:43.473 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011629 2024-09-17T18:15:43.473 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.473 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.474 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.474 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.474 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.474 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180912+0000", 2024-09-17T18:15:43.474 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.223914124, 2024-09-17T18:15:43.474 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017495620999999999, 2024-09-17T18:15:43.474 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.474 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.474 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.474 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.474 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.474 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.474 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 73 2024-09-17T18:15:43.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.475 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180912+0000", 2024-09-17T18:15:43.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.475 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.475 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.475 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180912+0000", 2024-09-17T18:15:43.475 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.475 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180913+0000", 2024-09-17T18:15:43.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0529999999999999e-06 2024-09-17T18:15:43.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180920+0000", 2024-09-17T18:15:43.476 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8369999999999999e-06 2024-09-17T18:15:43.476 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.476 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.476 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.476 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180929+0000", 2024-09-17T18:15:43.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3659999999999998e-06 2024-09-17T18:15:43.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.477 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180936+0000", 2024-09-17T18:15:43.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9659999999999999e-06 2024-09-17T18:15:43.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.477 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.477 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.191317+0000", 2024-09-17T18:15:43.477 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010380545 2024-09-17T18:15:43.477 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.477 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.477 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.191435+0000", 2024-09-17T18:15:43.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118746 2024-09-17T18:15:43.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.191616+0000", 2024-09-17T18:15:43.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018002799999999999 2024-09-17T18:15:43.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.478 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.478 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.478 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.197244+0000", 2024-09-17T18:15:43.478 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056280940000000002 2024-09-17T18:15:43.478 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198243+0000", 2024-09-17T18:15:43.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00099925500000000011 2024-09-17T18:15:43.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198336+0000", 2024-09-17T18:15:43.479 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3447000000000002e-05 2024-09-17T18:15:43.479 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.479 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.479 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198408+0000", 2024-09-17T18:15:43.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1284000000000004e-05 2024-09-17T18:15:43.480 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.480 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.480 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.480 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.480 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.480 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180948+0000", 2024-09-17T18:15:43.480 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.223877772000002, 2024-09-17T18:15:43.480 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017711738000000001, 2024-09-17T18:15:43.480 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.480 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.480 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.481 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.481 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 74 2024-09-17T18:15:43.481 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.481 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.481 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.481 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.481 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180948+0000", 2024-09-17T18:15:43.481 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.481 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.481 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.481 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.481 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180948+0000", 2024-09-17T18:15:43.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180949+0000", 2024-09-17T18:15:43.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9000000000000005e-07 2024-09-17T18:15:43.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.482 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.482 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180955+0000", 2024-09-17T18:15:43.482 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3900000000000001e-06 2024-09-17T18:15:43.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.482 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180964+0000", 2024-09-17T18:15:43.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0559999999999994e-06 2024-09-17T18:15:43.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180970+0000", 2024-09-17T18:15:43.483 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-17T18:15:43.483 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.483 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.483 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.483 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.192795+0000", 2024-09-17T18:15:43.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011825057999999999 2024-09-17T18:15:43.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193035+0000", 2024-09-17T18:15:43.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00023942000000000001 2024-09-17T18:15:43.484 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.484 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.484 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.484 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193232+0000", 2024-09-17T18:15:43.484 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000197383 2024-09-17T18:15:43.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.197434+0000", 2024-09-17T18:15:43.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0042018029999999996 2024-09-17T18:15:43.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.485 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198506+0000", 2024-09-17T18:15:43.485 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0010720860000000001 2024-09-17T18:15:43.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.485 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.485 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198595+0000", 2024-09-17T18:15:43.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8710999999999998e-05 2024-09-17T18:15:43.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.486 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.486 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198660+0000", 2024-09-17T18:15:43.486 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5251000000000003e-05 2024-09-17T18:15:43.486 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.486 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.486 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.486 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.486 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.486 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.487 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180982+0000", 2024-09-17T18:15:43.487 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.223844093, 2024-09-17T18:15:43.487 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0204972, 2024-09-17T18:15:43.487 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.487 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.487 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.487 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.487 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.487 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.487 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 75 2024-09-17T18:15:43.487 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.487 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.487 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180982+0000", 2024-09-17T18:15:43.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180982+0000", 2024-09-17T18:15:43.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.488 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.488 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.488 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.488 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180983+0000", 2024-09-17T18:15:43.488 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8700000000000005e-07 2024-09-17T18:15:43.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181111+0000", 2024-09-17T18:15:43.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012798200000000001 2024-09-17T18:15:43.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.489 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.489 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181123+0000", 2024-09-17T18:15:43.489 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2283000000000001e-05 2024-09-17T18:15:43.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.489 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181133+0000", 2024-09-17T18:15:43.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.028e-05 2024-09-17T18:15:43.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193832+0000", 2024-09-17T18:15:43.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012698276999999999 2024-09-17T18:15:43.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.490 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.490 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.490 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193952+0000", 2024-09-17T18:15:43.490 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012077 2024-09-17T18:15:43.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.194141+0000", 2024-09-17T18:15:43.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018815100000000001 2024-09-17T18:15:43.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.491 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.199915+0000", 2024-09-17T18:15:43.491 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0057741190000000003 2024-09-17T18:15:43.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.491 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.491 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201326+0000", 2024-09-17T18:15:43.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001411463 2024-09-17T18:15:43.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201410+0000", 2024-09-17T18:15:43.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4166999999999996e-05 2024-09-17T18:15:43.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.492 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.492 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.492 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201479+0000", 2024-09-17T18:15:43.492 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8921e-05 2024-09-17T18:15:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.181149+0000", 2024-09-17T18:15:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.223677131999999, 2024-09-17T18:15:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.02060089, 2024-09-17T18:15:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 76 2024-09-17T18:15:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181149+0000", 2024-09-17T18:15:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181149+0000", 2024-09-17T18:15:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181150+0000", 2024-09-17T18:15:43.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3399999999999997e-07 2024-09-17T18:15:43.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.495 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181157+0000", 2024-09-17T18:15:43.495 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.379e-06 2024-09-17T18:15:43.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.495 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.495 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181166+0000", 2024-09-17T18:15:43.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0869999999999996e-06 2024-09-17T18:15:43.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181173+0000", 2024-09-17T18:15:43.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8360000000000003e-06 2024-09-17T18:15:43.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.496 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.496 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.496 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195884+0000", 2024-09-17T18:15:43.496 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.014710877000000001 2024-09-17T18:15:43.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.196029+0000", 2024-09-17T18:15:43.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014536900000000001 2024-09-17T18:15:43.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.196221+0000", 2024-09-17T18:15:43.497 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019122 2024-09-17T18:15:43.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.497 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.497 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.497 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.199925+0000", 2024-09-17T18:15:43.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037047389999999999 2024-09-17T18:15:43.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.498 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.498 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201572+0000", 2024-09-17T18:15:43.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001646652 2024-09-17T18:15:43.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.498 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.498 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201656+0000", 2024-09-17T18:15:43.498 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4107e-05 2024-09-17T18:15:43.498 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.498 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.499 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.499 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201750+0000", 2024-09-17T18:15:43.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3690000000000006e-05 2024-09-17T18:15:43.499 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.499 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.499 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.499 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.499 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.499 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.499 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.377941+0000", 2024-09-17T18:15:43.499 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.026885277000002, 2024-09-17T18:15:43.499 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.014341242000000001, 2024-09-17T18:15:43.499 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.500 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.500 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.500 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.500 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.500 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.500 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 119 2024-09-17T18:15:43.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.500 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.377941+0000", 2024-09-17T18:15:43.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.377941+0000", 2024-09-17T18:15:43.501 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.501 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.501 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.501 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.377942+0000", 2024-09-17T18:15:43.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.406e-06 2024-09-17T18:15:43.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.377953+0000", 2024-09-17T18:15:43.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0987e-05 2024-09-17T18:15:43.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.502 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.502 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.377972+0000", 2024-09-17T18:15:43.502 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8338999999999998e-05 2024-09-17T18:15:43.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.502 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.377985+0000", 2024-09-17T18:15:43.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3563e-05 2024-09-17T18:15:43.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.388154+0000", 2024-09-17T18:15:43.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010168961000000001 2024-09-17T18:15:43.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.503 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.503 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.503 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.388290+0000", 2024-09-17T18:15:43.503 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000136272 2024-09-17T18:15:43.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.388496+0000", 2024-09-17T18:15:43.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020587399999999999 2024-09-17T18:15:43.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.504 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.504 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392013+0000", 2024-09-17T18:15:43.504 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035166149999999998 2024-09-17T18:15:43.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392049+0000", 2024-09-17T18:15:43.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5812000000000002e-05 2024-09-17T18:15:43.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392178+0000", 2024-09-17T18:15:43.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000129209 2024-09-17T18:15:43.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.505 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.505 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392282+0000", 2024-09-17T18:15:43.505 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010420399999999999 2024-09-17T18:15:43.505 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.506 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.506 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.506 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.506 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378036+0000", 2024-09-17T18:15:43.506 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.026790104, 2024-09-17T18:15:43.506 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015468097, 2024-09-17T18:15:43.506 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.506 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.506 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.506 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.506 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.507 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.507 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 120 2024-09-17T18:15:43.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.507 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378036+0000", 2024-09-17T18:15:43.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.507 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.507 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378036+0000", 2024-09-17T18:15:43.507 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378038+0000", 2024-09-17T18:15:43.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5600000000000001e-06 2024-09-17T18:15:43.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.508 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378173+0000", 2024-09-17T18:15:43.508 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013549600000000001 2024-09-17T18:15:43.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.508 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378198+0000", 2024-09-17T18:15:43.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4975999999999999e-05 2024-09-17T18:15:43.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.509 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378220+0000", 2024-09-17T18:15:43.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1688999999999999e-05 2024-09-17T18:15:43.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.509 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.509 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.389483+0000", 2024-09-17T18:15:43.509 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011263237000000001 2024-09-17T18:15:43.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.510 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.389603+0000", 2024-09-17T18:15:43.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000119696 2024-09-17T18:15:43.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.510 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.389804+0000", 2024-09-17T18:15:43.510 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000201177 2024-09-17T18:15:43.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.510 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.510 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393237+0000", 2024-09-17T18:15:43.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034328599999999998 2024-09-17T18:15:43.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393278+0000", 2024-09-17T18:15:43.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1343e-05 2024-09-17T18:15:43.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.511 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393410+0000", 2024-09-17T18:15:43.511 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000131839 2024-09-17T18:15:43.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.511 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.512 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393504+0000", 2024-09-17T18:15:43.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4223999999999998e-05 2024-09-17T18:15:43.512 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.512 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.512 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.512 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.512 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378256+0000", 2024-09-17T18:15:43.512 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.026570413999998, 2024-09-17T18:15:43.512 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017159648999999999, 2024-09-17T18:15:43.512 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.513 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.513 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.513 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.513 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.513 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.513 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 121 2024-09-17T18:15:43.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.513 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.513 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.513 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378256+0000", 2024-09-17T18:15:43.513 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378256+0000", 2024-09-17T18:15:43.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378257+0000", 2024-09-17T18:15:43.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.573e-06 2024-09-17T18:15:43.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.514 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.514 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378269+0000", 2024-09-17T18:15:43.514 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1246999999999999e-05 2024-09-17T18:15:43.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378288+0000", 2024-09-17T18:15:43.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9239e-05 2024-09-17T18:15:43.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.515 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378302+0000", 2024-09-17T18:15:43.515 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4123e-05 2024-09-17T18:15:43.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.515 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.516 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.390941+0000", 2024-09-17T18:15:43.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012639015999999999 2024-09-17T18:15:43.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.516 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.516 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.391061+0000", 2024-09-17T18:15:43.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000120569 2024-09-17T18:15:43.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.516 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.516 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.391251+0000", 2024-09-17T18:15:43.516 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018965099999999999 2024-09-17T18:15:43.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.517 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.517 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393610+0000", 2024-09-17T18:15:43.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023590550000000001 2024-09-17T18:15:43.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.517 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.517 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.395217+0000", 2024-09-17T18:15:43.517 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0016063819999999999 2024-09-17T18:15:43.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.517 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.517 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.395355+0000", 2024-09-17T18:15:43.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000138863 2024-09-17T18:15:43.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.518 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.518 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.395415+0000", 2024-09-17T18:15:43.518 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9930999999999999e-05 2024-09-17T18:15:43.518 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.518 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.518 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.518 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.518 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378327+0000", 2024-09-17T18:15:43.519 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.026499333, 2024-09-17T18:15:43.519 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018591921000000001, 2024-09-17T18:15:43.519 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.519 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.519 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.519 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.519 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.519 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.519 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 122 2024-09-17T18:15:43.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.519 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.519 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.519 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378327+0000", 2024-09-17T18:15:43.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378327+0000", 2024-09-17T18:15:43.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.520 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.520 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378328+0000", 2024-09-17T18:15:43.520 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3170000000000001e-06 2024-09-17T18:15:43.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378338+0000", 2024-09-17T18:15:43.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0006e-05 2024-09-17T18:15:43.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378358+0000", 2024-09-17T18:15:43.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9919e-05 2024-09-17T18:15:43.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.521 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.521 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378371+0000", 2024-09-17T18:15:43.521 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3363999999999999e-05 2024-09-17T18:15:43.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392332+0000", 2024-09-17T18:15:43.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013960396999999999 2024-09-17T18:15:43.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.522 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392445+0000", 2024-09-17T18:15:43.522 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011278899999999999 2024-09-17T18:15:43.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.522 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392625+0000", 2024-09-17T18:15:43.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000180082 2024-09-17T18:15:43.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396780+0000", 2024-09-17T18:15:43.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0041555639999999996 2024-09-17T18:15:43.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.523 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.523 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396802+0000", 2024-09-17T18:15:43.523 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1460000000000001e-05 2024-09-17T18:15:43.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396864+0000", 2024-09-17T18:15:43.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2193999999999994e-05 2024-09-17T18:15:43.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.524 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.524 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396919+0000", 2024-09-17T18:15:43.524 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4829e-05 2024-09-17T18:15:43.524 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.524 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.524 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.525 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.525 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378397+0000", 2024-09-17T18:15:43.525 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.026428968000001, 2024-09-17T18:15:43.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018905537, 2024-09-17T18:15:43.525 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.525 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.525 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.525 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.525 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.525 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.525 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 123 2024-09-17T18:15:43.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.525 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378397+0000", 2024-09-17T18:15:43.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378397+0000", 2024-09-17T18:15:43.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.526 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378399+0000", 2024-09-17T18:15:43.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4559999999999999e-06 2024-09-17T18:15:43.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378595+0000", 2024-09-17T18:15:43.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019676399999999999 2024-09-17T18:15:43.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378611+0000", 2024-09-17T18:15:43.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5268999999999999e-05 2024-09-17T18:15:43.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378622+0000", 2024-09-17T18:15:43.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1593999999999999e-05 2024-09-17T18:15:43.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393759+0000", 2024-09-17T18:15:43.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015136836000000001 2024-09-17T18:15:43.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393966+0000", 2024-09-17T18:15:43.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020672 2024-09-17T18:15:43.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.394159+0000", 2024-09-17T18:15:43.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000193594 2024-09-17T18:15:43.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396935+0000", 2024-09-17T18:15:43.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027754889999999999 2024-09-17T18:15:43.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397041+0000", 2024-09-17T18:15:43.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105853 2024-09-17T18:15:43.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397193+0000", 2024-09-17T18:15:43.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015243200000000001 2024-09-17T18:15:43.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397303+0000", 2024-09-17T18:15:43.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010953 2024-09-17T18:15:43.530 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.530 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.531 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.531 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:43.531 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378646+0000", 2024-09-17T18:15:43.531 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 29.026180526000001, 2024-09-17T18:15:43.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019220590999999999, 2024-09-17T18:15:43.531 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.531 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.531 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:43.531 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:43.531 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:43.531 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:43.532 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 124 2024-09-17T18:15:43.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.532 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378646+0000", 2024-09-17T18:15:43.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378646+0000", 2024-09-17T18:15:43.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378647+0000", 2024-09-17T18:15:43.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.17e-06 2024-09-17T18:15:43.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378655+0000", 2024-09-17T18:15:43.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999997e-06 2024-09-17T18:15:43.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.533 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378669+0000", 2024-09-17T18:15:43.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4715000000000001e-05 2024-09-17T18:15:43.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378677+0000", 2024-09-17T18:15:43.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5499999999999997e-06 2024-09-17T18:15:43.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.395519+0000", 2024-09-17T18:15:43.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016842012999999999 2024-09-17T18:15:43.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:43.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.395741+0000", 2024-09-17T18:15:43.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000221776 2024-09-17T18:15:43.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:43.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396098+0000", 2024-09-17T18:15:43.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00035730199999999999 2024-09-17T18:15:43.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:43.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397456+0000", 2024-09-17T18:15:43.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001357701 2024-09-17T18:15:43.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:43.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397740+0000", 2024-09-17T18:15:43.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000284068 2024-09-17T18:15:43.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:43.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397813+0000", 2024-09-17T18:15:43.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2934000000000003e-05 2024-09-17T18:15:43.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397866+0000", 2024-09-17T18:15:43.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3542000000000003e-05 2024-09-17T18:15:43.537 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.537 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.537 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.537 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.537 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.537 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:43.539 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T18:15:43.539 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:43.533+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:43.646 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:43.635+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:43.666 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:43.667 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:43.667 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:15:43.667 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:43.681 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T18:15:43.741 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:43.738+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.13 to 1 (10000) 2024-09-17T18:15:43.811 INFO:tasks.rados.rados.0.smithi154.stdout:154: done (1 left) 2024-09-17T18:15:43.811 INFO:tasks.rados.rados.0.smithi154.stdout:155: done (0 left) 2024-09-17T18:15:43.811 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 34 current snap is 12 2024-09-17T18:15:43.811 INFO:tasks.rados.rados.0.smithi154.stdout:156: seq_num 81 ranges {475136=606208,1081344=720896,1802240=49152} 2024-09-17T18:15:43.828 INFO:tasks.rados.rados.0.smithi154.stdout:156: writing smithi15432074-34 from 475136 to 1081344 tid 1 2024-09-17T18:15:43.831 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 14 1 2024-09-17T18:15:43.842 INFO:tasks.rados.rados.0.smithi154.stdout:156: writing smithi15432074-34 from 1081344 to 1802240 tid 2 2024-09-17T18:15:43.842 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:43.835+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:43.843 INFO:tasks.rados.rados.0.smithi154.stdout:156: writing smithi15432074-34 from 1802240 to 1851392 tid 3 2024-09-17T18:15:43.843 INFO:tasks.rados.rados.0.smithi154.stdout:157: read oid 2 snap 3 2024-09-17T18:15:43.843 INFO:tasks.rados.rados.0.smithi154.stdout:157: expect (ObjNum 6 snap 0 seq_num 6) 2024-09-17T18:15:43.843 INFO:tasks.rados.rados.0.smithi154.stdout:158: snap_create 2024-09-17T18:15:43.852 INFO:tasks.rados.rados.0.smithi154.stdout:156: finishing write tid 1 to smithi15432074-34 2024-09-17T18:15:43.853 INFO:tasks.rados.rados.0.smithi154.stdout:157: expect (ObjNum 6 snap 0 seq_num 6) 2024-09-17T18:15:43.853 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 11605 2024-09-17T18:15:43.854 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:43.854 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:43.855 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:15:43.855 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:15:43.855 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:43.857 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 47520 2024-09-17T18:15:43.860 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 12858 2024-09-17T18:15:43.868 INFO:tasks.rados.rados.0.smithi154.stdout:156: finishing write tid 2 to smithi15432074-34 2024-09-17T18:15:43.868 INFO:tasks.rados.rados.0.smithi154.stdout:156: finishing write tid 3 to smithi15432074-34 2024-09-17T18:15:43.868 INFO:tasks.rados.rados.0.smithi154.stdout:156: finishing write tid 4 to smithi15432074-34 2024-09-17T18:15:43.868 INFO:tasks.rados.rados.0.smithi154.stdout:156: finishing write tid 5 to smithi15432074-34 2024-09-17T18:15:43.868 INFO:tasks.rados.rados.0.smithi154.stdout:156: oid 34 updating version 0 to 42 2024-09-17T18:15:43.868 INFO:tasks.rados.rados.0.smithi154.stdout:156: oid 34 updating version 42 to 45 2024-09-17T18:15:43.868 INFO:tasks.rados.rados.0.smithi154.stdout:156: oid 34 version 45 is already newer than 44 2024-09-17T18:15:43.868 INFO:tasks.rados.rados.0.smithi154.stdout:156: oid 34 version 45 is already newer than 43 2024-09-17T18:15:43.868 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 34 v 45 (ObjNum 81 snap 12 seq_num 81) dirty exists 2024-09-17T18:15:43.869 INFO:tasks.rados.rados.0.smithi154.stdout:156: left oid 34 (ObjNum 81 snap 12 seq_num 81) 2024-09-17T18:15:43.870 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T18:15:43.943 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:43.939+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:43.985 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:43.985 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:15:43.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:15:43.986 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-17T18:15:43.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.986 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s2 42/31 ECSubWrite(tid=40, reqid=client.4565.0:363, at_version=42'26, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:15:43.986 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.767133+0000", 2024-09-17T18:15:43.986 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.2169300969999997, 2024-09-17T18:15:43.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021588646, 2024-09-17T18:15:43.986 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.986 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.986 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:43.986 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767133+0000", 2024-09-17T18:15:43.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767133+0000", 2024-09-17T18:15:43.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767133+0000", 2024-09-17T18:15:43.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4000000000000002e-07 2024-09-17T18:15:43.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767171+0000", 2024-09-17T18:15:43.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7116000000000002e-05 2024-09-17T18:15:43.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767198+0000", 2024-09-17T18:15:43.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.756e-05 2024-09-17T18:15:43.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.988 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767223+0000", 2024-09-17T18:15:43.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4723e-05 2024-09-17T18:15:43.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767425+0000", 2024-09-17T18:15:43.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020206299999999999 2024-09-17T18:15:43.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:43.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767451+0000", 2024-09-17T18:15:43.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5769e-05 2024-09-17T18:15:43.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:43.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788636+0000", 2024-09-17T18:15:43.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021185626999999999 2024-09-17T18:15:43.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788722+0000", 2024-09-17T18:15:43.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5347999999999997e-05 2024-09-17T18:15:43.990 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.990 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.990 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.990 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=86, reqid=client.4565.0:343, at_version=42'21, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:43.991 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.769752+0000", 2024-09-17T18:15:43.991 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.2143111219999998, 2024-09-17T18:15:43.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022302678999999999, 2024-09-17T18:15:43.991 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.991 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.991 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:43.991 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769752+0000", 2024-09-17T18:15:43.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769752+0000", 2024-09-17T18:15:43.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769753+0000", 2024-09-17T18:15:43.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3e-07 2024-09-17T18:15:43.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769810+0000", 2024-09-17T18:15:43.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7501999999999999e-05 2024-09-17T18:15:43.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769843+0000", 2024-09-17T18:15:43.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2299999999999999e-05 2024-09-17T18:15:43.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769866+0000", 2024-09-17T18:15:43.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3448999999999999e-05 2024-09-17T18:15:43.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.770089+0000", 2024-09-17T18:15:43.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022273200000000001 2024-09-17T18:15:43.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:43.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.770113+0000", 2024-09-17T18:15:43.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4170000000000001e-05 2024-09-17T18:15:43.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:43.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.791961+0000", 2024-09-17T18:15:43.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021847829999999999 2024-09-17T18:15:43.994 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792055+0000", 2024-09-17T18:15:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3966000000000001e-05 2024-09-17T18:15:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 42/31 ECSubWrite(tid=87, reqid=client.4565.0:358, at_version=42'26, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.772061+0000", 2024-09-17T18:15:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.2120017860000001, 2024-09-17T18:15:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.020486306999999999, 2024-09-17T18:15:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772061+0000", 2024-09-17T18:15:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772061+0000", 2024-09-17T18:15:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772063+0000", 2024-09-17T18:15:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0870000000000001e-06 2024-09-17T18:15:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772121+0000", 2024-09-17T18:15:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7156e-05 2024-09-17T18:15:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772165+0000", 2024-09-17T18:15:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4885000000000001e-05 2024-09-17T18:15:43.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:43.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772198+0000", 2024-09-17T18:15:43.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2634e-05 2024-09-17T18:15:43.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:43.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772630+0000", 2024-09-17T18:15:43.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00043200500000000001 2024-09-17T18:15:43.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:43.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772656+0000", 2024-09-17T18:15:43.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5942e-05 2024-09-17T18:15:43.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:43.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792367+0000", 2024-09-17T18:15:43.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019711310999999999 2024-09-17T18:15:43.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:43.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:43.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:43.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792548+0000", 2024-09-17T18:15:43.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000180287 2024-09-17T18:15:43.999 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:43.999 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.000 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.000 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=88, reqid=client.4565.0:344, at_version=42'22, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:44.000 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.772258+0000", 2024-09-17T18:15:44.000 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.2118054320000002, 2024-09-17T18:15:44.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022345961000000001, 2024-09-17T18:15:44.000 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.000 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.000 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.000 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772258+0000", 2024-09-17T18:15:44.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772258+0000", 2024-09-17T18:15:44.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772259+0000", 2024-09-17T18:15:44.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.28e-06 2024-09-17T18:15:44.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772311+0000", 2024-09-17T18:15:44.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2061999999999997e-05 2024-09-17T18:15:44.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772339+0000", 2024-09-17T18:15:44.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7613000000000001e-05 2024-09-17T18:15:44.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772359+0000", 2024-09-17T18:15:44.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0313e-05 2024-09-17T18:15:44.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782669+0000", 2024-09-17T18:15:44.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010310293 2024-09-17T18:15:44.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782707+0000", 2024-09-17T18:15:44.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8213000000000002e-05 2024-09-17T18:15:44.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794497+0000", 2024-09-17T18:15:44.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011789366000000001 2024-09-17T18:15:44.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794604+0000", 2024-09-17T18:15:44.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106821 2024-09-17T18:15:44.004 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.004 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.004 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.005 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s2 42/31 ECSubWrite(tid=41, reqid=osd.7.0:41, at_version=42'28, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:15:44.005 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.773158+0000", 2024-09-17T18:15:44.005 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.2109054989999999, 2024-09-17T18:15:44.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016727855999999999, 2024-09-17T18:15:44.005 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.005 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.005 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.005 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773158+0000", 2024-09-17T18:15:44.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773158+0000", 2024-09-17T18:15:44.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773160+0000", 2024-09-17T18:15:44.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0829999999999998e-06 2024-09-17T18:15:44.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773236+0000", 2024-09-17T18:15:44.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6372000000000007e-05 2024-09-17T18:15:44.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773278+0000", 2024-09-17T18:15:44.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1841999999999997e-05 2024-09-17T18:15:44.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773299+0000", 2024-09-17T18:15:44.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.088e-05 2024-09-17T18:15:44.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773551+0000", 2024-09-17T18:15:44.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00025183200000000001 2024-09-17T18:15:44.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773574+0000", 2024-09-17T18:15:44.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3810000000000001e-05 2024-09-17T18:15:44.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.008 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789798+0000", 2024-09-17T18:15:44.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016223909000000002 2024-09-17T18:15:44.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789885+0000", 2024-09-17T18:15:44.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7127999999999997e-05 2024-09-17T18:15:44.009 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.009 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.009 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.009 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s2 42/31 ECSubWrite(tid=42, reqid=osd.7.0:42, at_version=42'30, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:15:44.009 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.773805+0000", 2024-09-17T18:15:44.009 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.2102577319999996, 2024-09-17T18:15:44.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.020956761000000001, 2024-09-17T18:15:44.010 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.010 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.010 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.010 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773805+0000", 2024-09-17T18:15:44.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773805+0000", 2024-09-17T18:15:44.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773807+0000", 2024-09-17T18:15:44.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9400000000000001e-06 2024-09-17T18:15:44.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773855+0000", 2024-09-17T18:15:44.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7753000000000002e-05 2024-09-17T18:15:44.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773891+0000", 2024-09-17T18:15:44.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5493000000000001e-05 2024-09-17T18:15:44.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773912+0000", 2024-09-17T18:15:44.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1818999999999999e-05 2024-09-17T18:15:44.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783091+0000", 2024-09-17T18:15:44.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0091785649999999996 2024-09-17T18:15:44.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.013 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783111+0000", 2024-09-17T18:15:44.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0523e-05 2024-09-17T18:15:44.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.013 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794669+0000", 2024-09-17T18:15:44.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011557263999999999 2024-09-17T18:15:44.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794762+0000", 2024-09-17T18:15:44.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3404000000000002e-05 2024-09-17T18:15:44.014 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.014 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.014 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.014 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=89, reqid=client.4565.0:345, at_version=42'23, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:44.015 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775036+0000", 2024-09-17T18:15:44.015 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.209026755, 2024-09-17T18:15:44.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019634636, 2024-09-17T18:15:44.015 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.015 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.015 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.015 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775036+0000", 2024-09-17T18:15:44.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775036+0000", 2024-09-17T18:15:44.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775038+0000", 2024-09-17T18:15:44.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0930000000000001e-06 2024-09-17T18:15:44.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775084+0000", 2024-09-17T18:15:44.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5612999999999998e-05 2024-09-17T18:15:44.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775122+0000", 2024-09-17T18:15:44.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7945999999999999e-05 2024-09-17T18:15:44.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775147+0000", 2024-09-17T18:15:44.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5296e-05 2024-09-17T18:15:44.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785552+0000", 2024-09-17T18:15:44.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010404722 2024-09-17T18:15:44.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785575+0000", 2024-09-17T18:15:44.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.313e-05 2024-09-17T18:15:44.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794613+0000", 2024-09-17T18:15:44.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0090377110000000004 2024-09-17T18:15:44.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794671+0000", 2024-09-17T18:15:44.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8125000000000003e-05 2024-09-17T18:15:44.019 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.019 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.019 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.019 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 42/31 ECSubWrite(tid=90, reqid=client.4565.0:359, at_version=42'27, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:44.019 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775192+0000", 2024-09-17T18:15:44.019 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.2088708849999996, 2024-09-17T18:15:44.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017422031000000001, 2024-09-17T18:15:44.019 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.019 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.020 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.020 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775192+0000", 2024-09-17T18:15:44.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775192+0000", 2024-09-17T18:15:44.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775193+0000", 2024-09-17T18:15:44.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4399999999999998e-07 2024-09-17T18:15:44.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775243+0000", 2024-09-17T18:15:44.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9595999999999997e-05 2024-09-17T18:15:44.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775297+0000", 2024-09-17T18:15:44.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3715000000000003e-05 2024-09-17T18:15:44.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775319+0000", 2024-09-17T18:15:44.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2742999999999999e-05 2024-09-17T18:15:44.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783071+0000", 2024-09-17T18:15:44.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0077514890000000003 2024-09-17T18:15:44.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783095+0000", 2024-09-17T18:15:44.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3981999999999998e-05 2024-09-17T18:15:44.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792559+0000", 2024-09-17T18:15:44.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0094641399999999994 2024-09-17T18:15:44.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792614+0000", 2024-09-17T18:15:44.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5421999999999999e-05 2024-09-17T18:15:44.023 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.023 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.023 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.024 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=91, reqid=client.4565.0:352, at_version=42'25, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:44.024 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775354+0000", 2024-09-17T18:15:44.024 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.2087086979999997, 2024-09-17T18:15:44.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019376402000000001, 2024-09-17T18:15:44.024 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.024 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.024 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.024 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775354+0000", 2024-09-17T18:15:44.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775354+0000", 2024-09-17T18:15:44.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775355+0000", 2024-09-17T18:15:44.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8700000000000004e-07 2024-09-17T18:15:44.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775411+0000", 2024-09-17T18:15:44.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5599000000000001e-05 2024-09-17T18:15:44.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775435+0000", 2024-09-17T18:15:44.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4156999999999999e-05 2024-09-17T18:15:44.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775454+0000", 2024-09-17T18:15:44.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8546000000000002e-05 2024-09-17T18:15:44.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787101+0000", 2024-09-17T18:15:44.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011647309 2024-09-17T18:15:44.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787134+0000", 2024-09-17T18:15:44.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2922000000000001e-05 2024-09-17T18:15:44.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794677+0000", 2024-09-17T18:15:44.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0075426629999999998 2024-09-17T18:15:44.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794731+0000", 2024-09-17T18:15:44.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4318999999999999e-05 2024-09-17T18:15:44.028 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.028 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.028 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.028 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 42/31 ECSubWrite(tid=92, reqid=client.4565.0:360, at_version=42'28, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:44.028 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775482+0000", 2024-09-17T18:15:44.028 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.2085811030000002, 2024-09-17T18:15:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019181841000000002, 2024-09-17T18:15:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775482+0000", 2024-09-17T18:15:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775482+0000", 2024-09-17T18:15:44.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775483+0000", 2024-09-17T18:15:44.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-17T18:15:44.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775514+0000", 2024-09-17T18:15:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1429e-05 2024-09-17T18:15:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775536+0000", 2024-09-17T18:15:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1773e-05 2024-09-17T18:15:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775551+0000", 2024-09-17T18:15:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.448e-05 2024-09-17T18:15:44.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785199+0000", 2024-09-17T18:15:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0096482760000000008 2024-09-17T18:15:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785221+0000", 2024-09-17T18:15:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2217000000000001e-05 2024-09-17T18:15:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794561+0000", 2024-09-17T18:15:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093396580000000007 2024-09-17T18:15:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794664+0000", 2024-09-17T18:15:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103168 2024-09-17T18:15:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=94, reqid=client.4565.0:353, at_version=42'26, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.778391+0000", 2024-09-17T18:15:44.034 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.2056724770000002, 2024-09-17T18:15:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019505588000000001, 2024-09-17T18:15:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778391+0000", 2024-09-17T18:15:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778391+0000", 2024-09-17T18:15:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778393+0000", 2024-09-17T18:15:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9130000000000001e-06 2024-09-17T18:15:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778432+0000", 2024-09-17T18:15:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9515999999999999e-05 2024-09-17T18:15:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778475+0000", 2024-09-17T18:15:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2898999999999997e-05 2024-09-17T18:15:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778517+0000", 2024-09-17T18:15:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2376000000000002e-05 2024-09-17T18:15:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788635+0000", 2024-09-17T18:15:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010117321 2024-09-17T18:15:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788661+0000", 2024-09-17T18:15:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6101999999999998e-05 2024-09-17T18:15:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.797809+0000", 2024-09-17T18:15:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0091479130000000006 2024-09-17T18:15:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.797896+0000", 2024-09-17T18:15:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7547999999999996e-05 2024-09-17T18:15:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 42/31 ECSubWrite(tid=93, reqid=osd.4.0:93, at_version=42'30, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.778582+0000", 2024-09-17T18:15:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.2054812039999998, 2024-09-17T18:15:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016196189999999999, 2024-09-17T18:15:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.039 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778582+0000", 2024-09-17T18:15:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778582+0000", 2024-09-17T18:15:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778583+0000", 2024-09-17T18:15:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.15e-06 2024-09-17T18:15:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778638+0000", 2024-09-17T18:15:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4752e-05 2024-09-17T18:15:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778664+0000", 2024-09-17T18:15:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5902999999999999e-05 2024-09-17T18:15:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778683+0000", 2024-09-17T18:15:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9406e-05 2024-09-17T18:15:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785698+0000", 2024-09-17T18:15:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0070144589999999998 2024-09-17T18:15:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785719+0000", 2024-09-17T18:15:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1746000000000002e-05 2024-09-17T18:15:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794719+0000", 2024-09-17T18:15:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0089993550000000005 2024-09-17T18:15:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794778+0000", 2024-09-17T18:15:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9419000000000001e-05 2024-09-17T18:15:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=95, reqid=client.4565.0:354, at_version=42'27, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779563+0000", 2024-09-17T18:15:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.2044998419999997, 2024-09-17T18:15:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018430695, 2024-09-17T18:15:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779563+0000", 2024-09-17T18:15:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779563+0000", 2024-09-17T18:15:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779565+0000", 2024-09-17T18:15:44.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9099999999999999e-06 2024-09-17T18:15:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779611+0000", 2024-09-17T18:15:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5595e-05 2024-09-17T18:15:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779644+0000", 2024-09-17T18:15:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3113e-05 2024-09-17T18:15:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779667+0000", 2024-09-17T18:15:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3033000000000001e-05 2024-09-17T18:15:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.790793+0000", 2024-09-17T18:15:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011125894000000001 2024-09-17T18:15:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.790816+0000", 2024-09-17T18:15:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3037e-05 2024-09-17T18:15:44.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.797906+0000", 2024-09-17T18:15:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0070905680000000002 2024-09-17T18:15:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.797994+0000", 2024-09-17T18:15:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7545000000000003e-05 2024-09-17T18:15:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 42/31 ECSubWrite(tid=96, reqid=osd.4.0:96, at_version=42'32, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779930+0000", 2024-09-17T18:15:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.2041328189999998, 2024-09-17T18:15:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018156274999999999, 2024-09-17T18:15:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779930+0000", 2024-09-17T18:15:44.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779930+0000", 2024-09-17T18:15:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779932+0000", 2024-09-17T18:15:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3999999999999999e-06 2024-09-17T18:15:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779978+0000", 2024-09-17T18:15:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6221999999999999e-05 2024-09-17T18:15:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.780043+0000", 2024-09-17T18:15:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5436000000000002e-05 2024-09-17T18:15:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.780066+0000", 2024-09-17T18:15:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2955e-05 2024-09-17T18:15:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788704+0000", 2024-09-17T18:15:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0086378989999999992 2024-09-17T18:15:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788729+0000", 2024-09-17T18:15:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4598999999999999e-05 2024-09-17T18:15:44.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.798004+0000", 2024-09-17T18:15:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0092750939999999994 2024-09-17T18:15:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.798087+0000", 2024-09-17T18:15:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2670000000000006e-05 2024-09-17T18:15:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=97, reqid=osd.4.0:97, at_version=42'29, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.782323+0000", 2024-09-17T18:15:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.2017402009999998, 2024-09-17T18:15:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015712542999999999, 2024-09-17T18:15:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782323+0000", 2024-09-17T18:15:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782323+0000", 2024-09-17T18:15:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782325+0000", 2024-09-17T18:15:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.08e-06 2024-09-17T18:15:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782379+0000", 2024-09-17T18:15:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4221999999999997e-05 2024-09-17T18:15:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782407+0000", 2024-09-17T18:15:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7438999999999999e-05 2024-09-17T18:15:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782428+0000", 2024-09-17T18:15:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1094000000000002e-05 2024-09-17T18:15:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.791219+0000", 2024-09-17T18:15:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0087913149999999992 2024-09-17T18:15:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.791236+0000", 2024-09-17T18:15:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6512999999999999e-05 2024-09-17T18:15:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.798002+0000", 2024-09-17T18:15:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0067663009999999997 2024-09-17T18:15:44.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.798035+0000", 2024-09-17T18:15:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3578999999999998e-05 2024-09-17T18:15:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.2s5 42/31 ECSubWrite(tid=19, reqid=osd.14.0:19, at_version=42'14, trim_to=0'0, roll_forward_to=39'12))", 2024-09-17T18:15:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.782552+0000", 2024-09-17T18:15:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.2015113050000004, 2024-09-17T18:15:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.01227898, 2024-09-17T18:15:44.058 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782552+0000", 2024-09-17T18:15:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782552+0000", 2024-09-17T18:15:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782552+0000", 2024-09-17T18:15:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-17T18:15:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782608+0000", 2024-09-17T18:15:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5099000000000002e-05 2024-09-17T18:15:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782637+0000", 2024-09-17T18:15:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9036000000000001e-05 2024-09-17T18:15:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782659+0000", 2024-09-17T18:15:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2687000000000001e-05 2024-09-17T18:15:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783249+0000", 2024-09-17T18:15:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00059022199999999995 2024-09-17T18:15:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783289+0000", 2024-09-17T18:15:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9298999999999998e-05 2024-09-17T18:15:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794737+0000", 2024-09-17T18:15:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011447739 2024-09-17T18:15:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794831+0000", 2024-09-17T18:15:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4282000000000003e-05 2024-09-17T18:15:44.062 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.2s5 42/31 ECSubWrite(tid=20, reqid=osd.14.0:20, at_version=42'16, trim_to=0'0, roll_forward_to=39'12))", 2024-09-17T18:15:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.785831+0000", 2024-09-17T18:15:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.1982320599999996, 2024-09-17T18:15:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012398578, 2024-09-17T18:15:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785831+0000", 2024-09-17T18:15:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785831+0000", 2024-09-17T18:15:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785833+0000", 2024-09-17T18:15:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9700000000000002e-06 2024-09-17T18:15:44.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785886+0000", 2024-09-17T18:15:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3124999999999997e-05 2024-09-17T18:15:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785916+0000", 2024-09-17T18:15:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9643999999999999e-05 2024-09-17T18:15:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785939+0000", 2024-09-17T18:15:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3014999999999999e-05 2024-09-17T18:15:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788473+0000", 2024-09-17T18:15:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025345900000000002 2024-09-17T18:15:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788497+0000", 2024-09-17T18:15:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3416000000000001e-05 2024-09-17T18:15:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.798028+0000", 2024-09-17T18:15:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0095311579999999996 2024-09-17T18:15:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.798230+0000", 2024-09-17T18:15:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020165999999999999 2024-09-17T18:15:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 43/31 ECSubWrite(tid=103, reqid=osd.4.0:103, at_version=43'31, trim_to=0'0, roll_forward_to=42'29))", 2024-09-17T18:15:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.768607+0000", 2024-09-17T18:15:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.2154559540000003, 2024-09-17T18:15:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093966889999999997, 2024-09-17T18:15:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768607+0000", 2024-09-17T18:15:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768607+0000", 2024-09-17T18:15:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768608+0000", 2024-09-17T18:15:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7000000000000005e-07 2024-09-17T18:15:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768665+0000", 2024-09-17T18:15:44.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7556000000000003e-05 2024-09-17T18:15:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768690+0000", 2024-09-17T18:15:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4532000000000002e-05 2024-09-17T18:15:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768715+0000", 2024-09-17T18:15:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5510000000000001e-05 2024-09-17T18:15:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768916+0000", 2024-09-17T18:15:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020097600000000001 2024-09-17T18:15:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768945+0000", 2024-09-17T18:15:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8636000000000002e-05 2024-09-17T18:15:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.777893+0000", 2024-09-17T18:15:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0089485239999999994 2024-09-17T18:15:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.778004+0000", 2024-09-17T18:15:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011038499999999999 2024-09-17T18:15:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 43/31 ECSubWrite(tid=110, reqid=osd.4.0:110, at_version=43'42, trim_to=0'0, roll_forward_to=43'38))", 2024-09-17T18:15:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.787989+0000", 2024-09-17T18:15:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.1960740889999997, 2024-09-17T18:15:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0099759700000000007, 2024-09-17T18:15:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.072 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.787989+0000", 2024-09-17T18:15:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.787989+0000", 2024-09-17T18:15:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.787991+0000", 2024-09-17T18:15:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6530000000000001e-06 2024-09-17T18:15:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788053+0000", 2024-09-17T18:15:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2742000000000003e-05 2024-09-17T18:15:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788084+0000", 2024-09-17T18:15:44.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0555999999999997e-05 2024-09-17T18:15:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788106+0000", 2024-09-17T18:15:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2086000000000002e-05 2024-09-17T18:15:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788506+0000", 2024-09-17T18:15:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00039958600000000001 2024-09-17T18:15:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788531+0000", 2024-09-17T18:15:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5099000000000001e-05 2024-09-17T18:15:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.797857+0000", 2024-09-17T18:15:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093266470000000004 2024-09-17T18:15:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.797965+0000", 2024-09-17T18:15:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000107601 2024-09-17T18:15:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.076 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.2s5 43/31 ECSubWrite(tid=23, reqid=osd.14.0:23, at_version=43'20, trim_to=0'0, roll_forward_to=42'16))", 2024-09-17T18:15:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.788439+0000", 2024-09-17T18:15:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.1956245179999998, 2024-09-17T18:15:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0096054739999999993, 2024-09-17T18:15:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788439+0000", 2024-09-17T18:15:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788439+0000", 2024-09-17T18:15:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788441+0000", 2024-09-17T18:15:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.12e-06 2024-09-17T18:15:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788494+0000", 2024-09-17T18:15:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3365999999999997e-05 2024-09-17T18:15:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788524+0000", 2024-09-17T18:15:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0005000000000002e-05 2024-09-17T18:15:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788564+0000", 2024-09-17T18:15:44.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0213000000000003e-05 2024-09-17T18:15:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788844+0000", 2024-09-17T18:15:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027924100000000001 2024-09-17T18:15:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788868+0000", 2024-09-17T18:15:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4626000000000001e-05 2024-09-17T18:15:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.797947+0000", 2024-09-17T18:15:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0090793120000000008 2024-09-17T18:15:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.798044+0000", 2024-09-17T18:15:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6590999999999997e-05 2024-09-17T18:15:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.081 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.081 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:44.083 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T18:15:44.083 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:44.079+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:44.183 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:44.183+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:44.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:15:44.210+0000 7f8f477fe640 0 --2- 172.21.15.87:0/1323404848 >> v2:172.21.15.87:3300/0 conn(0x7f8f4806e460 0x7f8f4806f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-17T18:15:44.260 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:44.260 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:44.260 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:15:44.260 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:44.274 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T18:15:44.284 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:44.281+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:44.385 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:44.379+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:44.397 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:44.397 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:44.397 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:15:44.397 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:15:44.397 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:44.411 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T18:15:44.486 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:44.482+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:44.532 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:44.533 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:15:44.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:15:44.533 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-17T18:15:44.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.533 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:259 3.2s0 3:412841d6:::smithi15432074-31:head [copy-from ver 6] snapc 5=[5,4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:15:44.533 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:33.723621+0000", 2024-09-17T18:15:44.533 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.805860366999999, 2024-09-17T18:15:44.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.023930903999999999, 2024-09-17T18:15:44.533 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.533 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.533 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:44.533 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:44.534 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:15:44.534 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:44.534 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 259 2024-09-17T18:15:44.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.534 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723621+0000", 2024-09-17T18:15:44.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723621+0000", 2024-09-17T18:15:44.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723624+0000", 2024-09-17T18:15:44.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7329999999999999e-06 2024-09-17T18:15:44.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723650+0000", 2024-09-17T18:15:44.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.635e-05 2024-09-17T18:15:44.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723679+0000", 2024-09-17T18:15:44.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9471999999999998e-05 2024-09-17T18:15:44.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723697+0000", 2024-09-17T18:15:44.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7499999999999998e-05 2024-09-17T18:15:44.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723856+0000", 2024-09-17T18:15:44.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015885699999999999 2024-09-17T18:15:44.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-17T18:15:44.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723876+0000", 2024-09-17T18:15:44.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0672000000000001e-05 2024-09-17T18:15:44.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725096+0000", 2024-09-17T18:15:44.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001219749 2024-09-17T18:15:44.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:44.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725238+0000", 2024-09-17T18:15:44.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014202299999999999 2024-09-17T18:15:44.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.742960+0000", 2024-09-17T18:15:44.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017721959999999998 2024-09-17T18:15:44.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.746486+0000", 2024-09-17T18:15:44.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035262169999999999 2024-09-17T18:15:44.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.539 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:44.539 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.747419+0000", 2024-09-17T18:15:44.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00093307999999999998 2024-09-17T18:15:44.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.539 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.539 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.747552+0000", 2024-09-17T18:15:44.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013229100000000001 2024-09-17T18:15:44.540 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.540 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.540 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.540 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:260 3.2s0 3:412841d6:::smithi15432074-31:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:15:44.540 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:33.723741+0000", 2024-09-17T18:15:44.540 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.805740346, 2024-09-17T18:15:44.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022041903000000002, 2024-09-17T18:15:44.540 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.541 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.541 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-17T18:15:44.541 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:44.541 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:15:44.541 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:44.541 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 260 2024-09-17T18:15:44.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.541 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723741+0000", 2024-09-17T18:15:44.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723741+0000", 2024-09-17T18:15:44.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723742+0000", 2024-09-17T18:15:44.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0130000000000001e-06 2024-09-17T18:15:44.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723747+0000", 2024-09-17T18:15:44.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1499999999999998e-06 2024-09-17T18:15:44.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723773+0000", 2024-09-17T18:15:44.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6389000000000001e-05 2024-09-17T18:15:44.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723788+0000", 2024-09-17T18:15:44.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4843e-05 2024-09-17T18:15:44.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.724014+0000", 2024-09-17T18:15:44.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000225539 2024-09-17T18:15:44.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:44.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.724024+0000", 2024-09-17T18:15:44.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0246e-05 2024-09-17T18:15:44.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725543+0000", 2024-09-17T18:15:44.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001519149 2024-09-17T18:15:44.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for blocked object", 2024-09-17T18:15:44.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725732+0000", 2024-09-17T18:15:44.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018853300000000001 2024-09-17T18:15:44.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.745290+0000", 2024-09-17T18:15:44.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019558507999999999 2024-09-17T18:15:44.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.545 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:44.545 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.745513+0000", 2024-09-17T18:15:44.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022266500000000001 2024-09-17T18:15:44.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.546 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.546 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.745783+0000", 2024-09-17T18:15:44.546 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00026986799999999999 2024-09-17T18:15:44.546 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.546 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.546 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.546 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:284 3.2s0 3:45e539c6:::smithi15432074-16:head [append 0~0] snapc 6=[6,5,4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T18:15:44.546 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:34.763530+0000", 2024-09-17T18:15:44.546 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7659511680000008, 2024-09-17T18:15:44.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010130172, 2024-09-17T18:15:44.547 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.547 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.547 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:44.547 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:44.547 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:15:44.547 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:44.547 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 284 2024-09-17T18:15:44.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.547 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763530+0000", 2024-09-17T18:15:44.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763530+0000", 2024-09-17T18:15:44.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763532+0000", 2024-09-17T18:15:44.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-17T18:15:44.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763542+0000", 2024-09-17T18:15:44.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1740000000000006e-06 2024-09-17T18:15:44.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763567+0000", 2024-09-17T18:15:44.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5664999999999999e-05 2024-09-17T18:15:44.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763579+0000", 2024-09-17T18:15:44.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1620000000000001e-05 2024-09-17T18:15:44.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763686+0000", 2024-09-17T18:15:44.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000107191 2024-09-17T18:15:44.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:44.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763820+0000", 2024-09-17T18:15:44.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013402600000000001 2024-09-17T18:15:44.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.551 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.764795+0000", 2024-09-17T18:15:44.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00097536200000000002 2024-09-17T18:15:44.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.551 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.551 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.769093+0000", 2024-09-17T18:15:44.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0042973430000000003 2024-09-17T18:15:44.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:44.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.773559+0000", 2024-09-17T18:15:44.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0044660000000000004 2024-09-17T18:15:44.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.773660+0000", 2024-09-17T18:15:44.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010135 2024-09-17T18:15:44.552 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.552 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.552 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.553 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:285 3.2s0 3:45e539c6:::smithi15432074-16:head [rollback 6] snapc 6=[6,5,4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T18:15:44.553 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:34.763617+0000", 2024-09-17T18:15:44.553 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7658640420000005, 2024-09-17T18:15:44.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0122197, 2024-09-17T18:15:44.553 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.553 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.553 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:44.553 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:44.553 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:15:44.553 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:44.553 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 285 2024-09-17T18:15:44.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.553 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763617+0000", 2024-09-17T18:15:44.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763617+0000", 2024-09-17T18:15:44.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.555 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.555 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763618+0000", 2024-09-17T18:15:44.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5799999999999998e-07 2024-09-17T18:15:44.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.555 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.555 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763622+0000", 2024-09-17T18:15:44.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0949999999999998e-06 2024-09-17T18:15:44.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.556 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763636+0000", 2024-09-17T18:15:44.556 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4297000000000001e-05 2024-09-17T18:15:44.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.556 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763644+0000", 2024-09-17T18:15:44.556 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7039999999999994e-06 2024-09-17T18:15:44.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.556 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.765578+0000", 2024-09-17T18:15:44.556 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001933733 2024-09-17T18:15:44.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.557 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:44.557 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.765683+0000", 2024-09-17T18:15:44.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105232 2024-09-17T18:15:44.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.557 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.557 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.766235+0000", 2024-09-17T18:15:44.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00055237199999999998 2024-09-17T18:15:44.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.557 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.557 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.769096+0000", 2024-09-17T18:15:44.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028609410000000001 2024-09-17T18:15:44.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:44.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.775767+0000", 2024-09-17T18:15:44.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0066707240000000003 2024-09-17T18:15:44.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.775837+0000", 2024-09-17T18:15:44.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9844000000000004e-05 2024-09-17T18:15:44.558 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.558 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.559 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.559 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:286 3.2s0 3:45e539c6:::smithi15432074-16:head [append 0~0] snapc 6=[6,5,4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T18:15:44.559 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:34.764140+0000", 2024-09-17T18:15:44.559 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.7653411069999994, 2024-09-17T18:15:44.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011898921, 2024-09-17T18:15:44.559 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.559 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.559 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:44.559 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:44.559 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:15:44.559 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:44.559 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 286 2024-09-17T18:15:44.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.560 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.560 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.560 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.764140+0000", 2024-09-17T18:15:44.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.764140+0000", 2024-09-17T18:15:44.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.764141+0000", 2024-09-17T18:15:44.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.153e-06 2024-09-17T18:15:44.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.764159+0000", 2024-09-17T18:15:44.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7893999999999998e-05 2024-09-17T18:15:44.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.764178+0000", 2024-09-17T18:15:44.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9293999999999999e-05 2024-09-17T18:15:44.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.764190+0000", 2024-09-17T18:15:44.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1571e-05 2024-09-17T18:15:44.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.766852+0000", 2024-09-17T18:15:44.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026625189999999999 2024-09-17T18:15:44.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.563 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:44.563 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.767092+0000", 2024-09-17T18:15:44.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000239588 2024-09-17T18:15:44.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.563 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.563 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.768435+0000", 2024-09-17T18:15:44.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0013428120000000001 2024-09-17T18:15:44.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.769945+0000", 2024-09-17T18:15:44.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015097820000000001 2024-09-17T18:15:44.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:44.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.775972+0000", 2024-09-17T18:15:44.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0060274079999999997 2024-09-17T18:15:44.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.776039+0000", 2024-09-17T18:15:44.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.69e-05 2024-09-17T18:15:44.565 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.565 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.565 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.565 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 42/31 ECSubWrite(tid=87, reqid=client.4565.0:358, at_version=42'26, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:44.565 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.771744+0000", 2024-09-17T18:15:44.565 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.7577372029999996, 2024-09-17T18:15:44.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015670561, 2024-09-17T18:15:44.565 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.565 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.565 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.565 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771744+0000", 2024-09-17T18:15:44.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771744+0000", 2024-09-17T18:15:44.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.567 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.567 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771746+0000", 2024-09-17T18:15:44.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.81e-06 2024-09-17T18:15:44.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.567 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.567 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771798+0000", 2024-09-17T18:15:44.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2142999999999999e-05 2024-09-17T18:15:44.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.567 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.567 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771824+0000", 2024-09-17T18:15:44.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6052999999999999e-05 2024-09-17T18:15:44.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771853+0000", 2024-09-17T18:15:44.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8716000000000001e-05 2024-09-17T18:15:44.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773108+0000", 2024-09-17T18:15:44.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012554829999999999 2024-09-17T18:15:44.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773139+0000", 2024-09-17T18:15:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1003000000000001e-05 2024-09-17T18:15:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.786900+0000", 2024-09-17T18:15:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013761175 2024-09-17T18:15:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787415+0000", 2024-09-17T18:15:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00051417800000000001 2024-09-17T18:15:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.570 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.570 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.570 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 42/31 ECSubWrite(tid=88, reqid=client.4565.0:344, at_version=42'22, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:44.570 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.771934+0000", 2024-09-17T18:15:44.570 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.7575473490000002, 2024-09-17T18:15:44.570 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011170889999999999, 2024-09-17T18:15:44.570 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.571 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.571 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.571 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771934+0000", 2024-09-17T18:15:44.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771934+0000", 2024-09-17T18:15:44.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.572 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.572 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.572 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771935+0000", 2024-09-17T18:15:44.572 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.167e-06 2024-09-17T18:15:44.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.572 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.572 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.572 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771989+0000", 2024-09-17T18:15:44.572 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3582000000000003e-05 2024-09-17T18:15:44.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.572 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.572 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.572 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772014+0000", 2024-09-17T18:15:44.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5531999999999999e-05 2024-09-17T18:15:44.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772038+0000", 2024-09-17T18:15:44.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3730000000000001e-05 2024-09-17T18:15:44.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773242+0000", 2024-09-17T18:15:44.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012045739999999999 2024-09-17T18:15:44.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773266+0000", 2024-09-17T18:15:44.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3969999999999999e-05 2024-09-17T18:15:44.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783041+0000", 2024-09-17T18:15:44.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0097749729999999993 2024-09-17T18:15:44.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.575 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.575 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783105+0000", 2024-09-17T18:15:44.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3361999999999994e-05 2024-09-17T18:15:44.575 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.575 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.575 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.575 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 42/31 ECSubWrite(tid=89, reqid=client.4565.0:345, at_version=42'23, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:44.575 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.773988+0000", 2024-09-17T18:15:44.575 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.7554930410000003, 2024-09-17T18:15:44.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013188996, 2024-09-17T18:15:44.575 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.576 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.576 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.576 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.576 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773988+0000", 2024-09-17T18:15:44.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.576 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773988+0000", 2024-09-17T18:15:44.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773990+0000", 2024-09-17T18:15:44.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8360000000000001e-06 2024-09-17T18:15:44.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774050+0000", 2024-09-17T18:15:44.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9735999999999999e-05 2024-09-17T18:15:44.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774085+0000", 2024-09-17T18:15:44.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5031999999999999e-05 2024-09-17T18:15:44.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.578 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.578 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.578 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774108+0000", 2024-09-17T18:15:44.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3067000000000001e-05 2024-09-17T18:15:44.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.578 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.578 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.578 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775952+0000", 2024-09-17T18:15:44.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018443450000000001 2024-09-17T18:15:44.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775975+0000", 2024-09-17T18:15:44.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2793e-05 2024-09-17T18:15:44.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.786570+0000", 2024-09-17T18:15:44.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010595099 2024-09-17T18:15:44.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787177+0000", 2024-09-17T18:15:44.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00060708799999999999 2024-09-17T18:15:44.580 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.580 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.580 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.580 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.580 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 42/31 ECSubWrite(tid=90, reqid=client.4565.0:359, at_version=42'27, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:44.580 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.774176+0000", 2024-09-17T18:15:44.580 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.7553050350000001, 2024-09-17T18:15:44.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013323531, 2024-09-17T18:15:44.580 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.580 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.580 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.581 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.581 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.581 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774176+0000", 2024-09-17T18:15:44.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.581 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.581 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.581 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774176+0000", 2024-09-17T18:15:44.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774177+0000", 2024-09-17T18:15:44.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2270000000000001e-06 2024-09-17T18:15:44.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774218+0000", 2024-09-17T18:15:44.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0448999999999998e-05 2024-09-17T18:15:44.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774241+0000", 2024-09-17T18:15:44.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3646e-05 2024-09-17T18:15:44.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774265+0000", 2024-09-17T18:15:44.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4012999999999999e-05 2024-09-17T18:15:44.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.777483+0000", 2024-09-17T18:15:44.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00321712 2024-09-17T18:15:44.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.777498+0000", 2024-09-17T18:15:44.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5566e-05 2024-09-17T18:15:44.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787425+0000", 2024-09-17T18:15:44.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0099264049999999993 2024-09-17T18:15:44.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787500+0000", 2024-09-17T18:15:44.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5104999999999993e-05 2024-09-17T18:15:44.585 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.585 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.585 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.585 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.585 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.585 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 42/31 ECSubWrite(tid=92, reqid=client.4565.0:360, at_version=42'28, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:44.585 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775679+0000", 2024-09-17T18:15:44.585 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.7538025929999996, 2024-09-17T18:15:44.585 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011913399999999999, 2024-09-17T18:15:44.585 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.585 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.585 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.585 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775679+0000", 2024-09-17T18:15:44.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775679+0000", 2024-09-17T18:15:44.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775680+0000", 2024-09-17T18:15:44.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9e-06 2024-09-17T18:15:44.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775741+0000", 2024-09-17T18:15:44.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0992000000000002e-05 2024-09-17T18:15:44.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775774+0000", 2024-09-17T18:15:44.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2595999999999998e-05 2024-09-17T18:15:44.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775796+0000", 2024-09-17T18:15:44.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1469999999999999e-05 2024-09-17T18:15:44.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778960+0000", 2024-09-17T18:15:44.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031640510000000002 2024-09-17T18:15:44.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.589 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.589 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778981+0000", 2024-09-17T18:15:44.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1036e-05 2024-09-17T18:15:44.589 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.589 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.589 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.589 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787509+0000", 2024-09-17T18:15:44.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0085285199999999995 2024-09-17T18:15:44.589 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.589 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.589 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.589 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787592+0000", 2024-09-17T18:15:44.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2835000000000002e-05 2024-09-17T18:15:44.589 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.590 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.590 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.590 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 42/31 ECSubWrite(tid=91, reqid=client.4565.0:352, at_version=42'25, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:44.590 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775835+0000", 2024-09-17T18:15:44.590 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.7536461130000003, 2024-09-17T18:15:44.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013769896, 2024-09-17T18:15:44.590 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.590 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.590 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.590 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775835+0000", 2024-09-17T18:15:44.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775835+0000", 2024-09-17T18:15:44.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775836+0000", 2024-09-17T18:15:44.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.04e-06 2024-09-17T18:15:44.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.592 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.592 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.592 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775890+0000", 2024-09-17T18:15:44.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4225999999999999e-05 2024-09-17T18:15:44.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.592 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.592 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.592 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775914+0000", 2024-09-17T18:15:44.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3646e-05 2024-09-17T18:15:44.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.592 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.592 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.592 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775932+0000", 2024-09-17T18:15:44.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8043e-05 2024-09-17T18:15:44.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.593 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.593 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776905+0000", 2024-09-17T18:15:44.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00097315499999999996 2024-09-17T18:15:44.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.593 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.593 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776926+0000", 2024-09-17T18:15:44.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1322999999999999e-05 2024-09-17T18:15:44.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.593 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.594 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789505+0000", 2024-09-17T18:15:44.594 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012578768000000001 2024-09-17T18:15:44.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.594 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.594 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789605+0000", 2024-09-17T18:15:44.594 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9695e-05 2024-09-17T18:15:44.594 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.594 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.594 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.594 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.cs6 42/31 ECSubWrite(tid=38, reqid=osd.5.0:38, at_version=42'19, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T18:15:44.595 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.776311+0000", 2024-09-17T18:15:44.595 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.7531699920000001, 2024-09-17T18:15:44.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012039032, 2024-09-17T18:15:44.595 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.595 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.595 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.595 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776311+0000", 2024-09-17T18:15:44.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776311+0000", 2024-09-17T18:15:44.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776312+0000", 2024-09-17T18:15:44.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0399999999999996e-07 2024-09-17T18:15:44.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776369+0000", 2024-09-17T18:15:44.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7395000000000002e-05 2024-09-17T18:15:44.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.597 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.597 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.597 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776398+0000", 2024-09-17T18:15:44.597 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8736999999999999e-05 2024-09-17T18:15:44.597 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.597 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.597 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.597 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776437+0000", 2024-09-17T18:15:44.597 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9261999999999998e-05 2024-09-17T18:15:44.597 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.597 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.597 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.597 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776999+0000", 2024-09-17T18:15:44.598 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0005622 2024-09-17T18:15:44.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.598 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.777021+0000", 2024-09-17T18:15:44.598 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1875999999999999e-05 2024-09-17T18:15:44.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.598 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788258+0000", 2024-09-17T18:15:44.598 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.01123652 2024-09-17T18:15:44.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.599 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788350+0000", 2024-09-17T18:15:44.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2437999999999998e-05 2024-09-17T18:15:44.599 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.599 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.599 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.599 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.599 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 42/31 ECSubWrite(tid=94, reqid=client.4565.0:353, at_version=42'26, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:44.599 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779073+0000", 2024-09-17T18:15:44.599 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.7504076800000004, 2024-09-17T18:15:44.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013251409, 2024-09-17T18:15:44.599 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.600 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.600 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.600 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.600 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.600 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779073+0000", 2024-09-17T18:15:44.600 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.600 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.600 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.600 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779073+0000", 2024-09-17T18:15:44.601 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.601 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.601 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.601 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.601 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779075+0000", 2024-09-17T18:15:44.601 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.734e-06 2024-09-17T18:15:44.601 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.601 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.601 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.601 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779118+0000", 2024-09-17T18:15:44.601 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2719000000000002e-05 2024-09-17T18:15:44.601 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.601 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.601 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.602 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779145+0000", 2024-09-17T18:15:44.602 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6740000000000001e-05 2024-09-17T18:15:44.602 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.602 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.602 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.602 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779166+0000", 2024-09-17T18:15:44.602 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1029000000000001e-05 2024-09-17T18:15:44.602 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.602 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.602 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.602 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783908+0000", 2024-09-17T18:15:44.602 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047425669999999996 2024-09-17T18:15:44.602 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.603 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.603 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.603 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783931+0000", 2024-09-17T18:15:44.603 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2484e-05 2024-09-17T18:15:44.603 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.603 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.603 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.603 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792232+0000", 2024-09-17T18:15:44.603 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0083012639999999992 2024-09-17T18:15:44.603 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.603 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.603 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.603 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792325+0000", 2024-09-17T18:15:44.604 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2872000000000001e-05 2024-09-17T18:15:44.604 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.604 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.604 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.604 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.605 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.605 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 42/31 ECSubWrite(tid=93, reqid=osd.4.0:93, at_version=42'30, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:44.605 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779203+0000", 2024-09-17T18:15:44.605 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.7502781719999998, 2024-09-17T18:15:44.605 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0099596730000000005, 2024-09-17T18:15:44.605 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.605 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.605 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.605 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.605 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779203+0000", 2024-09-17T18:15:44.606 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779203+0000", 2024-09-17T18:15:44.606 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779204+0000", 2024-09-17T18:15:44.606 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0529999999999999e-06 2024-09-17T18:15:44.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.607 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.607 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779285+0000", 2024-09-17T18:15:44.607 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1372000000000006e-05 2024-09-17T18:15:44.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.607 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.607 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779312+0000", 2024-09-17T18:15:44.607 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6143e-05 2024-09-17T18:15:44.608 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.608 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.608 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.608 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779330+0000", 2024-09-17T18:15:44.608 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8369e-05 2024-09-17T18:15:44.608 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.608 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.609 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.609 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779487+0000", 2024-09-17T18:15:44.609 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000156787 2024-09-17T18:15:44.609 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.609 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.609 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.609 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779507+0000", 2024-09-17T18:15:44.609 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0259999999999999e-05 2024-09-17T18:15:44.609 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.609 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.609 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.609 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789100+0000", 2024-09-17T18:15:44.610 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0095926870000000008 2024-09-17T18:15:44.610 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.610 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.610 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.610 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789163+0000", 2024-09-17T18:15:44.610 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3002000000000004e-05 2024-09-17T18:15:44.610 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.610 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.610 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.610 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.610 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.610 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 42/31 ECSubWrite(tid=95, reqid=client.4565.0:354, at_version=42'27, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:44.610 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779371+0000", 2024-09-17T18:15:44.610 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.750109782, 2024-09-17T18:15:44.611 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013017299, 2024-09-17T18:15:44.611 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.611 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.611 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.611 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.611 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.611 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.611 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779371+0000", 2024-09-17T18:15:44.611 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.611 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.612 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.612 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779371+0000", 2024-09-17T18:15:44.612 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.612 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.612 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.612 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779372+0000", 2024-09-17T18:15:44.612 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.017e-06 2024-09-17T18:15:44.612 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.612 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.612 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779414+0000", 2024-09-17T18:15:44.613 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1862e-05 2024-09-17T18:15:44.613 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.613 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.613 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.613 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779436+0000", 2024-09-17T18:15:44.613 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1946e-05 2024-09-17T18:15:44.613 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.613 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.613 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.613 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779452+0000", 2024-09-17T18:15:44.613 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6263999999999999e-05 2024-09-17T18:15:44.613 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.613 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.614 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.614 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785966+0000", 2024-09-17T18:15:44.614 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0065139439999999998 2024-09-17T18:15:44.614 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.614 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.614 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.615 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785990+0000", 2024-09-17T18:15:44.615 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3598999999999999e-05 2024-09-17T18:15:44.615 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.615 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.615 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.615 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792332+0000", 2024-09-17T18:15:44.615 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0063415720000000002 2024-09-17T18:15:44.615 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.615 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.615 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.615 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792389+0000", 2024-09-17T18:15:44.615 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7095000000000001e-05 2024-09-17T18:15:44.616 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.616 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.616 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.616 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.616 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.616 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 42/31 ECSubWrite(tid=96, reqid=osd.4.0:96, at_version=42'32, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:44.616 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779902+0000", 2024-09-17T18:15:44.616 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.7495792720000001, 2024-09-17T18:15:44.616 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011419632000000001, 2024-09-17T18:15:44.616 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.617 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.617 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.617 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.617 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.617 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.617 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779902+0000", 2024-09-17T18:15:44.617 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.617 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.617 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.617 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.617 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779902+0000", 2024-09-17T18:15:44.617 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.617 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.618 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.618 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779903+0000", 2024-09-17T18:15:44.618 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1930000000000001e-06 2024-09-17T18:15:44.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.618 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.618 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779942+0000", 2024-09-17T18:15:44.618 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9276999999999997e-05 2024-09-17T18:15:44.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.618 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.619 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779971+0000", 2024-09-17T18:15:44.619 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8319000000000001e-05 2024-09-17T18:15:44.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.620 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.620 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779989+0000", 2024-09-17T18:15:44.620 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8519999999999999e-05 2024-09-17T18:15:44.620 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.620 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.620 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785112+0000", 2024-09-17T18:15:44.620 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0051225869999999996 2024-09-17T18:15:44.620 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.620 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.621 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785135+0000", 2024-09-17T18:15:44.621 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3289e-05 2024-09-17T18:15:44.621 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.621 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.621 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.621 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.791216+0000", 2024-09-17T18:15:44.621 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.006080523 2024-09-17T18:15:44.621 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.621 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.621 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.621 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.791322+0000", 2024-09-17T18:15:44.621 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105924 2024-09-17T18:15:44.621 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.622 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.622 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.622 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.622 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.622 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 43/31 ECSubWrite(tid=105, reqid=osd.4.0:105, at_version=43'38, trim_to=0'0, roll_forward_to=42'34))", 2024-09-17T18:15:44.622 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.770201+0000", 2024-09-17T18:15:44.622 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.7592800520000003, 2024-09-17T18:15:44.622 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013112386, 2024-09-17T18:15:44.622 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.622 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.622 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.622 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.622 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.623 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.623 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770201+0000", 2024-09-17T18:15:44.623 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.623 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.623 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.623 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.623 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770201+0000", 2024-09-17T18:15:44.623 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.623 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.623 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.624 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770203+0000", 2024-09-17T18:15:44.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3969999999999999e-06 2024-09-17T18:15:44.624 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.624 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770256+0000", 2024-09-17T18:15:44.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3615000000000001e-05 2024-09-17T18:15:44.624 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.624 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770288+0000", 2024-09-17T18:15:44.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.218e-05 2024-09-17T18:15:44.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.625 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.625 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770310+0000", 2024-09-17T18:15:44.625 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1386000000000002e-05 2024-09-17T18:15:44.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.625 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.625 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.771914+0000", 2024-09-17T18:15:44.625 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001604556 2024-09-17T18:15:44.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.625 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.626 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.771940+0000", 2024-09-17T18:15:44.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5514999999999999e-05 2024-09-17T18:15:44.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.626 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.626 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.626 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.783201+0000", 2024-09-17T18:15:44.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011260983 2024-09-17T18:15:44.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.626 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.626 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.626 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.783313+0000", 2024-09-17T18:15:44.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000112754 2024-09-17T18:15:44.626 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.626 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.627 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.627 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.627 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.fs3 43/31 ECSubWrite(tid=182, reqid=osd.13.0:182, at_version=43'14, trim_to=0'0, roll_forward_to=42'12))", 2024-09-17T18:15:44.627 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.776175+0000", 2024-09-17T18:15:44.627 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.7533059189999998, 2024-09-17T18:15:44.627 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010822146, 2024-09-17T18:15:44.627 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.627 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.627 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.627 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.627 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776175+0000", 2024-09-17T18:15:44.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.628 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776175+0000", 2024-09-17T18:15:44.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.628 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776176+0000", 2024-09-17T18:15:44.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4000000000000002e-07 2024-09-17T18:15:44.628 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.629 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.629 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.629 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776230+0000", 2024-09-17T18:15:44.629 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4106e-05 2024-09-17T18:15:44.629 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.629 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.629 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776261+0000", 2024-09-17T18:15:44.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0945000000000003e-05 2024-09-17T18:15:44.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.630 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776284+0000", 2024-09-17T18:15:44.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3617000000000001e-05 2024-09-17T18:15:44.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776446+0000", 2024-09-17T18:15:44.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000161383 2024-09-17T18:15:44.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776470+0000", 2024-09-17T18:15:44.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4309999999999999e-05 2024-09-17T18:15:44.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.786910+0000", 2024-09-17T18:15:44.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010439834 2024-09-17T18:15:44.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.786997+0000", 2024-09-17T18:15:44.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7410999999999994e-05 2024-09-17T18:15:44.632 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.632 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.632 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.633 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.633 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.633 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s1 43/31 ECSubWrite(tid=20, reqid=osd.0.0:20, at_version=43'12, trim_to=0'0, roll_forward_to=35'10))", 2024-09-17T18:15:44.633 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.779487+0000", 2024-09-17T18:15:44.633 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.749994311, 2024-09-17T18:15:44.633 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0098483689999999992, 2024-09-17T18:15:44.633 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.633 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.633 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.633 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.633 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779487+0000", 2024-09-17T18:15:44.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779487+0000", 2024-09-17T18:15:44.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779488+0000", 2024-09-17T18:15:44.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0999999999999997e-07 2024-09-17T18:15:44.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779545+0000", 2024-09-17T18:15:44.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7076e-05 2024-09-17T18:15:44.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779575+0000", 2024-09-17T18:15:44.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0096000000000001e-05 2024-09-17T18:15:44.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.637 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779598+0000", 2024-09-17T18:15:44.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3453000000000001e-05 2024-09-17T18:15:44.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.637 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779781+0000", 2024-09-17T18:15:44.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018308899999999999 2024-09-17T18:15:44.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779805+0000", 2024-09-17T18:15:44.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4026e-05 2024-09-17T18:15:44.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.789249+0000", 2024-09-17T18:15:44.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0094439009999999993 2024-09-17T18:15:44.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.789335+0000", 2024-09-17T18:15:44.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5817999999999997e-05 2024-09-17T18:15:44.639 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.639 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.639 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.639 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 43/31 ECSubWrite(tid=110, reqid=osd.4.0:110, at_version=43'42, trim_to=0'0, roll_forward_to=43'38))", 2024-09-17T18:15:44.639 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.788583+0000", 2024-09-17T18:15:44.639 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.7408978570000002, 2024-09-17T18:15:44.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0095213190000000003, 2024-09-17T18:15:44.639 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:44.639 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:44.639 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:44.640 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:44.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:44.640 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788583+0000", 2024-09-17T18:15:44.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:44.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788583+0000", 2024-09-17T18:15:44.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:44.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.641 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:44.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788593+0000", 2024-09-17T18:15:44.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2730000000000008e-06 2024-09-17T18:15:44.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:44.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788644+0000", 2024-09-17T18:15:44.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1439e-05 2024-09-17T18:15:44.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:44.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788675+0000", 2024-09-17T18:15:44.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0942000000000003e-05 2024-09-17T18:15:44.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:44.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788696+0000", 2024-09-17T18:15:44.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1387e-05 2024-09-17T18:15:44.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:44.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.790358+0000", 2024-09-17T18:15:44.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001661764 2024-09-17T18:15:44.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:44.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.790382+0000", 2024-09-17T18:15:44.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4266000000000001e-05 2024-09-17T18:15:44.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:44.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.797988+0000", 2024-09-17T18:15:44.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0076055369999999999 2024-09-17T18:15:44.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:44.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:44.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:44.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.798105+0000", 2024-09-17T18:15:44.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116711 2024-09-17T18:15:44.644 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.644 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.644 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.645 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:44.645 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:44.645 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:44.647 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T18:15:44.647 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:44.645+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:44.747 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:44.745+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:44.780 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:44.780 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:15:44.780 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T18:15:44.780 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:44.794 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T18:15:44.817 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.14 to 1 (10000) 2024-09-17T18:15:44.823 INFO:tasks.rados.rados.0.smithi154.stdout:156: done (2 left) 2024-09-17T18:15:44.823 INFO:tasks.rados.rados.0.smithi154.stdout:157: done (1 left) 2024-09-17T18:15:44.823 INFO:tasks.rados.rados.0.smithi154.stdout:158: done (0 left) 2024-09-17T18:15:44.823 INFO:tasks.rados.rados.0.smithi154.stdout:159: delete oid 15 current snap is 13 2024-09-17T18:15:44.831 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T18:15:44.832 INFO:tasks.rados.rados.0.smithi154.stdout:159: done (0 left) 2024-09-17T18:15:44.832 INFO:tasks.rados.rados.0.smithi154.stdout:160: read oid 25 snap -1 2024-09-17T18:15:44.832 INFO:tasks.rados.rados.0.smithi154.stdout:160: expect deleted 2024-09-17T18:15:44.832 INFO:tasks.rados.rados.0.smithi154.stdout:161: snap_create 2024-09-17T18:15:44.842 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 15 1 2024-09-17T18:15:44.848 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:44.845+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:44.949 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:44.949 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:15:44.949 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T18:15:44.949 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T18:15:44.950 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:44.950 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:44.947+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:44.964 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T18:15:45.050 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:45.047+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:45.132 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:45.132 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T18:15:45.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T18:15:45.132 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T18:15:45.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.133 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs3 37/31 ECSubWrite(tid=32, reqid=client.4565.0:243, at_version=37'17, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:15:45.133 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:32.707105+0000", 2024-09-17T18:15:45.133 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.423307482, 2024-09-17T18:15:45.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054309459999999999, 2024-09-17T18:15:45.133 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.133 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.133 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.133 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.707105+0000", 2024-09-17T18:15:45.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.707105+0000", 2024-09-17T18:15:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.707107+0000", 2024-09-17T18:15:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3629999999999999e-06 2024-09-17T18:15:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.707139+0000", 2024-09-17T18:15:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2956000000000001e-05 2024-09-17T18:15:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.707159+0000", 2024-09-17T18:15:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9213000000000001e-05 2024-09-17T18:15:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.707187+0000", 2024-09-17T18:15:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7973000000000001e-05 2024-09-17T18:15:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.707327+0000", 2024-09-17T18:15:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014055900000000001 2024-09-17T18:15:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.707351+0000", 2024-09-17T18:15:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3723e-05 2024-09-17T18:15:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.712466+0000", 2024-09-17T18:15:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051153539999999999 2024-09-17T18:15:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.712536+0000", 2024-09-17T18:15:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9805e-05 2024-09-17T18:15:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.as4 37/31 ECSubWrite(tid=101, reqid=client.4565.0:248, at_version=37'25, trim_to=0'0, roll_forward_to=36'23))", 2024-09-17T18:15:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:32.727208+0000", 2024-09-17T18:15:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.403204481, 2024-09-17T18:15:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0049432260000000002, 2024-09-17T18:15:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.727208+0000", 2024-09-17T18:15:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.727208+0000", 2024-09-17T18:15:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.727208+0000", 2024-09-17T18:15:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4400000000000001e-07 2024-09-17T18:15:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.727253+0000", 2024-09-17T18:15:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4925000000000001e-05 2024-09-17T18:15:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.727287+0000", 2024-09-17T18:15:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3469000000000001e-05 2024-09-17T18:15:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.727309+0000", 2024-09-17T18:15:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2367000000000001e-05 2024-09-17T18:15:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.727459+0000", 2024-09-17T18:15:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015013200000000001 2024-09-17T18:15:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.727487+0000", 2024-09-17T18:15:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7673000000000001e-05 2024-09-17T18:15:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.732058+0000", 2024-09-17T18:15:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045710719999999998 2024-09-17T18:15:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.732151+0000", 2024-09-17T18:15:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3244000000000004e-05 2024-09-17T18:15:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 42/31 ECSubWrite(tid=133, reqid=osd.6.0:133, at_version=42'17, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T18:15:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:37.762283+0000", 2024-09-17T18:15:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.3681294470000003, 2024-09-17T18:15:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057420070000000004, 2024-09-17T18:15:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.762283+0000", 2024-09-17T18:15:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.762283+0000", 2024-09-17T18:15:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.762284+0000", 2024-09-17T18:15:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5300000000000002e-07 2024-09-17T18:15:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.762312+0000", 2024-09-17T18:15:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8285000000000001e-05 2024-09-17T18:15:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.762329+0000", 2024-09-17T18:15:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6407999999999999e-05 2024-09-17T18:15:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.762342+0000", 2024-09-17T18:15:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3027000000000001e-05 2024-09-17T18:15:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.762442+0000", 2024-09-17T18:15:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100437 2024-09-17T18:15:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.762451+0000", 2024-09-17T18:15:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7010000000000002e-06 2024-09-17T18:15:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.767893+0000", 2024-09-17T18:15:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054417399999999996 2024-09-17T18:15:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.768025+0000", 2024-09-17T18:15:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013245600000000001 2024-09-17T18:15:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s6 42/31 ECSubWrite(tid=40, reqid=client.4565.0:363, at_version=42'26, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:15:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:37.766681+0000", 2024-09-17T18:15:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.3637317089999996, 2024-09-17T18:15:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084439879999999995, 2024-09-17T18:15:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766681+0000", 2024-09-17T18:15:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766681+0000", 2024-09-17T18:15:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766682+0000", 2024-09-17T18:15:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.06e-07 2024-09-17T18:15:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766724+0000", 2024-09-17T18:15:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1882999999999999e-05 2024-09-17T18:15:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766749+0000", 2024-09-17T18:15:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5157e-05 2024-09-17T18:15:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766756+0000", 2024-09-17T18:15:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3610000000000003e-06 2024-09-17T18:15:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766820+0000", 2024-09-17T18:15:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4313999999999994e-05 2024-09-17T18:15:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766834+0000", 2024-09-17T18:15:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3346999999999999e-05 2024-09-17T18:15:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.775060+0000", 2024-09-17T18:15:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082263920000000008 2024-09-17T18:15:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.775125+0000", 2024-09-17T18:15:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4827999999999997e-05 2024-09-17T18:15:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.fs1 43/31 ECSubWrite(tid=182, reqid=osd.13.0:182, at_version=43'14, trim_to=0'0, roll_forward_to=42'12))", 2024-09-17T18:15:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.775559+0000", 2024-09-17T18:15:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.3548532199999999, 2024-09-17T18:15:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0080031730000000006, 2024-09-17T18:15:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775559+0000", 2024-09-17T18:15:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775559+0000", 2024-09-17T18:15:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775560+0000", 2024-09-17T18:15:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0999999999999998e-07 2024-09-17T18:15:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775634+0000", 2024-09-17T18:15:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4357999999999995e-05 2024-09-17T18:15:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775672+0000", 2024-09-17T18:15:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7595999999999997e-05 2024-09-17T18:15:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775696+0000", 2024-09-17T18:15:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3652999999999999e-05 2024-09-17T18:15:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775930+0000", 2024-09-17T18:15:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023461099999999999 2024-09-17T18:15:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775959+0000", 2024-09-17T18:15:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9229000000000001e-05 2024-09-17T18:15:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.783468+0000", 2024-09-17T18:15:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075087779999999998 2024-09-17T18:15:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.783563+0000", 2024-09-17T18:15:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4338000000000004e-05 2024-09-17T18:15:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 43/31 ECSubWrite(tid=135, reqid=osd.6.0:135, at_version=43'19, trim_to=0'0, roll_forward_to=42'17))", 2024-09-17T18:15:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.777285+0000", 2024-09-17T18:15:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.3531278000000002, 2024-09-17T18:15:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090781219999999992, 2024-09-17T18:15:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777285+0000", 2024-09-17T18:15:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777285+0000", 2024-09-17T18:15:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777285+0000", 2024-09-17T18:15:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4000000000000002e-07 2024-09-17T18:15:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777344+0000", 2024-09-17T18:15:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8978999999999999e-05 2024-09-17T18:15:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777376+0000", 2024-09-17T18:15:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1532999999999998e-05 2024-09-17T18:15:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777398+0000", 2024-09-17T18:15:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2541999999999999e-05 2024-09-17T18:15:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777568+0000", 2024-09-17T18:15:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016965900000000001 2024-09-17T18:15:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777594+0000", 2024-09-17T18:15:45.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5732999999999999e-05 2024-09-17T18:15:45.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786283+0000", 2024-09-17T18:15:45.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086891280000000008 2024-09-17T18:15:45.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786363+0000", 2024-09-17T18:15:45.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0007999999999997e-05 2024-09-17T18:15:45.166 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.166 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.166 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.166 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 43/31 ECSubWrite(tid=136, reqid=osd.6.0:136, at_version=43'21, trim_to=0'0, roll_forward_to=42'17))", 2024-09-17T18:15:45.167 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.779871+0000", 2024-09-17T18:15:45.167 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.3505411709999997, 2024-09-17T18:15:45.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010748845999999999, 2024-09-17T18:15:45.167 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.167 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.167 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.167 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779871+0000", 2024-09-17T18:15:45.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779871+0000", 2024-09-17T18:15:45.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779873+0000", 2024-09-17T18:15:45.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9860000000000001e-06 2024-09-17T18:15:45.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779952+0000", 2024-09-17T18:15:45.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8191999999999999e-05 2024-09-17T18:15:45.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779981+0000", 2024-09-17T18:15:45.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9675e-05 2024-09-17T18:15:45.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.780002+0000", 2024-09-17T18:15:45.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0713999999999999e-05 2024-09-17T18:15:45.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.780164+0000", 2024-09-17T18:15:45.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000161559 2024-09-17T18:15:45.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.780189+0000", 2024-09-17T18:15:45.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5539000000000001e-05 2024-09-17T18:15:45.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790548+0000", 2024-09-17T18:15:45.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010358590000000001 2024-09-17T18:15:45.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790620+0000", 2024-09-17T18:15:45.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2590999999999997e-05 2024-09-17T18:15:45.172 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.172 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.172 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.173 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.2s1 43/31 ECSubWrite(tid=22, reqid=osd.14.0:22, at_version=43'18, trim_to=0'0, roll_forward_to=42'16))", 2024-09-17T18:15:45.173 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.785984+0000", 2024-09-17T18:15:45.173 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.3444282779999996, 2024-09-17T18:15:45.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010839348, 2024-09-17T18:15:45.173 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.173 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.173 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.173 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785984+0000", 2024-09-17T18:15:45.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785984+0000", 2024-09-17T18:15:45.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785985+0000", 2024-09-17T18:15:45.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-07 2024-09-17T18:15:45.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786040+0000", 2024-09-17T18:15:45.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4694999999999997e-05 2024-09-17T18:15:45.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786073+0000", 2024-09-17T18:15:45.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3328999999999999e-05 2024-09-17T18:15:45.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786096+0000", 2024-09-17T18:15:45.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2643e-05 2024-09-17T18:15:45.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786277+0000", 2024-09-17T18:15:45.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000181669 2024-09-17T18:15:45.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786303+0000", 2024-09-17T18:15:45.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6149e-05 2024-09-17T18:15:45.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796720+0000", 2024-09-17T18:15:45.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010416752 2024-09-17T18:15:45.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796824+0000", 2024-09-17T18:15:45.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103491 2024-09-17T18:15:45.178 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.178 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.178 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.178 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.2s1 43/31 ECSubWrite(tid=23, reqid=osd.14.0:23, at_version=43'20, trim_to=0'0, roll_forward_to=42'16))", 2024-09-17T18:15:45.178 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.788662+0000", 2024-09-17T18:15:45.179 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.3417503689999997, 2024-09-17T18:15:45.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096349590000000002, 2024-09-17T18:15:45.179 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.179 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.179 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.179 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788662+0000", 2024-09-17T18:15:45.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788662+0000", 2024-09-17T18:15:45.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788664+0000", 2024-09-17T18:15:45.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9240000000000001e-06 2024-09-17T18:15:45.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788715+0000", 2024-09-17T18:15:45.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1028e-05 2024-09-17T18:15:45.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788749+0000", 2024-09-17T18:15:45.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3358999999999997e-05 2024-09-17T18:15:45.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788771+0000", 2024-09-17T18:15:45.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1943999999999999e-05 2024-09-17T18:15:45.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790286+0000", 2024-09-17T18:15:45.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015151819999999999 2024-09-17T18:15:45.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790299+0000", 2024-09-17T18:15:45.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3302000000000001e-05 2024-09-17T18:15:45.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.798203+0000", 2024-09-17T18:15:45.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079036650000000007 2024-09-17T18:15:45.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.798297+0000", 2024-09-17T18:15:45.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4555000000000005e-05 2024-09-17T18:15:45.183 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.184 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.184 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.fs1 43/31 ECSubWrite(tid=186, reqid=osd.13.0:182, at_version=0'0, trim_to=0'0, roll_forward_to=43'14))", 2024-09-17T18:15:45.184 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.789109+0000", 2024-09-17T18:15:45.184 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.3413036930000004, 2024-09-17T18:15:45.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0077309220000000003, 2024-09-17T18:15:45.184 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.184 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.184 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.184 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789109+0000", 2024-09-17T18:15:45.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789109+0000", 2024-09-17T18:15:45.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789111+0000", 2024-09-17T18:15:45.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.57e-06 2024-09-17T18:15:45.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789133+0000", 2024-09-17T18:15:45.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2552999999999999e-05 2024-09-17T18:15:45.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789159+0000", 2024-09-17T18:15:45.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6156000000000002e-05 2024-09-17T18:15:45.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789178+0000", 2024-09-17T18:15:45.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8692e-05 2024-09-17T18:15:45.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789376+0000", 2024-09-17T18:15:45.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019766200000000001 2024-09-17T18:15:45.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789399+0000", 2024-09-17T18:15:45.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3430000000000001e-05 2024-09-17T18:15:45.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796725+0000", 2024-09-17T18:15:45.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007325776 2024-09-17T18:15:45.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796840+0000", 2024-09-17T18:15:45.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115083 2024-09-17T18:15:45.189 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.189 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.189 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.189 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs3 43/31 ECSubWrite(tid=44, reqid=osd.5.0:44, at_version=43'23, trim_to=0'0, roll_forward_to=42'21))", 2024-09-17T18:15:45.189 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.790263+0000", 2024-09-17T18:15:45.189 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.3401496660000003, 2024-09-17T18:15:45.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088116389999999996, 2024-09-17T18:15:45.189 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.189 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.189 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.189 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790263+0000", 2024-09-17T18:15:45.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790263+0000", 2024-09-17T18:15:45.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790264+0000", 2024-09-17T18:15:45.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0399999999999996e-07 2024-09-17T18:15:45.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790322+0000", 2024-09-17T18:15:45.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8798999999999997e-05 2024-09-17T18:15:45.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790356+0000", 2024-09-17T18:15:45.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3172e-05 2024-09-17T18:15:45.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790379+0000", 2024-09-17T18:15:45.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3059000000000001e-05 2024-09-17T18:15:45.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790531+0000", 2024-09-17T18:15:45.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015204300000000001 2024-09-17T18:15:45.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790554+0000", 2024-09-17T18:15:45.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3445999999999999e-05 2024-09-17T18:15:45.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.799018+0000", 2024-09-17T18:15:45.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008464325 2024-09-17T18:15:45.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.799075+0000", 2024-09-17T18:15:45.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6190999999999998e-05 2024-09-17T18:15:45.193 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.193 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.193 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.194 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs3 43/31 ECSubWrite(tid=45, reqid=osd.5.0:45, at_version=43'25, trim_to=0'0, roll_forward_to=42'21))", 2024-09-17T18:15:45.194 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.790430+0000", 2024-09-17T18:15:45.194 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.3399828229999997, 2024-09-17T18:15:45.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011985595999999999, 2024-09-17T18:15:45.194 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.194 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.194 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.194 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790430+0000", 2024-09-17T18:15:45.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790430+0000", 2024-09-17T18:15:45.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790431+0000", 2024-09-17T18:15:45.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0999999999999997e-07 2024-09-17T18:15:45.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790473+0000", 2024-09-17T18:15:45.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2178999999999997e-05 2024-09-17T18:15:45.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790494+0000", 2024-09-17T18:15:45.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1526e-05 2024-09-17T18:15:45.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790514+0000", 2024-09-17T18:15:45.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9222999999999999e-05 2024-09-17T18:15:45.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794972+0000", 2024-09-17T18:15:45.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044584150000000003 2024-09-17T18:15:45.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794996+0000", 2024-09-17T18:15:45.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4192000000000001e-05 2024-09-17T18:15:45.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.802330+0000", 2024-09-17T18:15:45.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073335029999999999 2024-09-17T18:15:45.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.802415+0000", 2024-09-17T18:15:45.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5648000000000004e-05 2024-09-17T18:15:45.198 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.198 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.198 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.199 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s6 43/31 ECSubWrite(tid=47, reqid=osd.7.0:47, at_version=43'34, trim_to=0'0, roll_forward_to=42'32))", 2024-09-17T18:15:45.199 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.791154+0000", 2024-09-17T18:15:45.199 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.3392582910000002, 2024-09-17T18:15:45.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073769049999999996, 2024-09-17T18:15:45.199 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.199 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.199 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.199 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791154+0000", 2024-09-17T18:15:45.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791154+0000", 2024-09-17T18:15:45.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791155+0000", 2024-09-17T18:15:45.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6300000000000005e-07 2024-09-17T18:15:45.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791210+0000", 2024-09-17T18:15:45.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5208999999999999e-05 2024-09-17T18:15:45.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791241+0000", 2024-09-17T18:15:45.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0803000000000003e-05 2024-09-17T18:15:45.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791268+0000", 2024-09-17T18:15:45.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7475e-05 2024-09-17T18:15:45.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791473+0000", 2024-09-17T18:15:45.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204539 2024-09-17T18:15:45.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791496+0000", 2024-09-17T18:15:45.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2991999999999999e-05 2024-09-17T18:15:45.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.798450+0000", 2024-09-17T18:15:45.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006953819 2024-09-17T18:15:45.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.798531+0000", 2024-09-17T18:15:45.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1404999999999997e-05 2024-09-17T18:15:45.203 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.203 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.203 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.204 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s6 43/31 ECSubWrite(tid=48, reqid=osd.7.0:48, at_version=43'36, trim_to=0'0, roll_forward_to=42'32))", 2024-09-17T18:15:45.204 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.791326+0000", 2024-09-17T18:15:45.204 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.3390867049999997, 2024-09-17T18:15:45.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099638959999999999, 2024-09-17T18:15:45.204 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.204 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.204 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.204 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791326+0000", 2024-09-17T18:15:45.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791326+0000", 2024-09-17T18:15:45.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791327+0000", 2024-09-17T18:15:45.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0899999999999999e-06 2024-09-17T18:15:45.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791369+0000", 2024-09-17T18:15:45.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2462000000000001e-05 2024-09-17T18:15:45.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791394+0000", 2024-09-17T18:15:45.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4246000000000001e-05 2024-09-17T18:15:45.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791412+0000", 2024-09-17T18:15:45.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8556e-05 2024-09-17T18:15:45.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.795134+0000", 2024-09-17T18:15:45.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037219000000000002 2024-09-17T18:15:45.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.795157+0000", 2024-09-17T18:15:45.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3156e-05 2024-09-17T18:15:45.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.801210+0000", 2024-09-17T18:15:45.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060524250000000002 2024-09-17T18:15:45.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.801290+0000", 2024-09-17T18:15:45.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0061000000000005e-05 2024-09-17T18:15:45.208 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.208 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.209 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.209 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.as4 43/31 ECSubWrite(tid=190, reqid=osd.13.0:190, at_version=43'43, trim_to=0'0, roll_forward_to=42'39))", 2024-09-17T18:15:45.209 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.807710+0000", 2024-09-17T18:15:45.209 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.3227024800000002, 2024-09-17T18:15:45.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0064163989999999997, 2024-09-17T18:15:45.209 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.209 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.209 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.209 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.807710+0000", 2024-09-17T18:15:45.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.807710+0000", 2024-09-17T18:15:45.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.807712+0000", 2024-09-17T18:15:45.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0470000000000001e-06 2024-09-17T18:15:45.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.807767+0000", 2024-09-17T18:15:45.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5031999999999998e-05 2024-09-17T18:15:45.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.807801+0000", 2024-09-17T18:15:45.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3974999999999999e-05 2024-09-17T18:15:45.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.807826+0000", 2024-09-17T18:15:45.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5287e-05 2024-09-17T18:15:45.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.808066+0000", 2024-09-17T18:15:45.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023987699999999999 2024-09-17T18:15:45.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.808090+0000", 2024-09-17T18:15:45.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3592999999999999e-05 2024-09-17T18:15:45.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.814042+0000", 2024-09-17T18:15:45.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059524770000000003 2024-09-17T18:15:45.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.814127+0000", 2024-09-17T18:15:45.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4110999999999995e-05 2024-09-17T18:15:45.213 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.213 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.214 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.214 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.2s1 43/31 ECSubWrite(tid=24, reqid=osd.14.0:23, at_version=0'0, trim_to=0'0, roll_forward_to=43'20))", 2024-09-17T18:15:45.214 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.810265+0000", 2024-09-17T18:15:45.214 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.3201477009999998, 2024-09-17T18:15:45.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050203310000000003, 2024-09-17T18:15:45.214 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.214 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.214 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.214 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810265+0000", 2024-09-17T18:15:45.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810265+0000", 2024-09-17T18:15:45.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810267+0000", 2024-09-17T18:15:45.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0200000000000001e-06 2024-09-17T18:15:45.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810295+0000", 2024-09-17T18:15:45.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7676000000000001e-05 2024-09-17T18:15:45.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810326+0000", 2024-09-17T18:15:45.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1853000000000001e-05 2024-09-17T18:15:45.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810373+0000", 2024-09-17T18:15:45.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7015000000000003e-05 2024-09-17T18:15:45.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810521+0000", 2024-09-17T18:15:45.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014745700000000001 2024-09-17T18:15:45.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810549+0000", 2024-09-17T18:15:45.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8141999999999999e-05 2024-09-17T18:15:45.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.815178+0000", 2024-09-17T18:15:45.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046285409999999999 2024-09-17T18:15:45.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.815285+0000", 2024-09-17T18:15:45.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000107627 2024-09-17T18:15:45.218 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.218 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.218 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.218 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s6 43/31 ECSubWrite(tid=51, reqid=osd.7.0:51, at_version=43'40, trim_to=0'0, roll_forward_to=43'36))", 2024-09-17T18:15:45.218 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.817711+0000", 2024-09-17T18:15:45.219 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.3127011480000004, 2024-09-17T18:15:45.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065603199999999997, 2024-09-17T18:15:45.219 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.219 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.219 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.219 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.817711+0000", 2024-09-17T18:15:45.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.817711+0000", 2024-09-17T18:15:45.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.817713+0000", 2024-09-17T18:15:45.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T18:15:45.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.817766+0000", 2024-09-17T18:15:45.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3035000000000003e-05 2024-09-17T18:15:45.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.817828+0000", 2024-09-17T18:15:45.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1174999999999996e-05 2024-09-17T18:15:45.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.817851+0000", 2024-09-17T18:15:45.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3023e-05 2024-09-17T18:15:45.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.818009+0000", 2024-09-17T18:15:45.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015859899999999999 2024-09-17T18:15:45.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.818033+0000", 2024-09-17T18:15:45.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3972999999999999e-05 2024-09-17T18:15:45.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.824175+0000", 2024-09-17T18:15:45.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061414240000000004 2024-09-17T18:15:45.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.824272+0000", 2024-09-17T18:15:45.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7157000000000005e-05 2024-09-17T18:15:45.223 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.223 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.223 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.223 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.as4 43/31 ECSubWrite(tid=193, reqid=osd.13.0:193, at_version=43'45, trim_to=0'0, roll_forward_to=43'43))", 2024-09-17T18:15:45.223 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.818255+0000", 2024-09-17T18:15:45.224 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.3121573480000004, 2024-09-17T18:15:45.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060481149999999997, 2024-09-17T18:15:45.224 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.224 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.224 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.224 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.818255+0000", 2024-09-17T18:15:45.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.818255+0000", 2024-09-17T18:15:45.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.818257+0000", 2024-09-17T18:15:45.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.764e-06 2024-09-17T18:15:45.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.818366+0000", 2024-09-17T18:15:45.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108917 2024-09-17T18:15:45.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.818397+0000", 2024-09-17T18:15:45.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0589000000000001e-05 2024-09-17T18:15:45.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.818418+0000", 2024-09-17T18:15:45.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1226e-05 2024-09-17T18:15:45.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.818584+0000", 2024-09-17T18:15:45.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000166293 2024-09-17T18:15:45.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.818620+0000", 2024-09-17T18:15:45.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5905999999999998e-05 2024-09-17T18:15:45.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.824224+0000", 2024-09-17T18:15:45.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056040539999999998 2024-09-17T18:15:45.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.824303+0000", 2024-09-17T18:15:45.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9365999999999999e-05 2024-09-17T18:15:45.228 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.228 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.228 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.228 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.as4 43/31 ECSubWrite(tid=194, reqid=osd.13.0:194, at_version=43'47, trim_to=0'0, roll_forward_to=43'43))", 2024-09-17T18:15:45.228 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.820723+0000", 2024-09-17T18:15:45.228 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.3096896960000004, 2024-09-17T18:15:45.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005726727, 2024-09-17T18:15:45.228 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.228 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.228 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.229 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.820723+0000", 2024-09-17T18:15:45.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.820723+0000", 2024-09-17T18:15:45.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.820725+0000", 2024-09-17T18:15:45.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.95e-06 2024-09-17T18:15:45.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.820781+0000", 2024-09-17T18:15:45.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5785000000000002e-05 2024-09-17T18:15:45.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.820812+0000", 2024-09-17T18:15:45.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1418999999999999e-05 2024-09-17T18:15:45.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.820834+0000", 2024-09-17T18:15:45.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2382999999999999e-05 2024-09-17T18:15:45.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.820995+0000", 2024-09-17T18:15:45.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016018900000000001 2024-09-17T18:15:45.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.821018+0000", 2024-09-17T18:15:45.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3739000000000001e-05 2024-09-17T18:15:45.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.826382+0000", 2024-09-17T18:15:45.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053637399999999997 2024-09-17T18:15:45.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.826450+0000", 2024-09-17T18:15:45.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7521999999999995e-05 2024-09-17T18:15:45.232 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.232 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.232 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.233 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s6 48/31 ECSubWrite(tid=53, reqid=client.4565.0:398, at_version=48'42, trim_to=0'0, roll_forward_to=43'40))", 2024-09-17T18:15:45.233 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:43.836878+0000", 2024-09-17T18:15:45.233 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.293534475, 2024-09-17T18:15:45.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00584856, 2024-09-17T18:15:45.233 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.233 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.233 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.233 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.836878+0000", 2024-09-17T18:15:45.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.836878+0000", 2024-09-17T18:15:45.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.836879+0000", 2024-09-17T18:15:45.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2999999999999999e-07 2024-09-17T18:15:45.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.837699+0000", 2024-09-17T18:15:45.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082043000000000003 2024-09-17T18:15:45.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.837738+0000", 2024-09-17T18:15:45.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8739000000000003e-05 2024-09-17T18:15:45.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.837764+0000", 2024-09-17T18:15:45.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5882999999999999e-05 2024-09-17T18:15:45.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.837940+0000", 2024-09-17T18:15:45.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017576500000000001 2024-09-17T18:15:45.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.837967+0000", 2024-09-17T18:15:45.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7325999999999999e-05 2024-09-17T18:15:45.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.842641+0000", 2024-09-17T18:15:45.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046734360000000004 2024-09-17T18:15:45.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.842727+0000", 2024-09-17T18:15:45.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6150999999999996e-05 2024-09-17T18:15:45.237 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.237 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.237 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.237 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.237 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.237 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:45.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T18:15:45.240 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:45.235+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:45.340 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:45.339+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:45.366 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:45.366 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:15:45.366 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T18:15:45.366 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:45.380 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T18:15:45.402 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T18:15:45.447 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:45.446+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:45.503 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:15:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T18:15:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T18:15:45.504 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:45.517 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T18:15:45.541 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:45.538+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:45.556 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:15:45.557 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:15:45.578 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:15:45.578 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:15:45.598 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:15:45.599 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:15:45.620 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:15:45.620 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:15:45.639 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:15:45.639 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:15:45.640 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:45.640 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T18:15:45.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T18:15:45.640 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T18:15:45.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.641 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs4 37/31 ECSubWrite(tid=30, reqid=client.4565.0:241, at_version=37'15, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:15:45.641 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:32.704551+0000", 2024-09-17T18:15:45.641 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.932155536, 2024-09-17T18:15:45.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055863350000000004, 2024-09-17T18:15:45.641 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.641 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.641 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.641 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.704551+0000", 2024-09-17T18:15:45.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.704551+0000", 2024-09-17T18:15:45.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.704551+0000", 2024-09-17T18:15:45.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7e-07 2024-09-17T18:15:45.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.704584+0000", 2024-09-17T18:15:45.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2419000000000003e-05 2024-09-17T18:15:45.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.704629+0000", 2024-09-17T18:15:45.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5549e-05 2024-09-17T18:15:45.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.704646+0000", 2024-09-17T18:15:45.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6426000000000002e-05 2024-09-17T18:15:45.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.704853+0000", 2024-09-17T18:15:45.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710100000000001 2024-09-17T18:15:45.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.704879+0000", 2024-09-17T18:15:45.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6346000000000002e-05 2024-09-17T18:15:45.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.709988+0000", 2024-09-17T18:15:45.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051082580000000001 2024-09-17T18:15:45.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.710137+0000", 2024-09-17T18:15:45.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014986599999999999 2024-09-17T18:15:45.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.645 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.645 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs4 37/31 ECSubWrite(tid=31, reqid=client.4565.0:242, at_version=37'16, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:15:45.646 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:32.706102+0000", 2024-09-17T18:15:45.646 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.930605032000001, 2024-09-17T18:15:45.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065028059999999999, 2024-09-17T18:15:45.646 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.646 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.646 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.646 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.706102+0000", 2024-09-17T18:15:45.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.706102+0000", 2024-09-17T18:15:45.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.706104+0000", 2024-09-17T18:15:45.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0499999999999999e-06 2024-09-17T18:15:45.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.706152+0000", 2024-09-17T18:15:45.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8578999999999997e-05 2024-09-17T18:15:45.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.706184+0000", 2024-09-17T18:15:45.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1962000000000003e-05 2024-09-17T18:15:45.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.706208+0000", 2024-09-17T18:15:45.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3808999999999999e-05 2024-09-17T18:15:45.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.706376+0000", 2024-09-17T18:15:45.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016798299999999999 2024-09-17T18:15:45.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.706393+0000", 2024-09-17T18:15:45.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7232999999999999e-05 2024-09-17T18:15:45.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.712487+0000", 2024-09-17T18:15:45.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060936200000000001 2024-09-17T18:15:45.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:32.712604+0000", 2024-09-17T18:15:45.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011757 2024-09-17T18:15:45.652 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.652 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.652 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.652 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:363 3.9s0 3:9d124c8a:::smithi15432074-25:head [delete] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+full_force+supports_pool_eio e42)", 2024-09-17T18:15:45.652 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:37.764061+0000", 2024-09-17T18:15:45.652 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.8726454989999999, 2024-09-17T18:15:45.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025800416999999999, 2024-09-17T18:15:45.652 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.652 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.653 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:45.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:15:45.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:15:45.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:45.653 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 363 2024-09-17T18:15:45.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.653 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764061+0000", 2024-09-17T18:15:45.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764061+0000", 2024-09-17T18:15:45.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764063+0000", 2024-09-17T18:15:45.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0640000000000001e-06 2024-09-17T18:15:45.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764072+0000", 2024-09-17T18:15:45.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5799999999999992e-06 2024-09-17T18:15:45.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764093+0000", 2024-09-17T18:15:45.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1495e-05 2024-09-17T18:15:45.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764107+0000", 2024-09-17T18:15:45.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3923999999999999e-05 2024-09-17T18:15:45.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764184+0000", 2024-09-17T18:15:45.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7185e-05 2024-09-17T18:15:45.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-17T18:15:45.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764194+0000", 2024-09-17T18:15:45.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.798e-06 2024-09-17T18:15:45.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.765898+0000", 2024-09-17T18:15:45.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0017036530000000001 2024-09-17T18:15:45.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:45.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766028+0000", 2024-09-17T18:15:45.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012982299999999999 2024-09-17T18:15:45.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766720+0000", 2024-09-17T18:15:45.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069236299999999998 2024-09-17T18:15:45.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.775694+0000", 2024-09-17T18:15:45.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0089743789999999993 2024-09-17T18:15:45.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:45.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.789778+0000", 2024-09-17T18:15:45.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014084051 2024-09-17T18:15:45.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.789862+0000", 2024-09-17T18:15:45.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3102000000000005e-05 2024-09-17T18:15:45.659 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.659 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.659 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.659 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.0s1 42/31 ECSubWrite(tid=14, reqid=osd.3.0:14, at_version=42'11, trim_to=0'0, roll_forward_to=39'9))", 2024-09-17T18:15:45.659 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:37.764970+0000", 2024-09-17T18:15:45.659 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.8717369020000003, 2024-09-17T18:15:45.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0066730130000000002, 2024-09-17T18:15:45.659 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.659 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.659 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.660 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764970+0000", 2024-09-17T18:15:45.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764970+0000", 2024-09-17T18:15:45.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764970+0000", 2024-09-17T18:15:45.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.27e-07 2024-09-17T18:15:45.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.765000+0000", 2024-09-17T18:15:45.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9944e-05 2024-09-17T18:15:45.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.765015+0000", 2024-09-17T18:15:45.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4990999999999999e-05 2024-09-17T18:15:45.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.765026+0000", 2024-09-17T18:15:45.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0535e-05 2024-09-17T18:15:45.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.765520+0000", 2024-09-17T18:15:45.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049415600000000004 2024-09-17T18:15:45.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.765527+0000", 2024-09-17T18:15:45.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9460000000000001e-06 2024-09-17T18:15:45.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.771543+0000", 2024-09-17T18:15:45.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060162000000000002 2024-09-17T18:15:45.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.771643+0000", 2024-09-17T18:15:45.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9914000000000006e-05 2024-09-17T18:15:45.664 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.664 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.664 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.664 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(osd.5.22:2 3.9s0 3:9634a0c7:::smithi15432074-24:head [assert-version v19,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:45.664 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:37.770314+0000", 2024-09-17T18:15:45.664 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.866392769, 2024-09-17T18:15:45.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033325575000000003, 2024-09-17T18:15:45.664 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.664 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.666 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:15:45.666 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770314+0000", 2024-09-17T18:15:45.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770314+0000", 2024-09-17T18:15:45.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770317+0000", 2024-09-17T18:15:45.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.627e-06 2024-09-17T18:15:45.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770327+0000", 2024-09-17T18:15:45.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0789e-05 2024-09-17T18:15:45.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770356+0000", 2024-09-17T18:15:45.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8940000000000001e-05 2024-09-17T18:15:45.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770377+0000", 2024-09-17T18:15:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0361999999999999e-05 2024-09-17T18:15:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.775952+0000", 2024-09-17T18:15:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005575333 2024-09-17T18:15:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for rw locks", 2024-09-17T18:15:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.776188+0000", 2024-09-17T18:15:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000235982 2024-09-17T18:15:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.795949+0000", 2024-09-17T18:15:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019760771999999999 2024-09-17T18:15:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.796074+0000", 2024-09-17T18:15:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012547900000000001 2024-09-17T18:15:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.803639+0000", 2024-09-17T18:15:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007565291 2024-09-17T18:15:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s6 43/31 ECSubWrite(tid=136, reqid=osd.6.0:136, at_version=43'21, trim_to=0'0, roll_forward_to=42'17))", 2024-09-17T18:15:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.791580+0000", 2024-09-17T18:15:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.8451266510000002, 2024-09-17T18:15:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0067969900000000001, 2024-09-17T18:15:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791580+0000", 2024-09-17T18:15:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791580+0000", 2024-09-17T18:15:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791581+0000", 2024-09-17T18:15:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1170000000000001e-06 2024-09-17T18:15:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791777+0000", 2024-09-17T18:15:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196085 2024-09-17T18:15:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791803+0000", 2024-09-17T18:15:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5446e-05 2024-09-17T18:15:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791824+0000", 2024-09-17T18:15:45.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1022999999999998e-05 2024-09-17T18:15:45.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.792567+0000", 2024-09-17T18:15:45.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00074380099999999999 2024-09-17T18:15:45.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.792591+0000", 2024-09-17T18:15:45.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4012999999999999e-05 2024-09-17T18:15:45.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.798307+0000", 2024-09-17T18:15:45.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057151370000000003 2024-09-17T18:15:45.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.798377+0000", 2024-09-17T18:15:45.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0368000000000001e-05 2024-09-17T18:15:45.675 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.675 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.676 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.676 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.2s6 43/31 ECSubWrite(tid=22, reqid=osd.14.0:22, at_version=43'18, trim_to=0'0, roll_forward_to=42'16))", 2024-09-17T18:15:45.676 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.794176+0000", 2024-09-17T18:15:45.676 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.8425301659999995, 2024-09-17T18:15:45.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0078475999999999997, 2024-09-17T18:15:45.676 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.676 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.676 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.676 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794176+0000", 2024-09-17T18:15:45.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794176+0000", 2024-09-17T18:15:45.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794177+0000", 2024-09-17T18:15:45.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T18:15:45.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794230+0000", 2024-09-17T18:15:45.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3062999999999997e-05 2024-09-17T18:15:45.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794252+0000", 2024-09-17T18:15:45.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1209e-05 2024-09-17T18:15:45.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794277+0000", 2024-09-17T18:15:45.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4946000000000001e-05 2024-09-17T18:15:45.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794410+0000", 2024-09-17T18:15:45.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000133406 2024-09-17T18:15:45.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794433+0000", 2024-09-17T18:15:45.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3393000000000001e-05 2024-09-17T18:15:45.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.801947+0000", 2024-09-17T18:15:45.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075137019999999997 2024-09-17T18:15:45.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.802024+0000", 2024-09-17T18:15:45.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7040999999999996e-05 2024-09-17T18:15:45.680 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.680 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.681 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.681 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.2s6 43/31 ECSubWrite(tid=23, reqid=osd.14.0:23, at_version=43'20, trim_to=0'0, roll_forward_to=42'16))", 2024-09-17T18:15:45.681 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.794327+0000", 2024-09-17T18:15:45.681 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.8423799130000003, 2024-09-17T18:15:45.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098518500000000005, 2024-09-17T18:15:45.681 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.681 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.681 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.681 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794327+0000", 2024-09-17T18:15:45.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794327+0000", 2024-09-17T18:15:45.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794328+0000", 2024-09-17T18:15:45.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6300000000000004e-07 2024-09-17T18:15:45.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794365+0000", 2024-09-17T18:15:45.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7852999999999998e-05 2024-09-17T18:15:45.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794385+0000", 2024-09-17T18:15:45.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9973e-05 2024-09-17T18:15:45.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794402+0000", 2024-09-17T18:15:45.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6308999999999999e-05 2024-09-17T18:15:45.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797022+0000", 2024-09-17T18:15:45.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026202249999999999 2024-09-17T18:15:45.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797049+0000", 2024-09-17T18:15:45.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7016e-05 2024-09-17T18:15:45.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.804104+0000", 2024-09-17T18:15:45.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0070550430000000004 2024-09-17T18:15:45.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.804179+0000", 2024-09-17T18:15:45.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4667999999999997e-05 2024-09-17T18:15:45.686 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.686 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.686 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.686 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs4 43/31 ECSubWrite(tid=44, reqid=osd.5.0:44, at_version=43'23, trim_to=0'0, roll_forward_to=42'21))", 2024-09-17T18:15:45.686 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.796116+0000", 2024-09-17T18:15:45.687 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.8405909579999999, 2024-09-17T18:15:45.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061651190000000002, 2024-09-17T18:15:45.687 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.687 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.687 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.687 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796116+0000", 2024-09-17T18:15:45.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796116+0000", 2024-09-17T18:15:45.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796117+0000", 2024-09-17T18:15:45.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.034e-06 2024-09-17T18:15:45.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796163+0000", 2024-09-17T18:15:45.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5995000000000003e-05 2024-09-17T18:15:45.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796178+0000", 2024-09-17T18:15:45.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4929999999999999e-05 2024-09-17T18:15:45.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796191+0000", 2024-09-17T18:15:45.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3295999999999999e-05 2024-09-17T18:15:45.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796331+0000", 2024-09-17T18:15:45.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014051999999999999 2024-09-17T18:15:45.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796355+0000", 2024-09-17T18:15:45.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3376000000000001e-05 2024-09-17T18:15:45.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.802221+0000", 2024-09-17T18:15:45.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058662360000000004 2024-09-17T18:15:45.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.802281+0000", 2024-09-17T18:15:45.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9731999999999997e-05 2024-09-17T18:15:45.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.691 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.691 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs4 43/31 ECSubWrite(tid=45, reqid=osd.5.0:45, at_version=43'25, trim_to=0'0, roll_forward_to=42'21))", 2024-09-17T18:15:45.691 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.796227+0000", 2024-09-17T18:15:45.692 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.8404795439999999, 2024-09-17T18:15:45.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013806557000000001, 2024-09-17T18:15:45.692 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.692 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.692 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.692 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796227+0000", 2024-09-17T18:15:45.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796227+0000", 2024-09-17T18:15:45.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796228+0000", 2024-09-17T18:15:45.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8999999999999995e-07 2024-09-17T18:15:45.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796267+0000", 2024-09-17T18:15:45.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9406000000000002e-05 2024-09-17T18:15:45.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796287+0000", 2024-09-17T18:15:45.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9925999999999999e-05 2024-09-17T18:15:45.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796303+0000", 2024-09-17T18:15:45.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6099999999999998e-05 2024-09-17T18:15:45.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.798999+0000", 2024-09-17T18:15:45.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026956720000000001 2024-09-17T18:15:45.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.799023+0000", 2024-09-17T18:15:45.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3519e-05 2024-09-17T18:15:45.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809942+0000", 2024-09-17T18:15:45.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01091982 2024-09-17T18:15:45.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810034+0000", 2024-09-17T18:15:45.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1323999999999995e-05 2024-09-17T18:15:45.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.696 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.696 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s6 43/31 ECSubWrite(tid=137, reqid=osd.6.0:136, at_version=0'0, trim_to=0'0, roll_forward_to=43'21))", 2024-09-17T18:15:45.696 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.805319+0000", 2024-09-17T18:15:45.696 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.8313873320000003, 2024-09-17T18:15:45.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059419110000000002, 2024-09-17T18:15:45.696 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.696 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.696 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.697 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.805319+0000", 2024-09-17T18:15:45.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.805319+0000", 2024-09-17T18:15:45.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.805321+0000", 2024-09-17T18:15:45.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8330000000000001e-06 2024-09-17T18:15:45.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.805349+0000", 2024-09-17T18:15:45.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.798e-05 2024-09-17T18:15:45.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.805380+0000", 2024-09-17T18:15:45.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1031999999999997e-05 2024-09-17T18:15:45.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.805403+0000", 2024-09-17T18:15:45.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2823000000000002e-05 2024-09-17T18:15:45.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.805635+0000", 2024-09-17T18:15:45.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000231864 2024-09-17T18:15:45.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.805654+0000", 2024-09-17T18:15:45.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9466e-05 2024-09-17T18:15:45.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.811184+0000", 2024-09-17T18:15:45.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055293749999999996 2024-09-17T18:15:45.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.811261+0000", 2024-09-17T18:15:45.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7538000000000002e-05 2024-09-17T18:15:45.701 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.701 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.701 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.701 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs4 43/31 ECSubWrite(tid=48, reqid=osd.5.0:45, at_version=0'0, trim_to=0'0, roll_forward_to=43'25))", 2024-09-17T18:15:45.701 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.813220+0000", 2024-09-17T18:15:45.701 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.8234865100000004, 2024-09-17T18:15:45.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010904479, 2024-09-17T18:15:45.701 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.701 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.701 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.702 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.813220+0000", 2024-09-17T18:15:45.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.813220+0000", 2024-09-17T18:15:45.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.813222+0000", 2024-09-17T18:15:45.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.903e-06 2024-09-17T18:15:45.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.813276+0000", 2024-09-17T18:15:45.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3752000000000003e-05 2024-09-17T18:15:45.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.813307+0000", 2024-09-17T18:15:45.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1389000000000001e-05 2024-09-17T18:15:45.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.813330+0000", 2024-09-17T18:15:45.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2580000000000001e-05 2024-09-17T18:15:45.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.813500+0000", 2024-09-17T18:15:45.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000170729 2024-09-17T18:15:45.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.813526+0000", 2024-09-17T18:15:45.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5168999999999999e-05 2024-09-17T18:15:45.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.824053+0000", 2024-09-17T18:15:45.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01052753 2024-09-17T18:15:45.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.824125+0000", 2024-09-17T18:15:45.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1427000000000006e-05 2024-09-17T18:15:45.705 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.705 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.705 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.706 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:398 3.9s0 3:91028b13:::smithi15432074-34:head [append 0~606208] snapc d=[d,c,b,a,9,8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T18:15:45.706 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:43.828873+0000", 2024-09-17T18:15:45.706 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.807833536, 2024-09-17T18:15:45.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022798233000000001, 2024-09-17T18:15:45.706 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.706 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.706 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:45.706 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:15:45.706 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:15:45.706 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:45.706 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 398 2024-09-17T18:15:45.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.706 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.828873+0000", 2024-09-17T18:15:45.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.828873+0000", 2024-09-17T18:15:45.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.828877+0000", 2024-09-17T18:15:45.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6569999999999999e-06 2024-09-17T18:15:45.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.829552+0000", 2024-09-17T18:15:45.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00067549600000000004 2024-09-17T18:15:45.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.829586+0000", 2024-09-17T18:15:45.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3923e-05 2024-09-17T18:15:45.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.829604+0000", 2024-09-17T18:15:45.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7425999999999999e-05 2024-09-17T18:15:45.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.829883+0000", 2024-09-17T18:15:45.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027969300000000002 2024-09-17T18:15:45.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-17T18:15:45.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.829965+0000", 2024-09-17T18:15:45.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1755000000000006e-05 2024-09-17T18:15:45.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.833780+0000", 2024-09-17T18:15:45.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038152870000000001 2024-09-17T18:15:45.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:45.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.834070+0000", 2024-09-17T18:15:45.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028968 2024-09-17T18:15:45.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.837763+0000", 2024-09-17T18:15:45.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036926369999999999 2024-09-17T18:15:45.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843381+0000", 2024-09-17T18:15:45.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056183989999999996 2024-09-17T18:15:45.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:45.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.851445+0000", 2024-09-17T18:15:45.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0080642149999999996 2024-09-17T18:15:45.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.851671+0000", 2024-09-17T18:15:45.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022606500000000001 2024-09-17T18:15:45.713 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.713 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.713 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.713 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:399 3.9s0 3:91028b13:::smithi15432074-34:head [append 0~720896] snapc d=[d,c,b,a,9,8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T18:15:45.713 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:43.842209+0000", 2024-09-17T18:15:45.713 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.794497644, 2024-09-17T18:15:45.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010772865, 2024-09-17T18:15:45.713 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.713 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.713 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:45.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:15:45.714 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:15:45.714 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:45.714 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 399 2024-09-17T18:15:45.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.714 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.842209+0000", 2024-09-17T18:15:45.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.842209+0000", 2024-09-17T18:15:45.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.842213+0000", 2024-09-17T18:15:45.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8430000000000003e-06 2024-09-17T18:15:45.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843318+0000", 2024-09-17T18:15:45.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001104713 2024-09-17T18:15:45.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843357+0000", 2024-09-17T18:15:45.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9765999999999998e-05 2024-09-17T18:15:45.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843380+0000", 2024-09-17T18:15:45.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2772000000000002e-05 2024-09-17T18:15:45.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843499+0000", 2024-09-17T18:15:45.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118607 2024-09-17T18:15:45.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:45.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843789+0000", 2024-09-17T18:15:45.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029068699999999998 2024-09-17T18:15:45.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.846172+0000", 2024-09-17T18:15:45.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023825040000000001 2024-09-17T18:15:45.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.852735+0000", 2024-09-17T18:15:45.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065630569999999997 2024-09-17T18:15:45.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:45.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.852849+0000", 2024-09-17T18:15:45.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011411700000000001 2024-09-17T18:15:45.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.852982+0000", 2024-09-17T18:15:45.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013279899999999999 2024-09-17T18:15:45.718 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.718 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.718 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.719 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:400 3.9s0 3:91028b13:::smithi15432074-34:head [append 0~49152] snapc d=[d,c,b,a,9,8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T18:15:45.719 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:43.843432+0000", 2024-09-17T18:15:45.719 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.7932748140000001, 2024-09-17T18:15:45.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012614670999999999, 2024-09-17T18:15:45.719 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.719 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.719 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:45.719 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:15:45.719 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:15:45.719 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:45.719 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 400 2024-09-17T18:15:45.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.720 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843432+0000", 2024-09-17T18:15:45.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843432+0000", 2024-09-17T18:15:45.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843434+0000", 2024-09-17T18:15:45.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9099999999999999e-06 2024-09-17T18:15:45.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843568+0000", 2024-09-17T18:15:45.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134029 2024-09-17T18:15:45.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843621+0000", 2024-09-17T18:15:45.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2778999999999997e-05 2024-09-17T18:15:45.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843655+0000", 2024-09-17T18:15:45.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3955999999999998e-05 2024-09-17T18:15:45.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.848104+0000", 2024-09-17T18:15:45.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044499759999999996 2024-09-17T18:15:45.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:45.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.848364+0000", 2024-09-17T18:15:45.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025996 2024-09-17T18:15:45.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.849855+0000", 2024-09-17T18:15:45.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001490739 2024-09-17T18:15:45.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.852990+0000", 2024-09-17T18:15:45.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003135063 2024-09-17T18:15:45.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:45.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.855861+0000", 2024-09-17T18:15:45.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028712270000000001 2024-09-17T18:15:45.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.856047+0000", 2024-09-17T18:15:45.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018503200000000001 2024-09-17T18:15:45.724 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.724 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.724 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.725 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:401 3.9s0 3:91028b13:::smithi15432074-34:head [setxattr _header (57) in=7b] snapc d=[d,c,b,a,9,8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T18:15:45.725 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:43.843710+0000", 2024-09-17T18:15:45.725 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.7929962740000001, 2024-09-17T18:15:45.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013786298000000001, 2024-09-17T18:15:45.725 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.725 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.725 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:45.725 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:15:45.725 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:15:45.725 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:45.725 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 401 2024-09-17T18:15:45.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.725 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843710+0000", 2024-09-17T18:15:45.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843710+0000", 2024-09-17T18:15:45.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843712+0000", 2024-09-17T18:15:45.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7859999999999999e-06 2024-09-17T18:15:45.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843739+0000", 2024-09-17T18:15:45.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7143000000000001e-05 2024-09-17T18:15:45.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843760+0000", 2024-09-17T18:15:45.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0723000000000001e-05 2024-09-17T18:15:45.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843775+0000", 2024-09-17T18:15:45.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5285999999999999e-05 2024-09-17T18:15:45.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.853335+0000", 2024-09-17T18:15:45.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095601139999999998 2024-09-17T18:15:45.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:45.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.853576+0000", 2024-09-17T18:15:45.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024087699999999999 2024-09-17T18:15:45.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:45.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.854383+0000", 2024-09-17T18:15:45.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080660599999999997 2024-09-17T18:15:45.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:45.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.856504+0000", 2024-09-17T18:15:45.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021208889999999999 2024-09-17T18:15:45.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:45.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.857277+0000", 2024-09-17T18:15:45.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077300899999999996 2024-09-17T18:15:45.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.857497+0000", 2024-09-17T18:15:45.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000219865 2024-09-17T18:15:45.730 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.730 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.730 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.730 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:402 3.9s0 3:91028b13:::smithi15432074-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48)", 2024-09-17T18:15:45.730 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:43.843801+0000", 2024-09-17T18:15:45.730 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.792905333, 2024-09-17T18:15:45.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016980807000000001, 2024-09-17T18:15:45.731 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.731 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.731 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:15:45.731 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:15:45.731 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:15:45.731 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:45.731 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 402 2024-09-17T18:15:45.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.731 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843801+0000", 2024-09-17T18:15:45.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843801+0000", 2024-09-17T18:15:45.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843803+0000", 2024-09-17T18:15:45.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5689999999999999e-06 2024-09-17T18:15:45.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843810+0000", 2024-09-17T18:15:45.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5329999999999997e-06 2024-09-17T18:15:45.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843834+0000", 2024-09-17T18:15:45.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3354e-05 2024-09-17T18:15:45.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843854+0000", 2024-09-17T18:15:45.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0438999999999999e-05 2024-09-17T18:15:45.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.855070+0000", 2024-09-17T18:15:45.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011216248999999999 2024-09-17T18:15:45.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for rw locks", 2024-09-17T18:15:45.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.855397+0000", 2024-09-17T18:15:45.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032609499999999999 2024-09-17T18:15:45.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.858525+0000", 2024-09-17T18:15:45.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031287849999999998 2024-09-17T18:15:45.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:45.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.858731+0000", 2024-09-17T18:15:45.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020568600000000001 2024-09-17T18:15:45.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.860782+0000", 2024-09-17T18:15:45.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002051097 2024-09-17T18:15:45.735 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.735 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.735 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.736 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWriteReply(3.9s0 48/31 ECSubWriteReply(tid=53, last_complete=48'42, committed=1, applied=1))", 2024-09-17T18:15:45.736 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:43.843923+0000", 2024-09-17T18:15:45.736 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.7927831699999999, 2024-09-17T18:15:45.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0071289880000000002, 2024-09-17T18:15:45.736 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.736 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.736 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.736 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843923+0000", 2024-09-17T18:15:45.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843923+0000", 2024-09-17T18:15:45.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843925+0000", 2024-09-17T18:15:45.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.11e-06 2024-09-17T18:15:45.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843933+0000", 2024-09-17T18:15:45.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8559999999999996e-06 2024-09-17T18:15:45.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843956+0000", 2024-09-17T18:15:45.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.287e-05 2024-09-17T18:15:45.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843972+0000", 2024-09-17T18:15:45.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5608999999999999e-05 2024-09-17T18:15:45.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.851004+0000", 2024-09-17T18:15:45.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0070321180000000004 2024-09-17T18:15:45.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.851052+0000", 2024-09-17T18:15:45.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8424999999999998e-05 2024-09-17T18:15:45.739 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.740 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.740 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.740 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWriteReply(3.9s0 48/31 ECSubWriteReply(tid=53, last_complete=48'42, committed=1, applied=1))", 2024-09-17T18:15:45.740 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:43.844040+0000", 2024-09-17T18:15:45.740 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.792666823, 2024-09-17T18:15:45.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0071224519999999996, 2024-09-17T18:15:45.740 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.740 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.740 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.740 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.844040+0000", 2024-09-17T18:15:45.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.844040+0000", 2024-09-17T18:15:45.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.844041+0000", 2024-09-17T18:15:45.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.19e-06 2024-09-17T18:15:45.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.844048+0000", 2024-09-17T18:15:45.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3270000000000003e-06 2024-09-17T18:15:45.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.844070+0000", 2024-09-17T18:15:45.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1849e-05 2024-09-17T18:15:45.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.844084+0000", 2024-09-17T18:15:45.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4156e-05 2024-09-17T18:15:45.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.851122+0000", 2024-09-17T18:15:45.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0070377579999999999 2024-09-17T18:15:45.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.851162+0000", 2024-09-17T18:15:45.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0172000000000001e-05 2024-09-17T18:15:45.743 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.743 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.743 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.744 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWriteReply(3.9s0 48/31 ECSubWriteReply(tid=53, last_complete=48'42, committed=1, applied=1))", 2024-09-17T18:15:45.744 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:43.845798+0000", 2024-09-17T18:15:45.744 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.7909084630000001, 2024-09-17T18:15:45.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059168620000000002, 2024-09-17T18:15:45.744 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:45.744 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:45.744 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:45.744 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:45.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:45.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.845798+0000", 2024-09-17T18:15:45.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:45.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.845798+0000", 2024-09-17T18:15:45.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:45.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:45.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.845800+0000", 2024-09-17T18:15:45.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8870000000000001e-06 2024-09-17T18:15:45.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:45.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.845810+0000", 2024-09-17T18:15:45.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7890000000000006e-06 2024-09-17T18:15:45.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:45.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.845833+0000", 2024-09-17T18:15:45.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2853e-05 2024-09-17T18:15:45.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:45.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.845853+0000", 2024-09-17T18:15:45.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0373e-05 2024-09-17T18:15:45.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:45.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.851228+0000", 2024-09-17T18:15:45.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053745420000000004 2024-09-17T18:15:45.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:45.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:45.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:45.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.851715+0000", 2024-09-17T18:15:45.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048741799999999999 2024-09-17T18:15:45.748 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.748 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.748 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.748 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:45.748 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:45.748 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:45.749 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:15:45.750 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:15:45.750 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:15:45.750 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:15:45.751 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T18:15:45.751 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:15:45.751 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:15:45.752 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:15:45.752 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:15:45.752 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:45.746+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:45.752 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:15:45.753 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:15:45.775 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:15:45.775 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:15:45.795 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:15:45.795 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:15:45.824 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.15 to 1 (10000) 2024-09-17T18:15:45.824 INFO:teuthology.orchestra.run.smithi087.stderr:nodeep-scrub is unset 2024-09-17T18:15:45.829 INFO:tasks.rados.rados.0.smithi154.stdout:160: done (1 left) 2024-09-17T18:15:45.829 INFO:tasks.rados.rados.0.smithi154.stdout:161: done (0 left) 2024-09-17T18:15:45.830 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 39 current snap is 14 2024-09-17T18:15:45.830 INFO:tasks.rados.rados.0.smithi154.stdout:162: seq_num 83 ranges {2572288=638976,3211264=622592,3833856=147456} 2024-09-17T18:15:45.850 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-17T18:15:45.850 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:15:45.851 INFO:tasks.rados.rados.0.smithi154.stdout:162: writing smithi15432074-39 from 2572288 to 3211264 tid 1 2024-09-17T18:15:45.851 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:45.849+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:45.853 INFO:tasks.rados.rados.0.smithi154.stdout:162: writing smithi15432074-39 from 3211264 to 3833856 tid 2 2024-09-17T18:15:45.855 INFO:tasks.rados.rados.0.smithi154.stdout:162: writing smithi15432074-39 from 3833856 to 3981312 tid 3 2024-09-17T18:15:45.855 INFO:tasks.rados.rados.0.smithi154.stdout:163: read oid 11 snap 12 2024-09-17T18:15:45.855 INFO:tasks.rados.rados.0.smithi154.stdout:163: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-17T18:15:45.855 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 40 current snap is 14 2024-09-17T18:15:45.855 INFO:tasks.rados.rados.0.smithi154.stdout:164: seq_num 84 ranges {671744=655360,1327104=638976,1966080=131072} 2024-09-17T18:15:45.864 INFO:tasks.rados.rados.0.smithi154.stdout:164: writing smithi15432074-40 from 671744 to 1327104 tid 1 2024-09-17T18:15:45.868 INFO:tasks.rados.rados.0.smithi154.stdout:164: writing smithi15432074-40 from 1327104 to 1966080 tid 2 2024-09-17T18:15:45.868 INFO:tasks.rados.rados.0.smithi154.stdout:164: writing smithi15432074-40 from 1966080 to 2097152 tid 3 2024-09-17T18:15:45.869 INFO:tasks.rados.rados.0.smithi154.stdout:165: rollback oid 3 current snap is 14 2024-09-17T18:15:45.869 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 3 to 4 2024-09-17T18:15:45.869 INFO:tasks.rados.rados.0.smithi154.stdout:166: snap_remove snap 13 2024-09-17T18:15:45.903 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:45.903 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:45.918 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T18:15:45.952 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:45.950+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:46.021 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:15:46.021 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:15:46.044 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:15:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:15:46.053 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:46.051+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:46.064 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:15:46.064 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:15:46.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:15:46.062+0000 7f0151b86640 0 -- 172.21.15.87:0/3838613027 >> [v2:172.21.15.154:6824/3670919160,v1:172.21.15.154:6825/3670919160] conn(0x7f014c225050 msgr2=0x7f014c227440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T18:15:46.081 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:46.081 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:46.086 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:15:46.086 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:15:46.096 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T18:15:46.154 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:46.151+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:46.197 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:15:46.198 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:15:46.215 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:46.215 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:46.216 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-09-17T18:15:45.825192+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":50102835,"num_objects":84,"num_object_clones":33,"num_object_copies":568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":2,"num_read":282,"num_read_kb":29255,"num_write":456,"num_write_kb":53570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":530,"ondisk_log_size":530,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":552288,"kb_used_data":94820,"kb_used_omap":24,"kb_used_meta":457063,"kb_avail":1509397152,"statfs":{"total":1546188226560,"available":1545622683648,"internally_reserved":0,"allocated":97095680,"data_stored":127219314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":468032593},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2392064,"num_objects":-11,"num_object_clones":-10,"num_object_copies":-77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11,"num_whiteouts":-1,"num_read":20,"num_read_kb":12936,"num_write":32,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039357"},"pg_stats":[{"pgid":"3.f","version":"43'14","reported_seq":82,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.826171+0000","last_change":"2024-09-17T18:15:38.800430+0000","last_active":"2024-09-17T18:15:41.826171+0000","last_peered":"2024-09-17T18:15:41.826171+0000","last_clean":"2024-09-17T18:15:41.826171+0000","last_became_active":"2024-09-17T18:15:28.090920+0000","last_became_peered":"2024-09-17T18:15:28.090920+0000","last_unstale":"2024-09-17T18:15:41.826171+0000","last_undegraded":"2024-09-17T18:15:41.826171+0000","last_fullsized":"2024-09-17T18:15:41.826171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:28.156240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026496161000000001,"stat_sum":{"num_bytes":1376256,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3799,"num_write":8,"num_write_kb":1424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3,15,14,2,11,0],"acting":[13,3,15,14,2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.e","version":"39'6","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.788901+0000","last_change":"2024-09-17T18:15:38.775016+0000","last_active":"2024-09-17T18:15:41.788901+0000","last_peered":"2024-09-17T18:15:41.788901+0000","last_clean":"2024-09-17T18:15:41.788901+0000","last_became_active":"2024-09-17T18:15:28.110648+0000","last_became_peered":"2024-09-17T18:15:28.110648+0000","last_unstale":"2024-09-17T18:15:41.788901+0000","last_undegraded":"2024-09-17T18:15:41.788901+0000","last_fullsized":"2024-09-17T18:15:41.788901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:50.527552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024869950000000001,"stat_sum":{"num_bytes":229376,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":417,"num_write":5,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14,6,13,8,3,12],"acting":[11,14,6,13,8,3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.d","version":"43'95","reported_seq":166,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.825626+0000","last_change":"2024-09-17T18:15:38.844939+0000","last_active":"2024-09-17T18:15:41.825626+0000","last_peered":"2024-09-17T18:15:41.825626+0000","last_clean":"2024-09-17T18:15:41.825626+0000","last_became_active":"2024-09-17T18:15:28.273848+0000","last_became_peered":"2024-09-17T18:15:28.273848+0000","last_unstale":"2024-09-17T18:15:41.825626+0000","last_undegraded":"2024-09-17T18:15:41.825626+0000","last_fullsized":"2024-09-17T18:15:41.825626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:48.188279+0000","scrub_duration":0,"objects_trimmed":5,"snaptrim_duration":0.071385053000000004,"stat_sum":{"num_bytes":10518528,"num_objects":17,"num_object_clones":8,"num_object_copies":119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":33,"num_read_kb":2217,"num_write":69,"num_write_kb":10752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,11,15,9,8,4],"acting":[13,1,11,15,9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.c","version":"46'29","reported_seq":95,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.830272+0000","last_change":"2024-09-17T18:15:38.814043+0000","last_active":"2024-09-17T18:15:41.830272+0000","last_peered":"2024-09-17T18:15:41.830272+0000","last_clean":"2024-09-17T18:15:41.830272+0000","last_became_active":"2024-09-17T18:15:28.112093+0000","last_became_peered":"2024-09-17T18:15:28.112093+0000","last_unstale":"2024-09-17T18:15:41.830272+0000","last_undegraded":"2024-09-17T18:15:41.830272+0000","last_fullsized":"2024-09-17T18:15:41.830272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:27.404883+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.030741185000000001,"stat_sum":{"num_bytes":3751936,"num_objects":7,"num_object_clones":3,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":10,"num_read_kb":4,"num_write":16,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,3,7,12,14],"acting":[5,8,13,3,7,12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.b","version":"46'47","reported_seq":112,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:42.808042+0000","last_change":"2024-09-17T18:15:38.812080+0000","last_active":"2024-09-17T18:15:42.808042+0000","last_peered":"2024-09-17T18:15:42.808042+0000","last_clean":"2024-09-17T18:15:42.808042+0000","last_became_active":"2024-09-17T18:15:28.111526+0000","last_became_peered":"2024-09-17T18:15:28.111526+0000","last_unstale":"2024-09-17T18:15:42.808042+0000","last_undegraded":"2024-09-17T18:15:42.808042+0000","last_fullsized":"2024-09-17T18:15:42.808042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:43.213225+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.045131996000000001,"stat_sum":{"num_bytes":5865472,"num_objects":9,"num_object_clones":5,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":49,"num_write_kb":6480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,10,12,11,1,14],"acting":[4,0,10,12,11,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.a","version":"43'47","reported_seq":120,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.825427+0000","last_change":"2024-09-17T18:15:38.828686+0000","last_active":"2024-09-17T18:15:41.825427+0000","last_peered":"2024-09-17T18:15:41.825427+0000","last_clean":"2024-09-17T18:15:41.825427+0000","last_became_active":"2024-09-17T18:15:28.089449+0000","last_became_peered":"2024-09-17T18:15:28.089449+0000","last_unstale":"2024-09-17T18:15:41.825427+0000","last_undegraded":"2024-09-17T18:15:41.825427+0000","last_fullsized":"2024-09-17T18:15:41.825427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:28.467375+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.054627892999999997,"stat_sum":{"num_bytes":4931584,"num_objects":7,"num_object_clones":2,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":9146,"num_write":24,"num_write_kb":5152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,6,5,3,15,4],"acting":[13,1,6,5,3,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.9","version":"43'40","reported_seq":111,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:43.280381+0000","last_change":"2024-09-17T18:15:38.828952+0000","last_active":"2024-09-17T18:15:43.280381+0000","last_peered":"2024-09-17T18:15:43.280381+0000","last_clean":"2024-09-17T18:15:43.280381+0000","last_became_active":"2024-09-17T18:15:28.095114+0000","last_became_peered":"2024-09-17T18:15:28.095114+0000","last_unstale":"2024-09-17T18:15:43.280381+0000","last_undegraded":"2024-09-17T18:15:43.280381+0000","last_fullsized":"2024-09-17T18:15:43.280381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:38.271404+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.044707917999999999,"stat_sum":{"num_bytes":4718592,"num_objects":7,"num_object_clones":3,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":17,"num_read_kb":2979,"num_write":40,"num_write_kb":5152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,10,11,5,8,3],"acting":[7,2,10,11,5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.8","version":"43'21","reported_seq":85,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:43.279438+0000","last_change":"2024-09-17T18:15:38.802250+0000","last_active":"2024-09-17T18:15:43.279438+0000","last_peered":"2024-09-17T18:15:43.279438+0000","last_clean":"2024-09-17T18:15:43.279438+0000","last_became_active":"2024-09-17T18:15:28.088066+0000","last_became_peered":"2024-09-17T18:15:28.088066+0000","last_unstale":"2024-09-17T18:15:43.279438+0000","last_undegraded":"2024-09-17T18:15:43.279438+0000","last_fullsized":"2024-09-17T18:15:43.279438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:28.315991+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.029072400000000002,"stat_sum":{"num_bytes":2572288,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":7,"num_read_kb":4,"num_write":11,"num_write_kb":2512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,11,3,15,1,7],"acting":[6,0,11,3,15,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"1.0","version":"25'112","reported_seq":191,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:43.279641+0000","last_change":"2024-09-17T18:15:13.924291+0000","last_active":"2024-09-17T18:15:43.279641+0000","last_peered":"2024-09-17T18:15:43.279641+0000","last_clean":"2024-09-17T18:15:43.279641+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:15:43.279641+0000","last_undegraded":"2024-09-17T18:15:43.279641+0000","last_fullsized":"2024-09-17T18:15:43.279641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:15:12.533086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.379235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":60,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:42.811430+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:15:42.811430+0000","last_peered":"2024-09-17T18:15:42.811430+0000","last_clean":"2024-09-17T18:15:42.811430+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:15:42.811430+0000","last_undegraded":"2024-09-17T18:15:42.811430+0000","last_fullsized":"2024-09-17T18:15:42.811430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"43'20","reported_seq":86,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:42.811403+0000","last_change":"2024-09-17T18:15:38.811680+0000","last_active":"2024-09-17T18:15:42.811403+0000","last_peered":"2024-09-17T18:15:42.811403+0000","last_clean":"2024-09-17T18:15:42.811403+0000","last_became_active":"2024-09-17T18:15:28.089102+0000","last_became_peered":"2024-09-17T18:15:28.089102+0000","last_unstale":"2024-09-17T18:15:42.811403+0000","last_undegraded":"2024-09-17T18:15:42.811403+0000","last_fullsized":"2024-09-17T18:15:42.811403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:46.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030778476999999999,"stat_sum":{"num_bytes":1523712,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":9,"num_write_kb":1488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3,13,1,5,10,7],"acting":[14,3,13,1,5,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T18:15:39.996224+0000","last_change":"2024-09-17T18:15:16.990099+0000","last_active":"2024-09-17T18:15:39.996224+0000","last_peered":"2024-09-17T18:15:39.996224+0000","last_clean":"2024-09-17T18:15:39.996224+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:15:39.996224+0000","last_undegraded":"2024-09-17T18:15:39.996224+0000","last_fullsized":"2024-09-17T18:15:39.996224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.933228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:42.807756+0000","last_change":"2024-09-17T18:15:38.767363+0000","last_active":"2024-09-17T18:15:42.807756+0000","last_peered":"2024-09-17T18:15:42.807756+0000","last_clean":"2024-09-17T18:15:42.807756+0000","last_became_active":"2024-09-17T18:15:28.094455+0000","last_became_peered":"2024-09-17T18:15:28.094455+0000","last_unstale":"2024-09-17T18:15:42.807756+0000","last_undegraded":"2024-09-17T18:15:42.807756+0000","last_fullsized":"2024-09-17T18:15:42.807756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:40.987114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063363600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,14,10,7,3,2],"acting":[4,13,14,10,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:42.811197+0000","last_change":"2024-09-17T18:15:17.499886+0000","last_active":"2024-09-17T18:15:42.811197+0000","last_peered":"2024-09-17T18:15:42.811197+0000","last_clean":"2024-09-17T18:15:42.811197+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:15:42.811197+0000","last_undegraded":"2024-09-17T18:15:42.811197+0000","last_fullsized":"2024-09-17T18:15:42.811197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.366017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"43'13","reported_seq":81,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:43.279929+0000","last_change":"2024-09-17T18:15:38.799691+0000","last_active":"2024-09-17T18:15:43.279929+0000","last_peered":"2024-09-17T18:15:43.279929+0000","last_clean":"2024-09-17T18:15:43.279929+0000","last_became_active":"2024-09-17T18:15:28.273637+0000","last_became_peered":"2024-09-17T18:15:28.273637+0000","last_unstale":"2024-09-17T18:15:43.279929+0000","last_undegraded":"2024-09-17T18:15:43.279929+0000","last_fullsized":"2024-09-17T18:15:43.279929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:29.757786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018255255000000001,"stat_sum":{"num_bytes":2441216,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":8,"num_write_kb":2384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,9,2,6,15,4],"acting":[3,7,9,2,6,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"2.2","version":"27'2","reported_seq":59,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.825493+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:15:41.825493+0000","last_peered":"2024-09-17T18:15:41.825493+0000","last_clean":"2024-09-17T18:15:41.825493+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:15:41.825493+0000","last_undegraded":"2024-09-17T18:15:41.825493+0000","last_fullsized":"2024-09-17T18:15:41.825493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:19.851941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"43'10","reported_seq":80,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.818322+0000","last_change":"2024-09-17T18:15:38.801350+0000","last_active":"2024-09-17T18:15:41.818322+0000","last_peered":"2024-09-17T18:15:41.818322+0000","last_clean":"2024-09-17T18:15:41.818322+0000","last_became_active":"2024-09-17T18:15:28.272974+0000","last_became_peered":"2024-09-17T18:15:28.272974+0000","last_unstale":"2024-09-17T18:15:41.818322+0000","last_undegraded":"2024-09-17T18:15:41.818322+0000","last_fullsized":"2024-09-17T18:15:41.818322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:41.212977+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.026502164000000002,"stat_sum":{"num_bytes":1556480,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":419,"num_write":7,"num_write_kb":1520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4,13,11,2,5],"acting":[10,9,4,13,11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.5","version":"43'12","reported_seq":79,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.821186+0000","last_change":"2024-09-17T18:15:38.814044+0000","last_active":"2024-09-17T18:15:41.821186+0000","last_peered":"2024-09-17T18:15:41.821186+0000","last_clean":"2024-09-17T18:15:41.821186+0000","last_became_active":"2024-09-17T18:15:28.275306+0000","last_became_peered":"2024-09-17T18:15:28.275306+0000","last_unstale":"2024-09-17T18:15:41.821186+0000","last_undegraded":"2024-09-17T18:15:41.821186+0000","last_fullsized":"2024-09-17T18:15:41.821186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.859267+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.029820243,"stat_sum":{"num_bytes":376832,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":486,"num_write":24,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,11],"acting":[5,8,4,9,12,0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:42.807818+0000","last_change":"2024-09-17T18:15:16.605178+0000","last_active":"2024-09-17T18:15:42.807818+0000","last_peered":"2024-09-17T18:15:42.807818+0000","last_clean":"2024-09-17T18:15:42.807818+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:15:42.807818+0000","last_undegraded":"2024-09-17T18:15:42.807818+0000","last_fullsized":"2024-09-17T18:15:42.807818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":63,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.829381+0000","last_change":"2024-09-17T18:15:38.781879+0000","last_active":"2024-09-17T18:15:41.829381+0000","last_peered":"2024-09-17T18:15:41.829381+0000","last_clean":"2024-09-17T18:15:41.829381+0000","last_became_active":"2024-09-17T18:15:28.090551+0000","last_became_peered":"2024-09-17T18:15:28.090551+0000","last_unstale":"2024-09-17T18:15:41.829381+0000","last_undegraded":"2024-09-17T18:15:41.829381+0000","last_fullsized":"2024-09-17T18:15:41.829381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.939127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068215300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15,4,2,6,10,7],"acting":[8,15,4,2,6,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:43.280604+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:15:43.280604+0000","last_peered":"2024-09-17T18:15:43.280604+0000","last_clean":"2024-09-17T18:15:43.280604+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:15:43.280604+0000","last_undegraded":"2024-09-17T18:15:43.280604+0000","last_fullsized":"2024-09-17T18:15:43.280604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:14.501281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"43'40","reported_seq":124,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:42.808093+0000","last_change":"2024-09-17T18:15:38.803383+0000","last_active":"2024-09-17T18:15:42.808093+0000","last_peered":"2024-09-17T18:15:42.808093+0000","last_clean":"2024-09-17T18:15:42.808093+0000","last_became_active":"2024-09-17T18:15:27.692814+0000","last_became_peered":"2024-09-17T18:15:27.692814+0000","last_unstale":"2024-09-17T18:15:42.808093+0000","last_undegraded":"2024-09-17T18:15:42.808093+0000","last_fullsized":"2024-09-17T18:15:42.808093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.794174+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.036273090000000001,"stat_sum":{"num_bytes":6340608,"num_objects":9,"num_object_clones":4,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":8169,"num_write":25,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,0,14,10,13],"acting":[4,11,6,0,14,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.829435+0000","last_change":"2024-09-17T18:15:17.502621+0000","last_active":"2024-09-17T18:15:41.829435+0000","last_peered":"2024-09-17T18:15:41.829435+0000","last_clean":"2024-09-17T18:15:41.829435+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:15:41.829435+0000","last_undegraded":"2024-09-17T18:15:41.829435+0000","last_fullsized":"2024-09-17T18:15:41.829435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.990534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"43'21","reported_seq":83,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T18:15:40.460614+0000","last_change":"2024-09-17T18:15:38.790907+0000","last_active":"2024-09-17T18:15:40.460614+0000","last_peered":"2024-09-17T18:15:40.460614+0000","last_clean":"2024-09-17T18:15:40.460614+0000","last_became_active":"2024-09-17T18:15:28.272963+0000","last_became_peered":"2024-09-17T18:15:28.272963+0000","last_unstale":"2024-09-17T18:15:40.460614+0000","last_undegraded":"2024-09-17T18:15:40.460614+0000","last_fullsized":"2024-09-17T18:15:40.460614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:55.978344+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.019482095000000001,"stat_sum":{"num_bytes":3309568,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":1528,"num_write":14,"num_write_kb":3232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14,6,2,5,9,15],"acting":[0,14,6,2,5,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.826078+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:15:41.826078+0000","last_peered":"2024-09-17T18:15:41.826078+0000","last_clean":"2024-09-17T18:15:41.826078+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:15:41.826078+0000","last_undegraded":"2024-09-17T18:15:41.826078+0000","last_fullsized":"2024-09-17T18:15:41.826078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:17.193575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":49512448,"num_objects":80,"num_object_clones":33,"num_object_copies":560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":2,"num_read":196,"num_read_kb":29182,"num_write":309,"num_write_kb":50896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87330816,"data_stored":122675200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":415,"ondisk_log_size":415,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247818,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38772,"kb_used_data":7584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333068,"statfs":{"total":96636764160,"available":96597061632,"internally_reserved":0,"allocated":7766016,"data_stored":9675420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247818,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37252,"kb_used_data":6060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334588,"statfs":{"total":96636764160,"available":96598618112,"internally_reserved":0,"allocated":6205440,"data_stored":9007228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280522,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30108,"kb_used_data":3076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341732,"statfs":{"total":96636764160,"available":96605933568,"internally_reserved":0,"allocated":3149824,"data_stored":4356166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313226,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":5060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":5181440,"data_stored":7329697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280522,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34988,"kb_used_data":7960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336852,"statfs":{"total":96636764160,"available":96600936448,"internally_reserved":0,"allocated":8151040,"data_stored":11315270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313226,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":4988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":5107712,"data_stored":6817697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280520,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":5500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":5632000,"data_stored":6600755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280521,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":5460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":5591040,"data_stored":7596083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,4,5,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313225,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39964,"kb_used_data":8768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331876,"statfs":{"total":96636764160,"available":96595841024,"internally_reserved":0,"allocated":8978432,"data_stored":12445747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280521,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37968,"kb_used_data":6780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333872,"statfs":{"total":96636764160,"available":96597884928,"internally_reserved":0,"allocated":6942720,"data_stored":9054259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280521,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30880,"kb_used_data":3848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340960,"statfs":{"total":96636764160,"available":96605143040,"internally_reserved":0,"allocated":3940352,"data_stored":4331571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247816,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32868,"kb_used_data":5836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338972,"statfs":{"total":96636764160,"available":96603107328,"internally_reserved":0,"allocated":5976064,"data_stored":6813747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247818,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39584,"kb_used_data":8396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332256,"statfs":{"total":96636764160,"available":96596230144,"internally_reserved":0,"allocated":8597504,"data_stored":12220467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247818,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37128,"kb_used_data":5936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334712,"statfs":{"total":96636764160,"available":96598745088,"internally_reserved":0,"allocated":6078464,"data_stored":7686739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247817,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31272,"kb_used_data":4240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340568,"statfs":{"total":96636764160,"available":96604741632,"internally_reserved":0,"allocated":4341760,"data_stored":5011507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280520,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":5328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":5455872,"data_stored":6956961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4624384,"data_stored":7045120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6692864,"data_stored":9236480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3350528,"data_stored":4026368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5386240,"data_stored":6508544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8347648,"data_stored":12402688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5042176,"data_stored":6295552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4956160,"data_stored":6852608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3751936,"data_stored":4706304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4898816,"data_stored":7053312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4550656,"data_stored":6533120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":5001216,"data_stored":7290880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":12140544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":2555904,"data_stored":4050944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":7557120,"data_stored":11010048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":5599232,"data_stored":8691712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":6627328,"data_stored":8830976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:15:46.218 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:15:46.230 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T18:15:46.254 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:46.251+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:46.353 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:46.353 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:46.355 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:46.355+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:46.368 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T18:15:46.456 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:46.453+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:46.487 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:46.487 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:46.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T18:15:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:15:46.519 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:15:46.536 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-09-17T18:15:45.825192+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":50102835,"num_objects":84,"num_object_clones":33,"num_object_copies":568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":2,"num_read":282,"num_read_kb":29255,"num_write":456,"num_write_kb":53570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":530,"ondisk_log_size":530,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":552288,"kb_used_data":94820,"kb_used_omap":24,"kb_used_meta":457063,"kb_avail":1509397152,"statfs":{"total":1546188226560,"available":1545622683648,"internally_reserved":0,"allocated":97095680,"data_stored":127219314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":468032593},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2392064,"num_objects":-11,"num_object_clones":-10,"num_object_copies":-77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11,"num_whiteouts":-1,"num_read":20,"num_read_kb":12936,"num_write":32,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039357"},"pg_stats":[{"pgid":"3.f","version":"43'14","reported_seq":82,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.826171+0000","last_change":"2024-09-17T18:15:38.800430+0000","last_active":"2024-09-17T18:15:41.826171+0000","last_peered":"2024-09-17T18:15:41.826171+0000","last_clean":"2024-09-17T18:15:41.826171+0000","last_became_active":"2024-09-17T18:15:28.090920+0000","last_became_peered":"2024-09-17T18:15:28.090920+0000","last_unstale":"2024-09-17T18:15:41.826171+0000","last_undegraded":"2024-09-17T18:15:41.826171+0000","last_fullsized":"2024-09-17T18:15:41.826171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:28.156240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026496161000000001,"stat_sum":{"num_bytes":1376256,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3799,"num_write":8,"num_write_kb":1424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3,15,14,2,11,0],"acting":[13,3,15,14,2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.e","version":"39'6","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.788901+0000","last_change":"2024-09-17T18:15:38.775016+0000","last_active":"2024-09-17T18:15:41.788901+0000","last_peered":"2024-09-17T18:15:41.788901+0000","last_clean":"2024-09-17T18:15:41.788901+0000","last_became_active":"2024-09-17T18:15:28.110648+0000","last_became_peered":"2024-09-17T18:15:28.110648+0000","last_unstale":"2024-09-17T18:15:41.788901+0000","last_undegraded":"2024-09-17T18:15:41.788901+0000","last_fullsized":"2024-09-17T18:15:41.788901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:50.527552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024869950000000001,"stat_sum":{"num_bytes":229376,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":417,"num_write":5,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14,6,13,8,3,12],"acting":[11,14,6,13,8,3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.d","version":"43'95","reported_seq":166,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.825626+0000","last_change":"2024-09-17T18:15:38.844939+0000","last_active":"2024-09-17T18:15:41.825626+0000","last_peered":"2024-09-17T18:15:41.825626+0000","last_clean":"2024-09-17T18:15:41.825626+0000","last_became_active":"2024-09-17T18:15:28.273848+0000","last_became_peered":"2024-09-17T18:15:28.273848+0000","last_unstale":"2024-09-17T18:15:41.825626+0000","last_undegraded":"2024-09-17T18:15:41.825626+0000","last_fullsized":"2024-09-17T18:15:41.825626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:48.188279+0000","scrub_duration":0,"objects_trimmed":5,"snaptrim_duration":0.071385053000000004,"stat_sum":{"num_bytes":10518528,"num_objects":17,"num_object_clones":8,"num_object_copies":119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":33,"num_read_kb":2217,"num_write":69,"num_write_kb":10752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,11,15,9,8,4],"acting":[13,1,11,15,9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.c","version":"46'29","reported_seq":95,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.830272+0000","last_change":"2024-09-17T18:15:38.814043+0000","last_active":"2024-09-17T18:15:41.830272+0000","last_peered":"2024-09-17T18:15:41.830272+0000","last_clean":"2024-09-17T18:15:41.830272+0000","last_became_active":"2024-09-17T18:15:28.112093+0000","last_became_peered":"2024-09-17T18:15:28.112093+0000","last_unstale":"2024-09-17T18:15:41.830272+0000","last_undegraded":"2024-09-17T18:15:41.830272+0000","last_fullsized":"2024-09-17T18:15:41.830272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:27.404883+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.030741185000000001,"stat_sum":{"num_bytes":3751936,"num_objects":7,"num_object_clones":3,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":10,"num_read_kb":4,"num_write":16,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,3,7,12,14],"acting":[5,8,13,3,7,12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.b","version":"46'47","reported_seq":112,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:42.808042+0000","last_change":"2024-09-17T18:15:38.812080+0000","last_active":"2024-09-17T18:15:42.808042+0000","last_peered":"2024-09-17T18:15:42.808042+0000","last_clean":"2024-09-17T18:15:42.808042+0000","last_became_active":"2024-09-17T18:15:28.111526+0000","last_became_peered":"2024-09-17T18:15:28.111526+0000","last_unstale":"2024-09-17T18:15:42.808042+0000","last_undegraded":"2024-09-17T18:15:42.808042+0000","last_fullsized":"2024-09-17T18:15:42.808042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:43.213225+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.045131996000000001,"stat_sum":{"num_bytes":5865472,"num_objects":9,"num_object_clones":5,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":49,"num_write_kb":6480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,10,12,11,1,14],"acting":[4,0,10,12,11,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.a","version":"43'47","reported_seq":120,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.825427+0000","last_change":"2024-09-17T18:15:38.828686+0000","last_active":"2024-09-17T18:15:41.825427+0000","last_peered":"2024-09-17T18:15:41.825427+0000","last_clean":"2024-09-17T18:15:41.825427+0000","last_became_active":"2024-09-17T18:15:28.089449+0000","last_became_peered":"2024-09-17T18:15:28.089449+0000","last_unstale":"2024-09-17T18:15:41.825427+0000","last_undegraded":"2024-09-17T18:15:41.825427+0000","last_fullsized":"2024-09-17T18:15:41.825427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:28.467375+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.054627892999999997,"stat_sum":{"num_bytes":4931584,"num_objects":7,"num_object_clones":2,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":9146,"num_write":24,"num_write_kb":5152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,6,5,3,15,4],"acting":[13,1,6,5,3,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.9","version":"43'40","reported_seq":111,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:43.280381+0000","last_change":"2024-09-17T18:15:38.828952+0000","last_active":"2024-09-17T18:15:43.280381+0000","last_peered":"2024-09-17T18:15:43.280381+0000","last_clean":"2024-09-17T18:15:43.280381+0000","last_became_active":"2024-09-17T18:15:28.095114+0000","last_became_peered":"2024-09-17T18:15:28.095114+0000","last_unstale":"2024-09-17T18:15:43.280381+0000","last_undegraded":"2024-09-17T18:15:43.280381+0000","last_fullsized":"2024-09-17T18:15:43.280381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:38.271404+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.044707917999999999,"stat_sum":{"num_bytes":4718592,"num_objects":7,"num_object_clones":3,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":17,"num_read_kb":2979,"num_write":40,"num_write_kb":5152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,10,11,5,8,3],"acting":[7,2,10,11,5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.8","version":"43'21","reported_seq":85,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:43.279438+0000","last_change":"2024-09-17T18:15:38.802250+0000","last_active":"2024-09-17T18:15:43.279438+0000","last_peered":"2024-09-17T18:15:43.279438+0000","last_clean":"2024-09-17T18:15:43.279438+0000","last_became_active":"2024-09-17T18:15:28.088066+0000","last_became_peered":"2024-09-17T18:15:28.088066+0000","last_unstale":"2024-09-17T18:15:43.279438+0000","last_undegraded":"2024-09-17T18:15:43.279438+0000","last_fullsized":"2024-09-17T18:15:43.279438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:28.315991+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.029072400000000002,"stat_sum":{"num_bytes":2572288,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":7,"num_read_kb":4,"num_write":11,"num_write_kb":2512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,11,3,15,1,7],"acting":[6,0,11,3,15,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"1.0","version":"25'112","reported_seq":191,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:43.279641+0000","last_change":"2024-09-17T18:15:13.924291+0000","last_active":"2024-09-17T18:15:43.279641+0000","last_peered":"2024-09-17T18:15:43.279641+0000","last_clean":"2024-09-17T18:15:43.279641+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:15:43.279641+0000","last_undegraded":"2024-09-17T18:15:43.279641+0000","last_fullsized":"2024-09-17T18:15:43.279641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:15:12.533086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.379235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":60,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:42.811430+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:15:42.811430+0000","last_peered":"2024-09-17T18:15:42.811430+0000","last_clean":"2024-09-17T18:15:42.811430+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:15:42.811430+0000","last_undegraded":"2024-09-17T18:15:42.811430+0000","last_fullsized":"2024-09-17T18:15:42.811430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"43'20","reported_seq":86,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:42.811403+0000","last_change":"2024-09-17T18:15:38.811680+0000","last_active":"2024-09-17T18:15:42.811403+0000","last_peered":"2024-09-17T18:15:42.811403+0000","last_clean":"2024-09-17T18:15:42.811403+0000","last_became_active":"2024-09-17T18:15:28.089102+0000","last_became_peered":"2024-09-17T18:15:28.089102+0000","last_unstale":"2024-09-17T18:15:42.811403+0000","last_undegraded":"2024-09-17T18:15:42.811403+0000","last_fullsized":"2024-09-17T18:15:42.811403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:46.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030778476999999999,"stat_sum":{"num_bytes":1523712,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":9,"num_write_kb":1488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3,13,1,5,10,7],"acting":[14,3,13,1,5,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T18:15:39.996224+0000","last_change":"2024-09-17T18:15:16.990099+0000","last_active":"2024-09-17T18:15:39.996224+0000","last_peered":"2024-09-17T18:15:39.996224+0000","last_clean":"2024-09-17T18:15:39.996224+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:15:39.996224+0000","last_undegraded":"2024-09-17T18:15:39.996224+0000","last_fullsized":"2024-09-17T18:15:39.996224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.933228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:42.807756+0000","last_change":"2024-09-17T18:15:38.767363+0000","last_active":"2024-09-17T18:15:42.807756+0000","last_peered":"2024-09-17T18:15:42.807756+0000","last_clean":"2024-09-17T18:15:42.807756+0000","last_became_active":"2024-09-17T18:15:28.094455+0000","last_became_peered":"2024-09-17T18:15:28.094455+0000","last_unstale":"2024-09-17T18:15:42.807756+0000","last_undegraded":"2024-09-17T18:15:42.807756+0000","last_fullsized":"2024-09-17T18:15:42.807756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:40.987114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063363600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,14,10,7,3,2],"acting":[4,13,14,10,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:42.811197+0000","last_change":"2024-09-17T18:15:17.499886+0000","last_active":"2024-09-17T18:15:42.811197+0000","last_peered":"2024-09-17T18:15:42.811197+0000","last_clean":"2024-09-17T18:15:42.811197+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:15:42.811197+0000","last_undegraded":"2024-09-17T18:15:42.811197+0000","last_fullsized":"2024-09-17T18:15:42.811197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.366017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"43'13","reported_seq":81,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:43.279929+0000","last_change":"2024-09-17T18:15:38.799691+0000","last_active":"2024-09-17T18:15:43.279929+0000","last_peered":"2024-09-17T18:15:43.279929+0000","last_clean":"2024-09-17T18:15:43.279929+0000","last_became_active":"2024-09-17T18:15:28.273637+0000","last_became_peered":"2024-09-17T18:15:28.273637+0000","last_unstale":"2024-09-17T18:15:43.279929+0000","last_undegraded":"2024-09-17T18:15:43.279929+0000","last_fullsized":"2024-09-17T18:15:43.279929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:29.757786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018255255000000001,"stat_sum":{"num_bytes":2441216,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":8,"num_write_kb":2384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,9,2,6,15,4],"acting":[3,7,9,2,6,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"2.2","version":"27'2","reported_seq":59,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.825493+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:15:41.825493+0000","last_peered":"2024-09-17T18:15:41.825493+0000","last_clean":"2024-09-17T18:15:41.825493+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:15:41.825493+0000","last_undegraded":"2024-09-17T18:15:41.825493+0000","last_fullsized":"2024-09-17T18:15:41.825493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:19.851941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"43'10","reported_seq":80,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.818322+0000","last_change":"2024-09-17T18:15:38.801350+0000","last_active":"2024-09-17T18:15:41.818322+0000","last_peered":"2024-09-17T18:15:41.818322+0000","last_clean":"2024-09-17T18:15:41.818322+0000","last_became_active":"2024-09-17T18:15:28.272974+0000","last_became_peered":"2024-09-17T18:15:28.272974+0000","last_unstale":"2024-09-17T18:15:41.818322+0000","last_undegraded":"2024-09-17T18:15:41.818322+0000","last_fullsized":"2024-09-17T18:15:41.818322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:41.212977+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.026502164000000002,"stat_sum":{"num_bytes":1556480,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":419,"num_write":7,"num_write_kb":1520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4,13,11,2,5],"acting":[10,9,4,13,11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.5","version":"43'12","reported_seq":79,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.821186+0000","last_change":"2024-09-17T18:15:38.814044+0000","last_active":"2024-09-17T18:15:41.821186+0000","last_peered":"2024-09-17T18:15:41.821186+0000","last_clean":"2024-09-17T18:15:41.821186+0000","last_became_active":"2024-09-17T18:15:28.275306+0000","last_became_peered":"2024-09-17T18:15:28.275306+0000","last_unstale":"2024-09-17T18:15:41.821186+0000","last_undegraded":"2024-09-17T18:15:41.821186+0000","last_fullsized":"2024-09-17T18:15:41.821186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.859267+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.029820243,"stat_sum":{"num_bytes":376832,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":486,"num_write":24,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,11],"acting":[5,8,4,9,12,0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:42.807818+0000","last_change":"2024-09-17T18:15:16.605178+0000","last_active":"2024-09-17T18:15:42.807818+0000","last_peered":"2024-09-17T18:15:42.807818+0000","last_clean":"2024-09-17T18:15:42.807818+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:15:42.807818+0000","last_undegraded":"2024-09-17T18:15:42.807818+0000","last_fullsized":"2024-09-17T18:15:42.807818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":63,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.829381+0000","last_change":"2024-09-17T18:15:38.781879+0000","last_active":"2024-09-17T18:15:41.829381+0000","last_peered":"2024-09-17T18:15:41.829381+0000","last_clean":"2024-09-17T18:15:41.829381+0000","last_became_active":"2024-09-17T18:15:28.090551+0000","last_became_peered":"2024-09-17T18:15:28.090551+0000","last_unstale":"2024-09-17T18:15:41.829381+0000","last_undegraded":"2024-09-17T18:15:41.829381+0000","last_fullsized":"2024-09-17T18:15:41.829381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.939127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068215300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15,4,2,6,10,7],"acting":[8,15,4,2,6,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:43.280604+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:15:43.280604+0000","last_peered":"2024-09-17T18:15:43.280604+0000","last_clean":"2024-09-17T18:15:43.280604+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:15:43.280604+0000","last_undegraded":"2024-09-17T18:15:43.280604+0000","last_fullsized":"2024-09-17T18:15:43.280604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:14.501281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"43'40","reported_seq":124,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-17T18:15:42.808093+0000","last_change":"2024-09-17T18:15:38.803383+0000","last_active":"2024-09-17T18:15:42.808093+0000","last_peered":"2024-09-17T18:15:42.808093+0000","last_clean":"2024-09-17T18:15:42.808093+0000","last_became_active":"2024-09-17T18:15:27.692814+0000","last_became_peered":"2024-09-17T18:15:27.692814+0000","last_unstale":"2024-09-17T18:15:42.808093+0000","last_undegraded":"2024-09-17T18:15:42.808093+0000","last_fullsized":"2024-09-17T18:15:42.808093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.794174+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.036273090000000001,"stat_sum":{"num_bytes":6340608,"num_objects":9,"num_object_clones":4,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":8169,"num_write":25,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,0,14,10,13],"acting":[4,11,6,0,14,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.829435+0000","last_change":"2024-09-17T18:15:17.502621+0000","last_active":"2024-09-17T18:15:41.829435+0000","last_peered":"2024-09-17T18:15:41.829435+0000","last_clean":"2024-09-17T18:15:41.829435+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:15:41.829435+0000","last_undegraded":"2024-09-17T18:15:41.829435+0000","last_fullsized":"2024-09-17T18:15:41.829435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.990534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"43'21","reported_seq":83,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T18:15:40.460614+0000","last_change":"2024-09-17T18:15:38.790907+0000","last_active":"2024-09-17T18:15:40.460614+0000","last_peered":"2024-09-17T18:15:40.460614+0000","last_clean":"2024-09-17T18:15:40.460614+0000","last_became_active":"2024-09-17T18:15:28.272963+0000","last_became_peered":"2024-09-17T18:15:28.272963+0000","last_unstale":"2024-09-17T18:15:40.460614+0000","last_undegraded":"2024-09-17T18:15:40.460614+0000","last_fullsized":"2024-09-17T18:15:40.460614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:55.978344+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.019482095000000001,"stat_sum":{"num_bytes":3309568,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":1528,"num_write":14,"num_write_kb":3232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14,6,2,5,9,15],"acting":[0,14,6,2,5,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T18:15:41.826078+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:15:41.826078+0000","last_peered":"2024-09-17T18:15:41.826078+0000","last_clean":"2024-09-17T18:15:41.826078+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:15:41.826078+0000","last_undegraded":"2024-09-17T18:15:41.826078+0000","last_fullsized":"2024-09-17T18:15:41.826078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:17.193575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":49512448,"num_objects":80,"num_object_clones":33,"num_object_copies":560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":2,"num_read":196,"num_read_kb":29182,"num_write":309,"num_write_kb":50896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87330816,"data_stored":122675200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":415,"ondisk_log_size":415,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247818,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38772,"kb_used_data":7584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333068,"statfs":{"total":96636764160,"available":96597061632,"internally_reserved":0,"allocated":7766016,"data_stored":9675420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247818,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37252,"kb_used_data":6060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334588,"statfs":{"total":96636764160,"available":96598618112,"internally_reserved":0,"allocated":6205440,"data_stored":9007228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280522,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30108,"kb_used_data":3076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341732,"statfs":{"total":96636764160,"available":96605933568,"internally_reserved":0,"allocated":3149824,"data_stored":4356166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313226,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":5060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":5181440,"data_stored":7329697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280522,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34988,"kb_used_data":7960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336852,"statfs":{"total":96636764160,"available":96600936448,"internally_reserved":0,"allocated":8151040,"data_stored":11315270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313226,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":4988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":5107712,"data_stored":6817697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280520,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":5500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":5632000,"data_stored":6600755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280521,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":5460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":5591040,"data_stored":7596083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,4,5,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313225,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39964,"kb_used_data":8768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331876,"statfs":{"total":96636764160,"available":96595841024,"internally_reserved":0,"allocated":8978432,"data_stored":12445747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280521,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37968,"kb_used_data":6780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333872,"statfs":{"total":96636764160,"available":96597884928,"internally_reserved":0,"allocated":6942720,"data_stored":9054259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280521,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30880,"kb_used_data":3848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340960,"statfs":{"total":96636764160,"available":96605143040,"internally_reserved":0,"allocated":3940352,"data_stored":4331571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247816,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32868,"kb_used_data":5836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338972,"statfs":{"total":96636764160,"available":96603107328,"internally_reserved":0,"allocated":5976064,"data_stored":6813747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247818,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39584,"kb_used_data":8396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332256,"statfs":{"total":96636764160,"available":96596230144,"internally_reserved":0,"allocated":8597504,"data_stored":12220467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247818,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37128,"kb_used_data":5936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334712,"statfs":{"total":96636764160,"available":96598745088,"internally_reserved":0,"allocated":6078464,"data_stored":7686739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247817,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31272,"kb_used_data":4240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340568,"statfs":{"total":96636764160,"available":96604741632,"internally_reserved":0,"allocated":4341760,"data_stored":5011507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280520,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":5328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":5455872,"data_stored":6956961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4624384,"data_stored":7045120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6692864,"data_stored":9236480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3350528,"data_stored":4026368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5386240,"data_stored":6508544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8347648,"data_stored":12402688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5042176,"data_stored":6295552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4956160,"data_stored":6852608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3751936,"data_stored":4706304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4898816,"data_stored":7053312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4550656,"data_stored":6533120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":5001216,"data_stored":7290880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":12140544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":2555904,"data_stored":4050944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":7557120,"data_stored":11010048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":5599232,"data_stored":8691712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":6627328,"data_stored":8830976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:15:46.538 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-17T18:15:46.538 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T18:15:46.539 INFO:tasks.thrashosds.thrasher:inject_pause on osd.10 2024-09-17T18:15:46.539 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T18:15:46.539 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T18:15:46.539 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok config set filestore_inject_stall 3 2024-09-17T18:15:46.558 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:46.554+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:46.659 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:46.658+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:46.664 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:46.664 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:46.669 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:46.669 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-17T18:15:46.669 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:46.678 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T18:15:46.760 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:46.759+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:46.807 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:46.807 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:46.822 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T18:15:46.835 INFO:tasks.rados.rados.0.smithi154.stdout:166: done (4 left) 2024-09-17T18:15:46.835 INFO:tasks.rados.rados.0.smithi154.stdout:167: rollback oid 34 current snap is 14 2024-09-17T18:15:46.835 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 34 to 9 2024-09-17T18:15:46.835 INFO:tasks.rados.rados.0.smithi154.stdout:162: finishing write tid 1 to smithi15432074-39 2024-09-17T18:15:46.835 INFO:tasks.rados.rados.0.smithi154.stdout:162: finishing write tid 2 to smithi15432074-39 2024-09-17T18:15:46.835 INFO:tasks.rados.rados.0.smithi154.stdout:162: finishing write tid 3 to smithi15432074-39 2024-09-17T18:15:46.835 INFO:tasks.rados.rados.0.smithi154.stdout:164: finishing write tid 1 to smithi15432074-40 2024-09-17T18:15:46.835 INFO:tasks.rados.rados.0.smithi154.stdout:162: finishing write tid 4 to smithi15432074-39 2024-09-17T18:15:46.835 INFO:tasks.rados.rados.0.smithi154.stdout:164: finishing write tid 2 to smithi15432074-40 2024-09-17T18:15:46.835 INFO:tasks.rados.rados.0.smithi154.stdout:165: finishing rollback tid 1 to smithi15432074-3 2024-09-17T18:15:46.836 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 3 v 0 (ObjNum 33 snap 0 seq_num 4029249592) dirty dne 2024-09-17T18:15:46.836 INFO:tasks.rados.rados.0.smithi154.stdout:163: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-17T18:15:46.836 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:46.841 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 77516 2024-09-17T18:15:46.849 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 165282 2024-09-17T18:15:46.851 INFO:tasks.rados.rados.0.smithi154.stdout:162: finishing write tid 5 to smithi15432074-39 2024-09-17T18:15:46.851 INFO:tasks.rados.rados.0.smithi154.stdout:162: oid 39 updating version 0 to 53 2024-09-17T18:15:46.851 INFO:tasks.rados.rados.0.smithi154.stdout:162: oid 39 version 53 is already newer than 51 2024-09-17T18:15:46.851 INFO:tasks.rados.rados.0.smithi154.stdout:162: oid 39 version 53 is already newer than 52 2024-09-17T18:15:46.851 INFO:tasks.rados.rados.0.smithi154.stdout:162: oid 39 updating version 53 to 54 2024-09-17T18:15:46.851 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 39 v 54 (ObjNum 83 snap 14 seq_num 83) dirty exists 2024-09-17T18:15:46.851 INFO:tasks.rados.rados.0.smithi154.stdout:162: left oid 39 (ObjNum 83 snap 14 seq_num 83) 2024-09-17T18:15:46.852 INFO:tasks.rados.rados.0.smithi154.stdout:164: finishing write tid 3 to smithi15432074-40 2024-09-17T18:15:46.852 INFO:tasks.rados.rados.0.smithi154.stdout:164: finishing write tid 4 to smithi15432074-40 2024-09-17T18:15:46.852 INFO:tasks.rados.rados.0.smithi154.stdout:164: finishing write tid 5 to smithi15432074-40 2024-09-17T18:15:46.852 INFO:tasks.rados.rados.0.smithi154.stdout:164: oid 40 updating version 0 to 32 2024-09-17T18:15:46.852 INFO:tasks.rados.rados.0.smithi154.stdout:164: oid 40 updating version 32 to 34 2024-09-17T18:15:46.852 INFO:tasks.rados.rados.0.smithi154.stdout:164: oid 40 version 34 is already newer than 31 2024-09-17T18:15:46.852 INFO:tasks.rados.rados.0.smithi154.stdout:164: oid 40 version 34 is already newer than 33 2024-09-17T18:15:46.852 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 40 v 34 (ObjNum 84 snap 14 seq_num 84) dirty exists 2024-09-17T18:15:46.852 INFO:tasks.rados.rados.0.smithi154.stdout:164: left oid 40 (ObjNum 84 snap 14 seq_num 84) 2024-09-17T18:15:46.852 INFO:tasks.rados.rados.0.smithi154.stdout:162: done (4 left) 2024-09-17T18:15:46.852 INFO:tasks.rados.rados.0.smithi154.stdout:163: done (3 left) 2024-09-17T18:15:46.853 INFO:tasks.rados.rados.0.smithi154.stdout:164: done (2 left) 2024-09-17T18:15:46.853 INFO:tasks.rados.rados.0.smithi154.stdout:165: done (1 left) 2024-09-17T18:15:46.853 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 12 current snap is 14 2024-09-17T18:15:46.854 INFO:tasks.rados.rados.0.smithi154.stdout:168: seq_num 85 ranges {2359296=671744,3031040=770048} 2024-09-17T18:15:46.867 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:46.866+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:46.885 INFO:tasks.rados.rados.0.smithi154.stdout:168: writing smithi15432074-12 from 2359296 to 3031040 tid 1 2024-09-17T18:15:46.894 INFO:tasks.rados.rados.0.smithi154.stdout:168: writing smithi15432074-12 from 3031040 to 3801088 tid 2 2024-09-17T18:15:46.894 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 47 current snap is 14 2024-09-17T18:15:46.894 INFO:tasks.rados.rados.0.smithi154.stdout:167: finishing rollback tid 0 to smithi15432074-34 2024-09-17T18:15:46.894 INFO:tasks.rados.rados.0.smithi154.stdout:167: finishing rollback tid 1 to smithi15432074-34 2024-09-17T18:15:46.894 INFO:tasks.rados.rados.0.smithi154.stdout:169: seq_num 86 ranges {786432=688128,1474560=540672,2015232=229376} 2024-09-17T18:15:46.908 INFO:tasks.rados.rados.0.smithi154.stdout:169: writing smithi15432074-47 from 786432 to 1474560 tid 1 2024-09-17T18:15:46.911 INFO:tasks.rados.rados.0.smithi154.stdout:169: writing smithi15432074-47 from 1474560 to 2015232 tid 2 2024-09-17T18:15:46.914 INFO:tasks.rados.rados.0.smithi154.stdout:169: writing smithi15432074-47 from 2015232 to 2244608 tid 3 2024-09-17T18:15:46.914 INFO:tasks.rados.rados.0.smithi154.stdout:170: setattr oid 10 current snap is 14 2024-09-17T18:15:46.914 INFO:tasks.rados.rados.0.smithi154.stdout:167: finishing rollback tid 2 to smithi15432074-34 2024-09-17T18:15:46.915 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 34 v 49 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-09-17T18:15:46.915 INFO:tasks.rados.rados.0.smithi154.stdout:168: finishing write tid 1 to smithi15432074-12 2024-09-17T18:15:46.915 INFO:tasks.rados.rados.0.smithi154.stdout:168: finishing write tid 2 to smithi15432074-12 2024-09-17T18:15:46.915 INFO:tasks.rados.rados.0.smithi154.stdout:168: finishing write tid 3 to smithi15432074-12 2024-09-17T18:15:46.915 INFO:tasks.rados.rados.0.smithi154.stdout:168: finishing write tid 4 to smithi15432074-12 2024-09-17T18:15:46.915 INFO:tasks.rados.rados.0.smithi154.stdout:168: oid 12 updating version 0 to 102 2024-09-17T18:15:46.915 INFO:tasks.rados.rados.0.smithi154.stdout:168: oid 12 updating version 102 to 103 2024-09-17T18:15:46.915 INFO:tasks.rados.rados.0.smithi154.stdout:168: oid 12 updating version 103 to 104 2024-09-17T18:15:46.915 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 12 v 104 (ObjNum 85 snap 14 seq_num 85) dirty exists 2024-09-17T18:15:46.915 INFO:tasks.rados.rados.0.smithi154.stdout:168: left oid 12 (ObjNum 85 snap 14 seq_num 85) 2024-09-17T18:15:46.917 INFO:tasks.rados.rados.0.smithi154.stdout:167: done (3 left) 2024-09-17T18:15:46.917 INFO:tasks.rados.rados.0.smithi154.stdout:168: done (2 left) 2024-09-17T18:15:46.917 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 33 current snap is 14 2024-09-17T18:15:46.917 INFO:tasks.rados.rados.0.smithi154.stdout:171: seq_num 87 ranges {1884160=704512,2588672=688128,3276800=81920} 2024-09-17T18:15:46.935 INFO:tasks.rados.rados.0.smithi154.stdout:171: writing smithi15432074-33 from 1884160 to 2588672 tid 1 2024-09-17T18:15:46.940 INFO:tasks.rados.rados.0.smithi154.stdout:171: writing smithi15432074-33 from 2588672 to 3276800 tid 2 2024-09-17T18:15:46.940 INFO:tasks.rados.rados.0.smithi154.stdout:171: writing smithi15432074-33 from 3276800 to 3358720 tid 3 2024-09-17T18:15:46.940 INFO:tasks.rados.rados.0.smithi154.stdout:172: snap_remove snap 2 2024-09-17T18:15:46.958 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:46.959 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:46.962 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:46.959+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:46.972 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T18:15:47.063 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:47.063+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:47.136 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:47.137 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:47.151 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T18:15:47.195 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:47.194+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:47.265 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:47.261+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:47.272 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:47.272 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:47.287 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T18:15:47.366 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:47.363+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:47.455 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:47.456 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:47.467 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:47.465+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:47.469 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T18:15:47.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:47.567+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:47.591 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:47.591 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:47.606 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T18:15:47.669 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:47.665+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:47.728 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:47.728 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:47.742 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T18:15:47.787 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:47.786+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:47.849 INFO:tasks.rados.rados.0.smithi154.stdout:172: done (3 left) 2024-09-17T18:15:47.849 INFO:tasks.rados.rados.0.smithi154.stdout:173: delete oid 4 current snap is 14 2024-09-17T18:15:47.849 INFO:tasks.rados.rados.0.smithi154.stdout:169: finishing write tid 1 to smithi15432074-47 2024-09-17T18:15:47.849 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 10 v 106 (ObjNum 80 snap 11 seq_num 80) dirty exists 2024-09-17T18:15:47.849 INFO:tasks.rados.rados.0.smithi154.stdout:169: finishing write tid 2 to smithi15432074-47 2024-09-17T18:15:47.849 INFO:tasks.rados.rados.0.smithi154.stdout:169: finishing write tid 3 to smithi15432074-47 2024-09-17T18:15:47.849 INFO:tasks.rados.rados.0.smithi154.stdout:169: finishing write tid 4 to smithi15432074-47 2024-09-17T18:15:47.849 INFO:tasks.rados.rados.0.smithi154.stdout:169: finishing write tid 5 to smithi15432074-47 2024-09-17T18:15:47.850 INFO:tasks.rados.rados.0.smithi154.stdout:169: oid 47 updating version 0 to 24 2024-09-17T18:15:47.850 INFO:tasks.rados.rados.0.smithi154.stdout:169: oid 47 updating version 24 to 25 2024-09-17T18:15:47.850 INFO:tasks.rados.rados.0.smithi154.stdout:169: oid 47 updating version 25 to 26 2024-09-17T18:15:47.850 INFO:tasks.rados.rados.0.smithi154.stdout:169: oid 47 version 26 is already newer than 23 2024-09-17T18:15:47.850 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 47 v 26 (ObjNum 86 snap 14 seq_num 86) dirty exists 2024-09-17T18:15:47.850 INFO:tasks.rados.rados.0.smithi154.stdout:169: left oid 47 (ObjNum 86 snap 14 seq_num 86) 2024-09-17T18:15:47.850 INFO:tasks.rados.rados.0.smithi154.stdout:171: finishing write tid 1 to smithi15432074-33 2024-09-17T18:15:47.850 INFO:tasks.rados.rados.0.smithi154.stdout:171: finishing write tid 2 to smithi15432074-33 2024-09-17T18:15:47.850 INFO:tasks.rados.rados.0.smithi154.stdout:171: finishing write tid 3 to smithi15432074-33 2024-09-17T18:15:47.850 INFO:tasks.rados.rados.0.smithi154.stdout:171: finishing write tid 4 to smithi15432074-33 2024-09-17T18:15:47.850 INFO:tasks.rados.rados.0.smithi154.stdout:171: finishing write tid 5 to smithi15432074-33 2024-09-17T18:15:47.850 INFO:tasks.rados.rados.0.smithi154.stdout:171: oid 33 updating version 0 to 51 2024-09-17T18:15:47.850 INFO:tasks.rados.rados.0.smithi154.stdout:171: oid 33 version 51 is already newer than 50 2024-09-17T18:15:47.851 INFO:tasks.rados.rados.0.smithi154.stdout:171: oid 33 updating version 51 to 53 2024-09-17T18:15:47.851 INFO:tasks.rados.rados.0.smithi154.stdout:171: oid 33 version 53 is already newer than 52 2024-09-17T18:15:47.851 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 33 v 53 (ObjNum 87 snap 14 seq_num 87) dirty exists 2024-09-17T18:15:47.851 INFO:tasks.rados.rados.0.smithi154.stdout:171: left oid 33 (ObjNum 87 snap 14 seq_num 87) 2024-09-17T18:15:47.851 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T18:15:47.871 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:47.871 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:47.871 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:47.871+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:47.878 INFO:tasks.rados.rados.0.smithi154.stdout:169: done (3 left) 2024-09-17T18:15:47.879 INFO:tasks.rados.rados.0.smithi154.stdout:170: done (2 left) 2024-09-17T18:15:47.879 INFO:tasks.rados.rados.0.smithi154.stdout:171: done (1 left) 2024-09-17T18:15:47.879 INFO:tasks.rados.rados.0.smithi154.stdout:173: done (0 left) 2024-09-17T18:15:47.879 INFO:tasks.rados.rados.0.smithi154.stdout:174: rollback oid 17 current snap is 14 2024-09-17T18:15:47.879 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 17 to 7 2024-09-17T18:15:47.879 INFO:tasks.rados.rados.0.smithi154.stdout:175: snap_create 2024-09-17T18:15:47.895 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T18:15:47.903 INFO:tasks.rados.rados.0.smithi154.stdout:174: finishing rollback tid 0 to smithi15432074-17 2024-09-17T18:15:47.904 INFO:tasks.rados.rados.0.smithi154.stdout:174: finishing rollback tid 1 to smithi15432074-17 2024-09-17T18:15:47.905 INFO:tasks.rados.rados.0.smithi154.stdout:174: finishing rollback tid 2 to smithi15432074-17 2024-09-17T18:15:47.905 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 17 v 64 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-09-17T18:15:47.973 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:47.969+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:48.060 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:48.061 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:48.073 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:48.071+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:48.075 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T18:15:48.105 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T18:15:48.174 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:48.171+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:48.195 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:48.195 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:48.210 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T18:15:48.265 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:15:48.266 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:15:48.275 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:48.275+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:48.287 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:15:48.287 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:15:48.301 INFO:teuthology.orchestra.run.smithi087.stderr:noscrub is set 2024-09-17T18:15:48.305 INFO:tasks.rados.rados.0.smithi154.stdout:174: done (1 left) 2024-09-17T18:15:48.306 INFO:tasks.rados.rados.0.smithi154.stdout:175: done (0 left) 2024-09-17T18:15:48.306 INFO:tasks.rados.rados.0.smithi154.stdout:176: copy_from oid 27 from oid 38 current snap is 15 2024-09-17T18:15:48.306 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 28 current snap is 15 2024-09-17T18:15:48.306 INFO:tasks.rados.rados.0.smithi154.stdout:177: seq_num 89 ranges {1409024=737280,2146304=573440,2719744=196608} 2024-09-17T18:15:48.310 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:15:48.311 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:15:48.332 INFO:tasks.rados.rados.0.smithi154.stdout:177: writing smithi15432074-28 from 1409024 to 2146304 tid 1 2024-09-17T18:15:48.334 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:48.334 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:48.336 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:15:48.336 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:15:48.340 INFO:tasks.rados.rados.0.smithi154.stdout:177: writing smithi15432074-28 from 2146304 to 2719744 tid 2 2024-09-17T18:15:48.341 INFO:tasks.rados.rados.0.smithi154.stdout:177: writing smithi15432074-28 from 2719744 to 2916352 tid 3 2024-09-17T18:15:48.341 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 49 current snap is 15 2024-09-17T18:15:48.341 INFO:tasks.rados.rados.0.smithi154.stdout:176: finishing copy_from racing read to smithi15432074-27 2024-09-17T18:15:48.342 INFO:tasks.rados.rados.0.smithi154.stdout:176: finishing copy_from to smithi15432074-27 2024-09-17T18:15:48.342 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 27 v 6 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-09-17T18:15:48.342 INFO:tasks.rados.rados.0.smithi154.stdout:178: seq_num 90 ranges {1835008=753664,2588672=720896,3309568=49152} 2024-09-17T18:15:48.348 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T18:15:48.354 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:15:48.354 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:15:48.371 INFO:tasks.rados.rados.0.smithi154.stdout:178: writing smithi15432074-49 from 1835008 to 2588672 tid 1 2024-09-17T18:15:48.376 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:15:48.376 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:15:48.377 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:48.373+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:48.378 INFO:tasks.rados.rados.0.smithi154.stdout:178: writing smithi15432074-49 from 2588672 to 3309568 tid 2 2024-09-17T18:15:48.379 INFO:tasks.rados.rados.0.smithi154.stdout:178: writing smithi15432074-49 from 3309568 to 3358720 tid 3 2024-09-17T18:15:48.379 INFO:tasks.rados.rados.0.smithi154.stdout:176: done (2 left) 2024-09-17T18:15:48.380 INFO:tasks.rados.rados.0.smithi154.stdout:179: read oid 6 snap 10 2024-09-17T18:15:48.380 INFO:tasks.rados.rados.0.smithi154.stdout:179: expect (ObjNum 5 snap 0 seq_num 5) 2024-09-17T18:15:48.380 INFO:tasks.rados.rados.0.smithi154.stdout:180: setattr oid 16 current snap is 15 2024-09-17T18:15:48.380 INFO:tasks.rados.rados.0.smithi154.stdout:177: finishing write tid 1 to smithi15432074-28 2024-09-17T18:15:48.380 INFO:tasks.rados.rados.0.smithi154.stdout:177: finishing write tid 2 to smithi15432074-28 2024-09-17T18:15:48.380 INFO:tasks.rados.rados.0.smithi154.stdout:177: finishing write tid 3 to smithi15432074-28 2024-09-17T18:15:48.380 INFO:tasks.rados.rados.0.smithi154.stdout:177: finishing write tid 4 to smithi15432074-28 2024-09-17T18:15:48.380 INFO:tasks.rados.rados.0.smithi154.stdout:177: finishing write tid 5 to smithi15432074-28 2024-09-17T18:15:48.381 INFO:tasks.rados.rados.0.smithi154.stdout:177: oid 28 updating version 0 to 14 2024-09-17T18:15:48.381 INFO:tasks.rados.rados.0.smithi154.stdout:177: oid 28 version 14 is already newer than 13 2024-09-17T18:15:48.381 INFO:tasks.rados.rados.0.smithi154.stdout:177: oid 28 version 14 is already newer than 12 2024-09-17T18:15:48.381 INFO:tasks.rados.rados.0.smithi154.stdout:177: oid 28 updating version 14 to 15 2024-09-17T18:15:48.381 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 28 v 15 (ObjNum 89 snap 15 seq_num 89) dirty exists 2024-09-17T18:15:48.381 INFO:tasks.rados.rados.0.smithi154.stdout:177: left oid 28 (ObjNum 89 snap 15 seq_num 89) 2024-09-17T18:15:48.382 INFO:tasks.rados.rados.0.smithi154.stdout:177: done (3 left) 2024-09-17T18:15:48.382 INFO:tasks.rados.rados.0.smithi154.stdout:181: read oid 22 snap -1 2024-09-17T18:15:48.382 INFO:tasks.rados.rados.0.smithi154.stdout:181: expect (ObjNum 57 snap 1 seq_num 57) 2024-09-17T18:15:48.382 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 23 current snap is 15 2024-09-17T18:15:48.382 INFO:tasks.rados.rados.0.smithi154.stdout:182: seq_num 91 ranges {376832=770048,1146880=475136,1622016=294912} 2024-09-17T18:15:48.393 INFO:tasks.rados.rados.0.smithi154.stdout:182: writing smithi15432074-23 from 376832 to 1146880 tid 1 2024-09-17T18:15:48.398 INFO:tasks.rados.rados.0.smithi154.stdout:182: writing smithi15432074-23 from 1146880 to 1622016 tid 2 2024-09-17T18:15:48.398 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:15:48.399 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:15:48.400 INFO:tasks.rados.rados.0.smithi154.stdout:182: writing smithi15432074-23 from 1622016 to 1916928 tid 3 2024-09-17T18:15:48.400 INFO:tasks.rados.rados.0.smithi154.stdout:183: setattr oid 33 current snap is 15 2024-09-17T18:15:48.402 INFO:tasks.rados.rados.0.smithi154.stdout:178: finishing write tid 1 to smithi15432074-49 2024-09-17T18:15:48.403 INFO:tasks.rados.rados.0.smithi154.stdout:179: expect (ObjNum 5 snap 0 seq_num 5) 2024-09-17T18:15:48.403 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:48.405 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 83224 2024-09-17T18:15:48.406 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:48.409 INFO:tasks.rados.rados.0.smithi154.stdout:178: finishing write tid 2 to smithi15432074-49 2024-09-17T18:15:48.409 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 16 v 26 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-09-17T18:15:48.409 INFO:tasks.rados.rados.0.smithi154.stdout:178: finishing write tid 3 to smithi15432074-49 2024-09-17T18:15:48.409 INFO:tasks.rados.rados.0.smithi154.stdout:178: finishing write tid 4 to smithi15432074-49 2024-09-17T18:15:48.409 INFO:tasks.rados.rados.0.smithi154.stdout:178: finishing write tid 5 to smithi15432074-49 2024-09-17T18:15:48.409 INFO:tasks.rados.rados.0.smithi154.stdout:178: oid 49 updating version 0 to 25 2024-09-17T18:15:48.409 INFO:tasks.rados.rados.0.smithi154.stdout:178: oid 49 updating version 25 to 28 2024-09-17T18:15:48.410 INFO:tasks.rados.rados.0.smithi154.stdout:178: oid 49 version 28 is already newer than 27 2024-09-17T18:15:48.410 INFO:tasks.rados.rados.0.smithi154.stdout:178: oid 49 version 28 is already newer than 26 2024-09-17T18:15:48.410 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 49 v 28 (ObjNum 90 snap 15 seq_num 90) dirty exists 2024-09-17T18:15:48.410 INFO:tasks.rados.rados.0.smithi154.stdout:178: left oid 49 (ObjNum 90 snap 15 seq_num 90) 2024-09-17T18:15:48.410 INFO:tasks.rados.rados.0.smithi154.stdout:182: finishing write tid 1 to smithi15432074-23 2024-09-17T18:15:48.410 INFO:tasks.rados.rados.0.smithi154.stdout:178: done (5 left) 2024-09-17T18:15:48.410 INFO:tasks.rados.rados.0.smithi154.stdout:179: done (4 left) 2024-09-17T18:15:48.410 INFO:tasks.rados.rados.0.smithi154.stdout:180: done (3 left) 2024-09-17T18:15:48.410 INFO:tasks.rados.rados.0.smithi154.stdout:184: rmattr oid 50 current snap is 15 2024-09-17T18:15:48.410 INFO:tasks.rados.rados.0.smithi154.stdout:184: done (3 left) 2024-09-17T18:15:48.410 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 2 current snap is 15 2024-09-17T18:15:48.410 INFO:tasks.rados.rados.0.smithi154.stdout:185: seq_num 92 ranges {114688=786432,901120=491520,1392640=278528} 2024-09-17T18:15:48.416 INFO:tasks.rados.rados.0.smithi154.stdout:185: writing smithi15432074-2 from 114688 to 901120 tid 1 2024-09-17T18:15:48.418 INFO:tasks.rados.rados.0.smithi154.stdout:185: writing smithi15432074-2 from 901120 to 1392640 tid 2 2024-09-17T18:15:48.421 INFO:tasks.rados.rados.0.smithi154.stdout:185: writing smithi15432074-2 from 1392640 to 1671168 tid 3 2024-09-17T18:15:48.421 INFO:tasks.rados.rados.0.smithi154.stdout:186: rollback oid 8 current snap is 15 2024-09-17T18:15:48.421 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 8 to 14 2024-09-17T18:15:48.421 INFO:tasks.rados.rados.0.smithi154.stdout:181: expect (ObjNum 57 snap 1 seq_num 57) 2024-09-17T18:15:48.428 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:15:48.428 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:15:48.428 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 978022 2024-09-17T18:15:48.439 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:48.447 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:15:48.447 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:15:48.467 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:15:48.468 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:15:48.470 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 151568 2024-09-17T18:15:48.475 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:48.475 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:48.477 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:48.475+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:48.489 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T18:15:48.489 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:15:48.489 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:15:48.491 INFO:tasks.rados.rados.0.smithi154.stdout:182: finishing write tid 2 to smithi15432074-23 2024-09-17T18:15:48.491 INFO:tasks.rados.rados.0.smithi154.stdout:182: finishing write tid 3 to smithi15432074-23 2024-09-17T18:15:48.491 INFO:tasks.rados.rados.0.smithi154.stdout:181: done (4 left) 2024-09-17T18:15:48.492 INFO:tasks.rados.rados.0.smithi154.stdout:187: delete oid 15 current snap is 15 2024-09-17T18:15:48.492 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 33 v 62 (ObjNum 87 snap 14 seq_num 87) dirty exists 2024-09-17T18:15:48.492 INFO:tasks.rados.rados.0.smithi154.stdout:182: finishing write tid 4 to smithi15432074-23 2024-09-17T18:15:48.492 INFO:tasks.rados.rados.0.smithi154.stdout:182: finishing write tid 5 to smithi15432074-23 2024-09-17T18:15:48.492 INFO:tasks.rados.rados.0.smithi154.stdout:182: oid 23 updating version 0 to 19 2024-09-17T18:15:48.492 INFO:tasks.rados.rados.0.smithi154.stdout:182: oid 23 version 19 is already newer than 18 2024-09-17T18:15:48.492 INFO:tasks.rados.rados.0.smithi154.stdout:182: oid 23 version 19 is already newer than 16 2024-09-17T18:15:48.492 INFO:tasks.rados.rados.0.smithi154.stdout:182: oid 23 version 19 is already newer than 17 2024-09-17T18:15:48.492 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 23 v 19 (ObjNum 91 snap 15 seq_num 91) dirty exists 2024-09-17T18:15:48.492 INFO:tasks.rados.rados.0.smithi154.stdout:182: left oid 23 (ObjNum 91 snap 15 seq_num 91) 2024-09-17T18:15:48.492 INFO:tasks.rados.rados.0.smithi154.stdout:185: finishing write tid 1 to smithi15432074-2 2024-09-17T18:15:48.492 INFO:tasks.rados.rados.0.smithi154.stdout:185: finishing write tid 2 to smithi15432074-2 2024-09-17T18:15:48.492 INFO:tasks.rados.rados.0.smithi154.stdout:185: finishing write tid 3 to smithi15432074-2 2024-09-17T18:15:48.499 INFO:tasks.rados.rados.0.smithi154.stdout:185: finishing write tid 4 to smithi15432074-2 2024-09-17T18:15:48.499 INFO:tasks.rados.rados.0.smithi154.stdout:186: finishing rollback tid 0 to smithi15432074-8 2024-09-17T18:15:48.499 INFO:tasks.rados.rados.0.smithi154.stdout:185: finishing write tid 5 to smithi15432074-2 2024-09-17T18:15:48.499 INFO:tasks.rados.rados.0.smithi154.stdout:185: oid 2 updating version 0 to 121 2024-09-17T18:15:48.500 INFO:tasks.rados.rados.0.smithi154.stdout:185: oid 2 updating version 121 to 123 2024-09-17T18:15:48.500 INFO:tasks.rados.rados.0.smithi154.stdout:185: oid 2 version 123 is already newer than 122 2024-09-17T18:15:48.500 INFO:tasks.rados.rados.0.smithi154.stdout:185: oid 2 version 123 is already newer than 120 2024-09-17T18:15:48.500 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 2 v 123 (ObjNum 92 snap 15 seq_num 92) dirty exists 2024-09-17T18:15:48.500 INFO:tasks.rados.rados.0.smithi154.stdout:185: left oid 2 (ObjNum 92 snap 15 seq_num 92) 2024-09-17T18:15:48.500 INFO:tasks.rados.rados.0.smithi154.stdout:186: finishing rollback tid 1 to smithi15432074-8 2024-09-17T18:15:48.500 INFO:tasks.rados.rados.0.smithi154.stdout:186: finishing rollback tid 2 to smithi15432074-8 2024-09-17T18:15:48.500 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 8 v 127 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-09-17T18:15:48.502 INFO:tasks.rados.rados.0.smithi154.stdout:182: done (4 left) 2024-09-17T18:15:48.502 INFO:tasks.rados.rados.0.smithi154.stdout:183: done (3 left) 2024-09-17T18:15:48.502 INFO:tasks.rados.rados.0.smithi154.stdout:185: done (2 left) 2024-09-17T18:15:48.502 INFO:tasks.rados.rados.0.smithi154.stdout:186: done (1 left) 2024-09-17T18:15:48.502 INFO:tasks.rados.rados.0.smithi154.stdout:187: done (0 left) 2024-09-17T18:15:48.502 INFO:tasks.rados.rados.0.smithi154.stdout:188: rollback oid 44 current snap is 15 2024-09-17T18:15:48.502 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 44 to 11 2024-09-17T18:15:48.502 INFO:tasks.rados.rados.0.smithi154.stdout:189: rollback oid 4 current snap is 15 2024-09-17T18:15:48.502 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 4 to 9 2024-09-17T18:15:48.503 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 41 current snap is 15 2024-09-17T18:15:48.503 INFO:tasks.rados.rados.0.smithi154.stdout:190: seq_num 94 ranges {1654784=425984,2080768=786432,2867200=376832} 2024-09-17T18:15:48.509 INFO:tasks.rados.rados.0.smithi154.stdout:190: writing smithi15432074-41 from 1654784 to 2080768 tid 1 2024-09-17T18:15:48.511 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:15:48.511 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:15:48.516 INFO:tasks.rados.rados.0.smithi154.stdout:190: writing smithi15432074-41 from 2080768 to 2867200 tid 2 2024-09-17T18:15:48.520 INFO:tasks.rados.rados.0.smithi154.stdout:190: writing smithi15432074-41 from 2867200 to 3244032 tid 3 2024-09-17T18:15:48.520 INFO:tasks.rados.rados.0.smithi154.stdout:191: rollback oid 24 current snap is 15 2024-09-17T18:15:48.520 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 24 to 6 2024-09-17T18:15:48.520 INFO:tasks.rados.rados.0.smithi154.stdout:189: finishing rollback tid 1 to smithi15432074-4 2024-09-17T18:15:48.520 INFO:tasks.rados.rados.0.smithi154.stdout:192: rollback oid 40 current snap is 15 2024-09-17T18:15:48.521 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 40 to 6 2024-09-17T18:15:48.521 INFO:tasks.rados.rados.0.smithi154.stdout:188: finishing rollback tid 0 to smithi15432074-44 2024-09-17T18:15:48.521 INFO:tasks.rados.rados.0.smithi154.stdout:188: finishing rollback tid 1 to smithi15432074-44 2024-09-17T18:15:48.521 INFO:tasks.rados.rados.0.smithi154.stdout:189: finishing rollback tid 2 to smithi15432074-4 2024-09-17T18:15:48.521 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 4 v 59 (ObjNum 75 snap 7 seq_num 75) dirty exists 2024-09-17T18:15:48.521 INFO:tasks.rados.rados.0.smithi154.stdout:188: finishing rollback tid 2 to smithi15432074-44 2024-09-17T18:15:48.521 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 44 v 44 (ObjNum 67 snap 5 seq_num 67) dirty exists 2024-09-17T18:15:48.521 INFO:tasks.rados.rados.0.smithi154.stdout:190: finishing write tid 1 to smithi15432074-41 2024-09-17T18:15:48.521 INFO:tasks.rados.rados.0.smithi154.stdout:188: done (4 left) 2024-09-17T18:15:48.521 INFO:tasks.rados.rados.0.smithi154.stdout:189: done (3 left) 2024-09-17T18:15:48.521 INFO:tasks.rados.rados.0.smithi154.stdout:193: snap_remove snap 7 2024-09-17T18:15:48.531 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:15:48.531 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:15:48.551 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:15:48.551 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:15:48.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:15:48.550+0000 7f92e37fe640 0 -- 172.21.15.87:0/929378871 >> [v2:172.21.15.146:6808/950976813,v1:172.21.15.146:6809/950976813] conn(0x7f92e42219c0 msgr2=0x7f92e4223db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T18:15:48.577 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:48.574+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:48.624 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:48.625 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:48.625 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:15:48.625 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:48.639 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T18:15:48.683 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:48.683+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:48.760 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:48.761 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:48.761 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:15:48.761 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:15:48.761 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:48.774 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T18:15:48.777 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:15:48.778 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:15:48.802 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:15:48.802 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:15:48.815 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:48.815+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:48.880 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:48.878+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:48.942 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:15:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:15:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:15:48.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpRead(3.as1 42/31 ECSubRead(tid=152, to_read={3:5b87f4c2:::smithi15432074-21:head=0,147456,0}, subchunks={3:5b87f4c2:::smithi15432074-21:head=[0,1]}, attrs_to_read=))", 2024-09-17T18:15:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.771671+0000", 2024-09-17T18:15:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.167712944, 2024-09-17T18:15:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072150779999999998, 2024-09-17T18:15:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.771671+0000", 2024-09-17T18:15:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.771671+0000", 2024-09-17T18:15:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.771673+0000", 2024-09-17T18:15:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0839999999999999e-06 2024-09-17T18:15:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:48.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.771693+0000", 2024-09-17T18:15:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9602e-05 2024-09-17T18:15:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.771735+0000", 2024-09-17T18:15:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2651999999999998e-05 2024-09-17T18:15:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.771763+0000", 2024-09-17T18:15:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7392000000000001e-05 2024-09-17T18:15:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777312+0000", 2024-09-17T18:15:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055492179999999999 2024-09-17T18:15:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.778886+0000", 2024-09-17T18:15:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00157413 2024-09-17T18:15:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 42/31 ECSubWrite(tid=87, reqid=client.4565.0:358, at_version=42'26, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.775695+0000", 2024-09-17T18:15:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.163688497000001, 2024-09-17T18:15:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013035743000000001, 2024-09-17T18:15:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775695+0000", 2024-09-17T18:15:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775695+0000", 2024-09-17T18:15:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775696+0000", 2024-09-17T18:15:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0699999999999997e-07 2024-09-17T18:15:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:48.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775753+0000", 2024-09-17T18:15:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7274000000000001e-05 2024-09-17T18:15:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775787+0000", 2024-09-17T18:15:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4102e-05 2024-09-17T18:15:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775810+0000", 2024-09-17T18:15:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3019000000000001e-05 2024-09-17T18:15:48.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775978+0000", 2024-09-17T18:15:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167546 2024-09-17T18:15:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.776002+0000", 2024-09-17T18:15:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4632000000000001e-05 2024-09-17T18:15:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788652+0000", 2024-09-17T18:15:48.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012649237000000001 2024-09-17T18:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788731+0000", 2024-09-17T18:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9425999999999995e-05 2024-09-17T18:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 42/31 ECSubWrite(tid=90, reqid=client.4565.0:359, at_version=42'27, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.775871+0000", 2024-09-17T18:15:48.953 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.163513081, 2024-09-17T18:15:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012923420999999999, 2024-09-17T18:15:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775871+0000", 2024-09-17T18:15:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:48.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775871+0000", 2024-09-17T18:15:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775872+0000", 2024-09-17T18:15:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0699999999999996e-07 2024-09-17T18:15:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775911+0000", 2024-09-17T18:15:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9221000000000003e-05 2024-09-17T18:15:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775936+0000", 2024-09-17T18:15:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5459000000000001e-05 2024-09-17T18:15:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775955+0000", 2024-09-17T18:15:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8998999999999999e-05 2024-09-17T18:15:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:48.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777777+0000", 2024-09-17T18:15:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001821135 2024-09-17T18:15:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777801+0000", 2024-09-17T18:15:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4122e-05 2024-09-17T18:15:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788743+0000", 2024-09-17T18:15:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010942383999999999 2024-09-17T18:15:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788794+0000", 2024-09-17T18:15:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1193999999999998e-05 2024-09-17T18:15:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 42/31 ECSubWrite(tid=92, reqid=client.4565.0:360, at_version=42'28, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.775988+0000", 2024-09-17T18:15:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.163396112999999, 2024-09-17T18:15:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012876787000000001, 2024-09-17T18:15:48.958 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775988+0000", 2024-09-17T18:15:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775988+0000", 2024-09-17T18:15:48.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775989+0000", 2024-09-17T18:15:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.08e-06 2024-09-17T18:15:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.776033+0000", 2024-09-17T18:15:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3857999999999999e-05 2024-09-17T18:15:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.776056+0000", 2024-09-17T18:15:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3691999999999999e-05 2024-09-17T18:15:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.776078+0000", 2024-09-17T18:15:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1265999999999999e-05 2024-09-17T18:15:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.779264+0000", 2024-09-17T18:15:48.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031865909999999999 2024-09-17T18:15:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.779283+0000", 2024-09-17T18:15:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8255000000000001e-05 2024-09-17T18:15:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788809+0000", 2024-09-17T18:15:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095260740000000007 2024-09-17T18:15:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788865+0000", 2024-09-17T18:15:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5971000000000003e-05 2024-09-17T18:15:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 42/31 ECSubWrite(tid=93, reqid=osd.4.0:93, at_version=42'30, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.777940+0000", 2024-09-17T18:15:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.161444161, 2024-09-17T18:15:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011561182999999999, 2024-09-17T18:15:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:48.963 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777940+0000", 2024-09-17T18:15:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777940+0000", 2024-09-17T18:15:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777941+0000", 2024-09-17T18:15:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1400000000000001e-06 2024-09-17T18:15:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777978+0000", 2024-09-17T18:15:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7509999999999998e-05 2024-09-17T18:15:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777997+0000", 2024-09-17T18:15:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8683999999999999e-05 2024-09-17T18:15:48.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.778010+0000", 2024-09-17T18:15:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2976000000000001e-05 2024-09-17T18:15:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.785277+0000", 2024-09-17T18:15:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072665289999999999 2024-09-17T18:15:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:48.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.785301+0000", 2024-09-17T18:15:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4579e-05 2024-09-17T18:15:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789423+0000", 2024-09-17T18:15:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041222949999999998 2024-09-17T18:15:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789501+0000", 2024-09-17T18:15:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7470000000000002e-05 2024-09-17T18:15:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.967 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 42/31 ECSubWrite(tid=96, reqid=osd.4.0:96, at_version=42'32, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.780330+0000", 2024-09-17T18:15:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.159053734, 2024-09-17T18:15:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010450348, 2024-09-17T18:15:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780330+0000", 2024-09-17T18:15:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780330+0000", 2024-09-17T18:15:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780332+0000", 2024-09-17T18:15:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.426e-06 2024-09-17T18:15:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780362+0000", 2024-09-17T18:15:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0756999999999997e-05 2024-09-17T18:15:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780391+0000", 2024-09-17T18:15:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.864e-05 2024-09-17T18:15:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780407+0000", 2024-09-17T18:15:48.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5784e-05 2024-09-17T18:15:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.786414+0000", 2024-09-17T18:15:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060069770000000001 2024-09-17T18:15:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.786436+0000", 2024-09-17T18:15:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2033000000000001e-05 2024-09-17T18:15:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.790707+0000", 2024-09-17T18:15:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042716220000000001 2024-09-17T18:15:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.790780+0000", 2024-09-17T18:15:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3108999999999994e-05 2024-09-17T18:15:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.972 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 42/31 ECSubWrite(tid=160, reqid=osd.13.0:160, at_version=42'69, trim_to=0'0, roll_forward_to=40'63))", 2024-09-17T18:15:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.793284+0000", 2024-09-17T18:15:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.146100111000001, 2024-09-17T18:15:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067334659999999996, 2024-09-17T18:15:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.793284+0000", 2024-09-17T18:15:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:48.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.793284+0000", 2024-09-17T18:15:48.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:48.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.793285+0000", 2024-09-17T18:15:48.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8400000000000002e-07 2024-09-17T18:15:48.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:48.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.793325+0000", 2024-09-17T18:15:48.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0398000000000002e-05 2024-09-17T18:15:48.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:48.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.793348+0000", 2024-09-17T18:15:48.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2792000000000001e-05 2024-09-17T18:15:48.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:48.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.793366+0000", 2024-09-17T18:15:48.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.804e-05 2024-09-17T18:15:48.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:48.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.793896+0000", 2024-09-17T18:15:48.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00053008199999999997 2024-09-17T18:15:48.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:48.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.793910+0000", 2024-09-17T18:15:48.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3553999999999999e-05 2024-09-17T18:15:48.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:48.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.799934+0000", 2024-09-17T18:15:48.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060242500000000001 2024-09-17T18:15:48.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:48.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.800017+0000", 2024-09-17T18:15:48.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3366000000000001e-05 2024-09-17T18:15:48.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.977 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:48.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.977 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 43/31 ECSubWrite(tid=105, reqid=osd.4.0:105, at_version=43'38, trim_to=0'0, roll_forward_to=42'34))", 2024-09-17T18:15:48.977 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.769850+0000", 2024-09-17T18:15:48.977 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.169533576999999, 2024-09-17T18:15:48.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083480640000000005, 2024-09-17T18:15:48.978 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:48.978 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:48.978 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:48.978 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:48.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:48.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.769850+0000", 2024-09-17T18:15:48.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:48.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.769850+0000", 2024-09-17T18:15:48.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:48.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.769852+0000", 2024-09-17T18:15:48.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7600000000000001e-06 2024-09-17T18:15:48.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:48.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.769908+0000", 2024-09-17T18:15:48.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6082000000000003e-05 2024-09-17T18:15:48.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:48.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.769984+0000", 2024-09-17T18:15:48.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5828999999999995e-05 2024-09-17T18:15:48.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:48.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.770007+0000", 2024-09-17T18:15:48.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3033000000000001e-05 2024-09-17T18:15:48.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:48.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.770609+0000", 2024-09-17T18:15:48.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00060163800000000004 2024-09-17T18:15:48.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:48.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.770648+0000", 2024-09-17T18:15:48.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9294e-05 2024-09-17T18:15:48.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:48.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778125+0000", 2024-09-17T18:15:48.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074772190000000002 2024-09-17T18:15:48.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:48.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778198+0000", 2024-09-17T18:15:48.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3208999999999997e-05 2024-09-17T18:15:48.982 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.982 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:48.982 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.982 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 43/31 ECSubWrite(tid=184, reqid=osd.13.0:184, at_version=43'81, trim_to=0'0, roll_forward_to=42'77))", 2024-09-17T18:15:48.982 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.778173+0000", 2024-09-17T18:15:48.982 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.161211215, 2024-09-17T18:15:48.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070539110000000004, 2024-09-17T18:15:48.982 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:48.983 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:48.983 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:48.983 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:48.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:48.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778173+0000", 2024-09-17T18:15:48.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:48.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778173+0000", 2024-09-17T18:15:48.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:48.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778174+0000", 2024-09-17T18:15:48.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.73e-06 2024-09-17T18:15:48.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:48.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778224+0000", 2024-09-17T18:15:48.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9923999999999998e-05 2024-09-17T18:15:48.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:48.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778249+0000", 2024-09-17T18:15:48.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4352e-05 2024-09-17T18:15:48.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:48.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778270+0000", 2024-09-17T18:15:48.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1475999999999999e-05 2024-09-17T18:15:48.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:48.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778451+0000", 2024-09-17T18:15:48.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181263 2024-09-17T18:15:48.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:48.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778485+0000", 2024-09-17T18:15:48.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3164000000000003e-05 2024-09-17T18:15:48.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:48.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.785141+0000", 2024-09-17T18:15:48.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066559829999999999 2024-09-17T18:15:48.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:48.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.785227+0000", 2024-09-17T18:15:48.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6019000000000004e-05 2024-09-17T18:15:48.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.987 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:48.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.987 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 43/31 ECSubWrite(tid=135, reqid=osd.6.0:135, at_version=43'19, trim_to=0'0, roll_forward_to=42'17))", 2024-09-17T18:15:48.987 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.778449+0000", 2024-09-17T18:15:48.987 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.160934556999999, 2024-09-17T18:15:48.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006812518, 2024-09-17T18:15:48.987 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:48.987 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:48.987 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:48.987 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:48.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:48.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778449+0000", 2024-09-17T18:15:48.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:48.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778449+0000", 2024-09-17T18:15:48.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:48.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778450+0000", 2024-09-17T18:15:48.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.13e-07 2024-09-17T18:15:48.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:48.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778501+0000", 2024-09-17T18:15:48.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1378000000000002e-05 2024-09-17T18:15:48.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:48.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778530+0000", 2024-09-17T18:15:48.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8428999999999998e-05 2024-09-17T18:15:48.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:48.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778549+0000", 2024-09-17T18:15:48.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9459000000000001e-05 2024-09-17T18:15:48.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:48.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778701+0000", 2024-09-17T18:15:48.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015145299999999999 2024-09-17T18:15:48.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:48.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778727+0000", 2024-09-17T18:15:48.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6018999999999999e-05 2024-09-17T18:15:48.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:48.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.785195+0000", 2024-09-17T18:15:48.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064685339999999997 2024-09-17T18:15:48.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:48.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.785262+0000", 2024-09-17T18:15:48.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6632999999999997e-05 2024-09-17T18:15:48.991 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.992 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:48.992 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.992 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 43/31 ECSubWrite(tid=136, reqid=osd.6.0:136, at_version=43'21, trim_to=0'0, roll_forward_to=42'17))", 2024-09-17T18:15:48.992 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.781138+0000", 2024-09-17T18:15:48.992 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.158246161999999, 2024-09-17T18:15:48.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088701509999999997, 2024-09-17T18:15:48.992 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:48.992 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:48.992 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:48.992 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:48.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:48.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781138+0000", 2024-09-17T18:15:48.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:48.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781138+0000", 2024-09-17T18:15:48.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:48.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781140+0000", 2024-09-17T18:15:48.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9400000000000001e-06 2024-09-17T18:15:48.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:48.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781194+0000", 2024-09-17T18:15:48.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4397000000000001e-05 2024-09-17T18:15:48.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:48.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781230+0000", 2024-09-17T18:15:48.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5995999999999999e-05 2024-09-17T18:15:48.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:48.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781253+0000", 2024-09-17T18:15:48.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3402000000000001e-05 2024-09-17T18:15:48.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:48.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781430+0000", 2024-09-17T18:15:48.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017692900000000001 2024-09-17T18:15:48.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:48.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781455+0000", 2024-09-17T18:15:48.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4579e-05 2024-09-17T18:15:48.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:48.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.789864+0000", 2024-09-17T18:15:48.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084094110000000003 2024-09-17T18:15:48.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:48.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.790008+0000", 2024-09-17T18:15:48.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143497 2024-09-17T18:15:48.996 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.996 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:48.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:48.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.997 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 43/31 ECSubWrite(tid=108, reqid=osd.4.0:105, at_version=0'0, trim_to=0'0, roll_forward_to=43'38))", 2024-09-17T18:15:48.997 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.784773+0000", 2024-09-17T18:15:48.997 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.154611228, 2024-09-17T18:15:48.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095347230000000002, 2024-09-17T18:15:48.997 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:48.997 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:48.997 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:48.997 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:48.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:48.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.784773+0000", 2024-09-17T18:15:48.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:48.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.784773+0000", 2024-09-17T18:15:48.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:48.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:48.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.784775+0000", 2024-09-17T18:15:48.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1069999999999999e-06 2024-09-17T18:15:48.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:48.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.784804+0000", 2024-09-17T18:15:48.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8992e-05 2024-09-17T18:15:48.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:48.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.784842+0000", 2024-09-17T18:15:48.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7789e-05 2024-09-17T18:15:48.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:48.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:48.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:48.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.784870+0000", 2024-09-17T18:15:48.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8208000000000002e-05 2024-09-17T18:15:49.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.785024+0000", 2024-09-17T18:15:49.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000154074 2024-09-17T18:15:49.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.785049+0000", 2024-09-17T18:15:49.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4719000000000002e-05 2024-09-17T18:15:49.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.794245+0000", 2024-09-17T18:15:49.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091964739999999996 2024-09-17T18:15:49.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.794307+0000", 2024-09-17T18:15:49.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2360000000000006e-05 2024-09-17T18:15:49.001 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.001 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.001 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.002 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 43/31 ECSubWrite(tid=109, reqid=osd.4.0:109, at_version=43'40, trim_to=0'0, roll_forward_to=43'38))", 2024-09-17T18:15:49.002 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.786711+0000", 2024-09-17T18:15:49.002 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.152673171, 2024-09-17T18:15:49.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010030938999999999, 2024-09-17T18:15:49.002 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.002 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.002 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:49.002 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786711+0000", 2024-09-17T18:15:49.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786711+0000", 2024-09-17T18:15:49.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786712+0000", 2024-09-17T18:15:49.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4279999999999999e-06 2024-09-17T18:15:49.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786752+0000", 2024-09-17T18:15:49.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0339999999999997e-05 2024-09-17T18:15:49.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786775+0000", 2024-09-17T18:15:49.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2657e-05 2024-09-17T18:15:49.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786794+0000", 2024-09-17T18:15:49.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9108999999999999e-05 2024-09-17T18:15:49.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786985+0000", 2024-09-17T18:15:49.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019076499999999999 2024-09-17T18:15:49.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.787010+0000", 2024-09-17T18:15:49.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4686e-05 2024-09-17T18:15:49.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.796653+0000", 2024-09-17T18:15:49.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096438080000000002 2024-09-17T18:15:49.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.796742+0000", 2024-09-17T18:15:49.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8146000000000006e-05 2024-09-17T18:15:49.006 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.006 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.006 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.006 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 43/31 ECSubWrite(tid=110, reqid=osd.4.0:110, at_version=43'42, trim_to=0'0, roll_forward_to=43'38))", 2024-09-17T18:15:49.006 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.787750+0000", 2024-09-17T18:15:49.006 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.151633834, 2024-09-17T18:15:49.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012045577999999999, 2024-09-17T18:15:49.007 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.007 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.007 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:49.007 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.787750+0000", 2024-09-17T18:15:49.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.787750+0000", 2024-09-17T18:15:49.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.787752+0000", 2024-09-17T18:15:49.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0760000000000001e-06 2024-09-17T18:15:49.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.787805+0000", 2024-09-17T18:15:49.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2507999999999999e-05 2024-09-17T18:15:49.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.787847+0000", 2024-09-17T18:15:49.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2345000000000002e-05 2024-09-17T18:15:49.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.787869+0000", 2024-09-17T18:15:49.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1849e-05 2024-09-17T18:15:49.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.794393+0000", 2024-09-17T18:15:49.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065246480000000001 2024-09-17T18:15:49.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.794413+0000", 2024-09-17T18:15:49.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9485999999999999e-05 2024-09-17T18:15:49.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.799702+0000", 2024-09-17T18:15:49.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052890699999999999 2024-09-17T18:15:49.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.799796+0000", 2024-09-17T18:15:49.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3596000000000003e-05 2024-09-17T18:15:49.011 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.011 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.011 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.011 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 43/31 ECSubWrite(tid=187, reqid=client.4565.0:365, at_version=43'83, trim_to=0'0, roll_forward_to=43'79))", 2024-09-17T18:15:49.011 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.797013+0000", 2024-09-17T18:15:49.011 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.142370714, 2024-09-17T18:15:49.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068672300000000002, 2024-09-17T18:15:49.011 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.012 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.012 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:49.012 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797013+0000", 2024-09-17T18:15:49.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797013+0000", 2024-09-17T18:15:49.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797015+0000", 2024-09-17T18:15:49.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2840000000000001e-06 2024-09-17T18:15:49.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797121+0000", 2024-09-17T18:15:49.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105405 2024-09-17T18:15:49.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797174+0000", 2024-09-17T18:15:49.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2800999999999998e-05 2024-09-17T18:15:49.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797197+0000", 2024-09-17T18:15:49.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2863000000000001e-05 2024-09-17T18:15:49.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797394+0000", 2024-09-17T18:15:49.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019730400000000001 2024-09-17T18:15:49.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797419+0000", 2024-09-17T18:15:49.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5029e-05 2024-09-17T18:15:49.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.803787+0000", 2024-09-17T18:15:49.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063680179999999996 2024-09-17T18:15:49.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.803880+0000", 2024-09-17T18:15:49.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3525999999999999e-05 2024-09-17T18:15:49.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.016 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.016 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 43/31 ECSubWrite(tid=189, reqid=osd.13.0:189, at_version=43'85, trim_to=0'0, roll_forward_to=43'81))", 2024-09-17T18:15:49.016 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.807401+0000", 2024-09-17T18:15:49.016 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.131982988000001, 2024-09-17T18:15:49.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074491890000000002, 2024-09-17T18:15:49.016 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.016 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.016 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:49.017 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807401+0000", 2024-09-17T18:15:49.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807401+0000", 2024-09-17T18:15:49.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807403+0000", 2024-09-17T18:15:49.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1330000000000002e-06 2024-09-17T18:15:49.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807495+0000", 2024-09-17T18:15:49.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.187e-05 2024-09-17T18:15:49.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807527+0000", 2024-09-17T18:15:49.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2072000000000001e-05 2024-09-17T18:15:49.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807562+0000", 2024-09-17T18:15:49.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5268999999999997e-05 2024-09-17T18:15:49.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807784+0000", 2024-09-17T18:15:49.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221936 2024-09-17T18:15:49.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807809+0000", 2024-09-17T18:15:49.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4868999999999999e-05 2024-09-17T18:15:49.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.814780+0000", 2024-09-17T18:15:49.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069705779999999998 2024-09-17T18:15:49.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.814850+0000", 2024-09-17T18:15:49.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0462000000000004e-05 2024-09-17T18:15:49.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.020 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.021 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 43/31 ECSubWrite(tid=190, reqid=osd.13.0:190, at_version=43'43, trim_to=0'0, roll_forward_to=42'39))", 2024-09-17T18:15:49.021 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.808722+0000", 2024-09-17T18:15:49.021 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.130662193999999, 2024-09-17T18:15:49.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063203759999999999, 2024-09-17T18:15:49.021 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.021 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.021 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:49.021 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.808722+0000", 2024-09-17T18:15:49.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.808722+0000", 2024-09-17T18:15:49.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.808723+0000", 2024-09-17T18:15:49.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.59e-06 2024-09-17T18:15:49.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.808789+0000", 2024-09-17T18:15:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5300000000000002e-05 2024-09-17T18:15:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.808815+0000", 2024-09-17T18:15:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6551999999999999e-05 2024-09-17T18:15:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.808836+0000", 2024-09-17T18:15:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1022999999999998e-05 2024-09-17T18:15:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.809215+0000", 2024-09-17T18:15:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037860999999999998 2024-09-17T18:15:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.809232+0000", 2024-09-17T18:15:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7294000000000001e-05 2024-09-17T18:15:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.814983+0000", 2024-09-17T18:15:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057511530000000002 2024-09-17T18:15:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.815042+0000", 2024-09-17T18:15:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8854000000000003e-05 2024-09-17T18:15:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.025 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 43/31 ECSubWrite(tid=191, reqid=osd.13.0:191, at_version=43'87, trim_to=0'0, roll_forward_to=43'81))", 2024-09-17T18:15:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.809886+0000", 2024-09-17T18:15:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.129498036999999, 2024-09-17T18:15:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010136275, 2024-09-17T18:15:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.809886+0000", 2024-09-17T18:15:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.809886+0000", 2024-09-17T18:15:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.809893+0000", 2024-09-17T18:15:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9659999999999999e-06 2024-09-17T18:15:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.809956+0000", 2024-09-17T18:15:49.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2836999999999995e-05 2024-09-17T18:15:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.809978+0000", 2024-09-17T18:15:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2436999999999999e-05 2024-09-17T18:15:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.809993+0000", 2024-09-17T18:15:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5335000000000001e-05 2024-09-17T18:15:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.810143+0000", 2024-09-17T18:15:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149887 2024-09-17T18:15:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.810163+0000", 2024-09-17T18:15:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9284e-05 2024-09-17T18:15:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.819955+0000", 2024-09-17T18:15:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0097923009999999998 2024-09-17T18:15:49.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.820022+0000", 2024-09-17T18:15:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7228000000000001e-05 2024-09-17T18:15:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 43/31 ECSubWrite(tid=112, reqid=osd.4.0:110, at_version=0'0, trim_to=0'0, roll_forward_to=43'42))", 2024-09-17T18:15:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.812167+0000", 2024-09-17T18:15:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.127216591, 2024-09-17T18:15:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077905739999999998, 2024-09-17T18:15:49.030 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812167+0000", 2024-09-17T18:15:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812167+0000", 2024-09-17T18:15:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812169+0000", 2024-09-17T18:15:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9659999999999999e-06 2024-09-17T18:15:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812195+0000", 2024-09-17T18:15:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5726000000000001e-05 2024-09-17T18:15:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812225+0000", 2024-09-17T18:15:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0352e-05 2024-09-17T18:15:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812248+0000", 2024-09-17T18:15:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2316000000000001e-05 2024-09-17T18:15:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812380+0000", 2024-09-17T18:15:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000132781 2024-09-17T18:15:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812399+0000", 2024-09-17T18:15:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8286000000000001e-05 2024-09-17T18:15:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.819899+0000", 2024-09-17T18:15:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075004049999999999 2024-09-17T18:15:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.819958+0000", 2024-09-17T18:15:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8742000000000001e-05 2024-09-17T18:15:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 53/31 ECSubWrite(tid=257, reqid=client.4565.0:476, at_version=53'120, trim_to=0'0, roll_forward_to=52'118))", 2024-09-17T18:15:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.419789+0000", 2024-09-17T18:15:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.51959492299999999, 2024-09-17T18:15:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070930430000000003, 2024-09-17T18:15:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.419789+0000", 2024-09-17T18:15:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.419789+0000", 2024-09-17T18:15:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.419791+0000", 2024-09-17T18:15:49.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-09-17T18:15:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.420124+0000", 2024-09-17T18:15:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033261500000000003 2024-09-17T18:15:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.420173+0000", 2024-09-17T18:15:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9317999999999998e-05 2024-09-17T18:15:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.420197+0000", 2024-09-17T18:15:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3459e-05 2024-09-17T18:15:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.420361+0000", 2024-09-17T18:15:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000164721 2024-09-17T18:15:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.420424+0000", 2024-09-17T18:15:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2508000000000005e-05 2024-09-17T18:15:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.426778+0000", 2024-09-17T18:15:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063538759999999996 2024-09-17T18:15:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.426882+0000", 2024-09-17T18:15:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010429600000000001 2024-09-17T18:15:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.039 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.039 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:49.041 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T18:15:49.042 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:49.037+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:49.142 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:49.139+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:49.170 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:49.171 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:49.171 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:15:49.171 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:49.185 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T18:15:49.243 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:49.241+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:49.307 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:49.307 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:49.307 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:15:49.308 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:15:49.308 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:49.310 INFO:tasks.rados.rados.0.smithi154.stdout:193: done (3 left) 2024-09-17T18:15:49.310 INFO:tasks.rados.rados.0.smithi154.stdout:194: rollback oid 11 current snap is 15 2024-09-17T18:15:49.310 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 11 to 3 2024-09-17T18:15:49.310 INFO:tasks.rados.rados.0.smithi154.stdout:190: finishing write tid 2 to smithi15432074-41 2024-09-17T18:15:49.310 INFO:tasks.rados.rados.0.smithi154.stdout:190: finishing write tid 3 to smithi15432074-41 2024-09-17T18:15:49.310 INFO:tasks.rados.rados.0.smithi154.stdout:192: finishing rollback tid 0 to smithi15432074-40 2024-09-17T18:15:49.310 INFO:tasks.rados.rados.0.smithi154.stdout:192: finishing rollback tid 1 to smithi15432074-40 2024-09-17T18:15:49.310 INFO:tasks.rados.rados.0.smithi154.stdout:190: finishing write tid 4 to smithi15432074-41 2024-09-17T18:15:49.311 INFO:tasks.rados.rados.0.smithi154.stdout:192: finishing rollback tid 2 to smithi15432074-40 2024-09-17T18:15:49.311 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 40 v 48 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-09-17T18:15:49.311 INFO:tasks.rados.rados.0.smithi154.stdout:190: finishing write tid 5 to smithi15432074-41 2024-09-17T18:15:49.311 INFO:tasks.rados.rados.0.smithi154.stdout:190: oid 41 updating version 0 to 131 2024-09-17T18:15:49.311 INFO:tasks.rados.rados.0.smithi154.stdout:190: oid 41 version 131 is already newer than 129 2024-09-17T18:15:49.311 INFO:tasks.rados.rados.0.smithi154.stdout:190: oid 41 version 131 is already newer than 130 2024-09-17T18:15:49.311 INFO:tasks.rados.rados.0.smithi154.stdout:190: oid 41 updating version 131 to 132 2024-09-17T18:15:49.311 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 41 v 132 (ObjNum 94 snap 15 seq_num 94) dirty exists 2024-09-17T18:15:49.311 INFO:tasks.rados.rados.0.smithi154.stdout:190: left oid 41 (ObjNum 94 snap 15 seq_num 94) 2024-09-17T18:15:49.311 INFO:tasks.rados.rados.0.smithi154.stdout:191: finishing rollback tid 0 to smithi15432074-24 2024-09-17T18:15:49.311 INFO:tasks.rados.rados.0.smithi154.stdout:191: finishing rollback tid 1 to smithi15432074-24 2024-09-17T18:15:49.311 INFO:tasks.rados.rados.0.smithi154.stdout:191: finishing rollback tid 2 to smithi15432074-24 2024-09-17T18:15:49.311 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 24 v 63 (ObjNum 67 snap 5 seq_num 67) dirty exists 2024-09-17T18:15:49.312 INFO:tasks.rados.rados.0.smithi154.stdout:190: done (3 left) 2024-09-17T18:15:49.312 INFO:tasks.rados.rados.0.smithi154.stdout:191: done (2 left) 2024-09-17T18:15:49.312 INFO:tasks.rados.rados.0.smithi154.stdout:192: done (1 left) 2024-09-17T18:15:49.312 INFO:tasks.rados.rados.0.smithi154.stdout:195: read oid 47 snap -1 2024-09-17T18:15:49.312 INFO:tasks.rados.rados.0.smithi154.stdout:195: expect (ObjNum 86 snap 14 seq_num 86) 2024-09-17T18:15:49.312 INFO:tasks.rados.rados.0.smithi154.stdout:196: copy_from oid 35 from oid 34 current snap is 15 2024-09-17T18:15:49.312 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 42 current snap is 15 2024-09-17T18:15:49.312 INFO:tasks.rados.rados.0.smithi154.stdout:197: seq_num 95 ranges {0=442368,442368=540672,983040=622592} 2024-09-17T18:15:49.316 INFO:tasks.rados.rados.0.smithi154.stdout:197: writing smithi15432074-42 from 0 to 442368 tid 1 2024-09-17T18:15:49.327 INFO:tasks.rados.rados.0.smithi154.stdout:197: writing smithi15432074-42 from 442368 to 983040 tid 2 2024-09-17T18:15:49.329 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T18:15:49.339 INFO:tasks.rados.rados.0.smithi154.stdout:197: writing smithi15432074-42 from 983040 to 1605632 tid 3 2024-09-17T18:15:49.339 INFO:tasks.rados.rados.0.smithi154.stdout:198: copy_from oid 7 from oid 49 current snap is 15 2024-09-17T18:15:49.339 INFO:tasks.rados.rados.0.smithi154.stdout:194: finishing rollback tid 0 to smithi15432074-11 2024-09-17T18:15:49.339 INFO:tasks.rados.rados.0.smithi154.stdout:194: finishing rollback tid 1 to smithi15432074-11 2024-09-17T18:15:49.340 INFO:tasks.rados.rados.0.smithi154.stdout:194: finishing rollback tid 2 to smithi15432074-11 2024-09-17T18:15:49.340 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 11 v 73 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-09-17T18:15:49.341 INFO:tasks.rados.rados.0.smithi154.stdout:194: done (4 left) 2024-09-17T18:15:49.341 INFO:tasks.rados.rados.0.smithi154.stdout:199: setattr oid 37 current snap is 15 2024-09-17T18:15:49.341 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:49.338+0000 7f15fac93640 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9 after trimming was started 2024-09-17T18:15:49.343 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:49.342+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:49.348 INFO:tasks.rados.rados.0.smithi154.stdout:197: finishing write tid 1 to smithi15432074-42 2024-09-17T18:15:49.354 INFO:tasks.rados.rados.0.smithi154.stdout:200: rollback oid 20 current snap is 15 2024-09-17T18:15:49.354 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 20 to 8 2024-09-17T18:15:49.354 INFO:tasks.rados.rados.0.smithi154.stdout:201: setattr oid 36 current snap is 15 2024-09-17T18:15:49.355 INFO:tasks.rados.rados.0.smithi154.stdout:195: expect (ObjNum 86 snap 14 seq_num 86) 2024-09-17T18:15:49.355 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:49.393 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 970914 2024-09-17T18:15:49.405 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:49.429 INFO:tasks.rados.rados.0.smithi154.stdout:196: finishing copy_from racing read to smithi15432074-35 2024-09-17T18:15:49.430 INFO:tasks.rados.rados.0.smithi154.stdout:197: finishing write tid 2 to smithi15432074-42 2024-09-17T18:15:49.430 INFO:tasks.rados.rados.0.smithi154.stdout:200: finishing rollback tid 0 to smithi15432074-20 2024-09-17T18:15:49.430 INFO:tasks.rados.rados.0.smithi154.stdout:200: finishing rollback tid 1 to smithi15432074-20 2024-09-17T18:15:49.430 INFO:tasks.rados.rados.0.smithi154.stdout:200: finishing rollback tid 2 to smithi15432074-20 2024-09-17T18:15:49.430 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 20 v 68 (ObjNum 54 snap 0 seq_num 54) dirty exists 2024-09-17T18:15:49.430 INFO:tasks.rados.rados.0.smithi154.stdout:196: finishing copy_from to smithi15432074-35 2024-09-17T18:15:49.430 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 35 v 49 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-09-17T18:15:49.430 INFO:tasks.rados.rados.0.smithi154.stdout:197: finishing write tid 3 to smithi15432074-42 2024-09-17T18:15:49.430 INFO:tasks.rados.rados.0.smithi154.stdout:197: finishing write tid 4 to smithi15432074-42 2024-09-17T18:15:49.430 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 37 v 142 (ObjNum 71 snap 5 seq_num 71) dirty exists 2024-09-17T18:15:49.430 INFO:tasks.rados.rados.0.smithi154.stdout:197: finishing write tid 5 to smithi15432074-42 2024-09-17T18:15:49.430 INFO:tasks.rados.rados.0.smithi154.stdout:197: oid 42 updating version 0 to 32 2024-09-17T18:15:49.431 INFO:tasks.rados.rados.0.smithi154.stdout:197: oid 42 version 32 is already newer than 29 2024-09-17T18:15:49.431 INFO:tasks.rados.rados.0.smithi154.stdout:197: oid 42 updating version 32 to 33 2024-09-17T18:15:49.431 INFO:tasks.rados.rados.0.smithi154.stdout:197: oid 42 updating version 33 to 34 2024-09-17T18:15:49.431 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 42 v 34 (ObjNum 95 snap 15 seq_num 95) dirty exists 2024-09-17T18:15:49.431 INFO:tasks.rados.rados.0.smithi154.stdout:197: left oid 42 (ObjNum 95 snap 15 seq_num 95) 2024-09-17T18:15:49.431 INFO:tasks.rados.rados.0.smithi154.stdout:198: finishing copy_from racing read to smithi15432074-7 2024-09-17T18:15:49.431 INFO:tasks.rados.rados.0.smithi154.stdout:198: finishing copy_from to smithi15432074-7 2024-09-17T18:15:49.431 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 7 v 28 (ObjNum 90 snap 15 seq_num 90) dirty exists 2024-09-17T18:15:49.431 INFO:tasks.rados.rados.0.smithi154.stdout:195: done (6 left) 2024-09-17T18:15:49.431 INFO:tasks.rados.rados.0.smithi154.stdout:196: done (5 left) 2024-09-17T18:15:49.431 INFO:tasks.rados.rados.0.smithi154.stdout:197: done (4 left) 2024-09-17T18:15:49.431 INFO:tasks.rados.rados.0.smithi154.stdout:198: done (3 left) 2024-09-17T18:15:49.431 INFO:tasks.rados.rados.0.smithi154.stdout:199: done (2 left) 2024-09-17T18:15:49.431 INFO:tasks.rados.rados.0.smithi154.stdout:200: done (1 left) 2024-09-17T18:15:49.432 INFO:tasks.rados.rados.0.smithi154.stdout:202: delete oid 44 current snap is 15 2024-09-17T18:15:49.433 INFO:tasks.rados.rados.0.smithi154.stdout:202: done (1 left) 2024-09-17T18:15:49.434 INFO:tasks.rados.rados.0.smithi154.stdout:203: snap_create 2024-09-17T18:15:49.437 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 36 v 54 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-09-17T18:15:49.444 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:49.443+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:15:49.461 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:49.461 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:15:49.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:15:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:15:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:242 3.cs0 3:38dc802b:::smithi15432074-44:head [rollback 4] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-17T18:15:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.703819+0000", 2024-09-17T18:15:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.754465761999999, 2024-09-17T18:15:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009696128, 2024-09-17T18:15:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 242 2024-09-17T18:15:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703819+0000", 2024-09-17T18:15:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703819+0000", 2024-09-17T18:15:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703819+0000", 2024-09-17T18:15:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1900000000000002e-07 2024-09-17T18:15:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703823+0000", 2024-09-17T18:15:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8879999999999999e-06 2024-09-17T18:15:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703833+0000", 2024-09-17T18:15:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4930000000000004e-06 2024-09-17T18:15:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703839+0000", 2024-09-17T18:15:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8050000000000001e-06 2024-09-17T18:15:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.705861+0000", 2024-09-17T18:15:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002021517 2024-09-17T18:15:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.705950+0000", 2024-09-17T18:15:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9370999999999995e-05 2024-09-17T18:15:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.706557+0000", 2024-09-17T18:15:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00060676800000000004 2024-09-17T18:15:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707971+0000", 2024-09-17T18:15:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014141519999999999 2024-09-17T18:15:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713458+0000", 2024-09-17T18:15:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054867010000000001 2024-09-17T18:15:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713515+0000", 2024-09-17T18:15:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6713999999999999e-05 2024-09-17T18:15:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:243 3.cs0 3:38dc802b:::smithi15432074-44:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-17T18:15:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:32.703851+0000", 2024-09-17T18:15:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.754433536000001, 2024-09-17T18:15:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0098715450000000007, 2024-09-17T18:15:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 243 2024-09-17T18:15:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703851+0000", 2024-09-17T18:15:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703851+0000", 2024-09-17T18:15:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703851+0000", 2024-09-17T18:15:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8999999999999996e-07 2024-09-17T18:15:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703856+0000", 2024-09-17T18:15:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6670000000000004e-06 2024-09-17T18:15:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703864+0000", 2024-09-17T18:15:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2300000000000008e-06 2024-09-17T18:15:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.703874+0000", 2024-09-17T18:15:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7559999999999994e-06 2024-09-17T18:15:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.706992+0000", 2024-09-17T18:15:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031183679999999998 2024-09-17T18:15:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707095+0000", 2024-09-17T18:15:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102736 2024-09-17T18:15:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.707589+0000", 2024-09-17T18:15:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049381200000000005 2024-09-17T18:15:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.708440+0000", 2024-09-17T18:15:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00085066600000000003 2024-09-17T18:15:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713642+0000", 2024-09-17T18:15:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052026970000000001 2024-09-17T18:15:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:32.713722+0000", 2024-09-17T18:15:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9923e-05 2024-09-17T18:15:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:263 3.5s0 3:a2c8c783:::smithi15432074-23:head [append 0~0] snapc 5=[5,4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:15:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:33.724100+0000", 2024-09-17T18:15:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.734184278000001, 2024-09-17T18:15:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090493069999999995, 2024-09-17T18:15:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 263 2024-09-17T18:15:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.724100+0000", 2024-09-17T18:15:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.724100+0000", 2024-09-17T18:15:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.724101+0000", 2024-09-17T18:15:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-07 2024-09-17T18:15:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.724104+0000", 2024-09-17T18:15:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.777e-06 2024-09-17T18:15:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.724116+0000", 2024-09-17T18:15:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1348e-05 2024-09-17T18:15:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.724128+0000", 2024-09-17T18:15:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.198e-05 2024-09-17T18:15:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728838+0000", 2024-09-17T18:15:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047105630000000001 2024-09-17T18:15:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.728978+0000", 2024-09-17T18:15:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013925 2024-09-17T18:15:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.729612+0000", 2024-09-17T18:15:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00063426699999999999 2024-09-17T18:15:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.730686+0000", 2024-09-17T18:15:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010736529999999999 2024-09-17T18:15:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.733056+0000", 2024-09-17T18:15:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023705750000000002 2024-09-17T18:15:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:33.733149+0000", 2024-09-17T18:15:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3233999999999995e-05 2024-09-17T18:15:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:361 3.cs0 3:38dc802b:::smithi15432074-44:head [copy-from ver 19] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764426+0000", 2024-09-17T18:15:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.693858093999999, 2024-09-17T18:15:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059937576999999999, 2024-09-17T18:15:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 361 2024-09-17T18:15:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764426+0000", 2024-09-17T18:15:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764426+0000", 2024-09-17T18:15:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764430+0000", 2024-09-17T18:15:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1930000000000003e-06 2024-09-17T18:15:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764447+0000", 2024-09-17T18:15:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6461999999999999e-05 2024-09-17T18:15:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764481+0000", 2024-09-17T18:15:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3905999999999997e-05 2024-09-17T18:15:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764498+0000", 2024-09-17T18:15:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7102e-05 2024-09-17T18:15:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764652+0000", 2024-09-17T18:15:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015383000000000001 2024-09-17T18:15:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:15:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764670+0000", 2024-09-17T18:15:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7946000000000001e-05 2024-09-17T18:15:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.769352+0000", 2024-09-17T18:15:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046824400000000004 2024-09-17T18:15:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.769609+0000", 2024-09-17T18:15:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025651899999999997 2024-09-17T18:15:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.818303+0000", 2024-09-17T18:15:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048694505999999999 2024-09-17T18:15:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.823809+0000", 2024-09-17T18:15:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055063359999999997 2024-09-17T18:15:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.824248+0000", 2024-09-17T18:15:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043867 2024-09-17T18:15:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.824364+0000", 2024-09-17T18:15:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115667 2024-09-17T18:15:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:362 3.cs0 3:38dc802b:::smithi15432074-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764538+0000", 2024-09-17T18:15:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.693746299000001, 2024-09-17T18:15:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058448629000000002, 2024-09-17T18:15:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 362 2024-09-17T18:15:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764538+0000", 2024-09-17T18:15:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764538+0000", 2024-09-17T18:15:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764540+0000", 2024-09-17T18:15:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.556e-06 2024-09-17T18:15:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764548+0000", 2024-09-17T18:15:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-17T18:15:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764570+0000", 2024-09-17T18:15:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2093e-05 2024-09-17T18:15:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764587+0000", 2024-09-17T18:15:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7048999999999999e-05 2024-09-17T18:15:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764835+0000", 2024-09-17T18:15:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024845899999999997 2024-09-17T18:15:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:49.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764853+0000", 2024-09-17T18:15:49.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7452000000000002e-05 2024-09-17T18:15:49.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.771487+0000", 2024-09-17T18:15:49.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066343749999999996 2024-09-17T18:15:49.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-09-17T18:15:49.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.771582+0000", 2024-09-17T18:15:49.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5038999999999996e-05 2024-09-17T18:15:49.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.822681+0000", 2024-09-17T18:15:49.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.051098466000000002 2024-09-17T18:15:49.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:49.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.822841+0000", 2024-09-17T18:15:49.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016044 2024-09-17T18:15:49.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.822987+0000", 2024-09-17T18:15:49.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145597 2024-09-17T18:15:49.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.492 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.492 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 42/31 ECSubWrite(tid=40, reqid=client.4565.0:363, at_version=42'26, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:15:49.492 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.767243+0000", 2024-09-17T18:15:49.492 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.691041540000001, 2024-09-17T18:15:49.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014866835, 2024-09-17T18:15:49.492 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.492 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.493 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:49.493 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767243+0000", 2024-09-17T18:15:49.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767243+0000", 2024-09-17T18:15:49.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767243+0000", 2024-09-17T18:15:49.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9299999999999998e-07 2024-09-17T18:15:49.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767281+0000", 2024-09-17T18:15:49.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7279e-05 2024-09-17T18:15:49.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767303+0000", 2024-09-17T18:15:49.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2575e-05 2024-09-17T18:15:49.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767319+0000", 2024-09-17T18:15:49.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5536000000000002e-05 2024-09-17T18:15:49.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767527+0000", 2024-09-17T18:15:49.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000208531 2024-09-17T18:15:49.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767551+0000", 2024-09-17T18:15:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4046e-05 2024-09-17T18:15:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.782022+0000", 2024-09-17T18:15:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014470518999999999 2024-09-17T18:15:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.782110+0000", 2024-09-17T18:15:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7855999999999994e-05 2024-09-17T18:15:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.497 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 42/31 ECSubWrite(tid=41, reqid=osd.7.0:41, at_version=42'28, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:15:49.497 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.772706+0000", 2024-09-17T18:15:49.497 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.685578783, 2024-09-17T18:15:49.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094777049999999995, 2024-09-17T18:15:49.497 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.497 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.497 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:49.497 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772706+0000", 2024-09-17T18:15:49.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772706+0000", 2024-09-17T18:15:49.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772707+0000", 2024-09-17T18:15:49.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.08e-06 2024-09-17T18:15:49.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772732+0000", 2024-09-17T18:15:49.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5885e-05 2024-09-17T18:15:49.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772745+0000", 2024-09-17T18:15:49.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2741e-05 2024-09-17T18:15:49.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772756+0000", 2024-09-17T18:15:49.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1032999999999999e-05 2024-09-17T18:15:49.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772878+0000", 2024-09-17T18:15:49.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122187 2024-09-17T18:15:49.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772891+0000", 2024-09-17T18:15:49.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2763e-05 2024-09-17T18:15:49.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.782122+0000", 2024-09-17T18:15:49.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092306850000000006 2024-09-17T18:15:49.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.782183+0000", 2024-09-17T18:15:49.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1330999999999999e-05 2024-09-17T18:15:49.501 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.501 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.502 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.502 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s4 42/31 ECSubWrite(tid=20, reqid=osd.14.0:20, at_version=42'16, trim_to=0'0, roll_forward_to=39'12))", 2024-09-17T18:15:49.502 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.785888+0000", 2024-09-17T18:15:49.502 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.672396728000001, 2024-09-17T18:15:49.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009720055, 2024-09-17T18:15:49.502 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.502 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.502 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:49.502 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.785888+0000", 2024-09-17T18:15:49.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.785888+0000", 2024-09-17T18:15:49.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.785889+0000", 2024-09-17T18:15:49.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.81e-06 2024-09-17T18:15:49.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.785943+0000", 2024-09-17T18:15:49.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3631000000000002e-05 2024-09-17T18:15:49.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.785974+0000", 2024-09-17T18:15:49.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0815999999999998e-05 2024-09-17T18:15:49.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.785997+0000", 2024-09-17T18:15:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3572000000000001e-05 2024-09-17T18:15:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.786096+0000", 2024-09-17T18:15:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8439999999999999e-05 2024-09-17T18:15:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.786108+0000", 2024-09-17T18:15:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2587e-05 2024-09-17T18:15:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.795551+0000", 2024-09-17T18:15:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094428329999999994 2024-09-17T18:15:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.795608+0000", 2024-09-17T18:15:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6366000000000002e-05 2024-09-17T18:15:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 42/31 ECSubWrite(tid=45, reqid=osd.7.0:45, at_version=42'32, trim_to=0'0, roll_forward_to=42'30))", 2024-09-17T18:15:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.797590+0000", 2024-09-17T18:15:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.660694201, 2024-09-17T18:15:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010515893, 2024-09-17T18:15:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797590+0000", 2024-09-17T18:15:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797590+0000", 2024-09-17T18:15:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797592+0000", 2024-09-17T18:15:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.767e-06 2024-09-17T18:15:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797642+0000", 2024-09-17T18:15:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0553999999999997e-05 2024-09-17T18:15:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797676+0000", 2024-09-17T18:15:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3287999999999997e-05 2024-09-17T18:15:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797704+0000", 2024-09-17T18:15:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8632999999999998e-05 2024-09-17T18:15:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797821+0000", 2024-09-17T18:15:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011641699999999999 2024-09-17T18:15:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797835+0000", 2024-09-17T18:15:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3947e-05 2024-09-17T18:15:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.808015+0000", 2024-09-17T18:15:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010180708 2024-09-17T18:15:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.808106+0000", 2024-09-17T18:15:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0579000000000001e-05 2024-09-17T18:15:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s4 43/31 ECSubWrite(tid=21, reqid=osd.0.0:20, at_version=0'0, trim_to=0'0, roll_forward_to=43'12))", 2024-09-17T18:15:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.791776+0000", 2024-09-17T18:15:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.666507808, 2024-09-17T18:15:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010331819000000001, 2024-09-17T18:15:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791776+0000", 2024-09-17T18:15:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791776+0000", 2024-09-17T18:15:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791778+0000", 2024-09-17T18:15:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.026e-06 2024-09-17T18:15:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791799+0000", 2024-09-17T18:15:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1965999999999999e-05 2024-09-17T18:15:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791827+0000", 2024-09-17T18:15:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7752000000000001e-05 2024-09-17T18:15:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791852+0000", 2024-09-17T18:15:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4318999999999999e-05 2024-09-17T18:15:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.792109+0000", 2024-09-17T18:15:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025731300000000001 2024-09-17T18:15:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.792134+0000", 2024-09-17T18:15:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5289000000000001e-05 2024-09-17T18:15:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.802016+0000", 2024-09-17T18:15:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0098818440000000007 2024-09-17T18:15:49.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.802108+0000", 2024-09-17T18:15:49.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2310000000000002e-05 2024-09-17T18:15:49.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.516 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.516 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 43/31 ECSubWrite(tid=47, reqid=osd.7.0:47, at_version=43'34, trim_to=0'0, roll_forward_to=42'32))", 2024-09-17T18:15:49.516 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.793606+0000", 2024-09-17T18:15:49.516 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.664677963000001, 2024-09-17T18:15:49.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095677650000000006, 2024-09-17T18:15:49.517 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.517 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.517 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:49.517 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793606+0000", 2024-09-17T18:15:49.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793606+0000", 2024-09-17T18:15:49.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793607+0000", 2024-09-17T18:15:49.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7000000000000005e-07 2024-09-17T18:15:49.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793661+0000", 2024-09-17T18:15:49.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4280999999999997e-05 2024-09-17T18:15:49.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793690+0000", 2024-09-17T18:15:49.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8949e-05 2024-09-17T18:15:49.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793712+0000", 2024-09-17T18:15:49.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1999000000000001e-05 2024-09-17T18:15:49.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793831+0000", 2024-09-17T18:15:49.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011900699999999999 2024-09-17T18:15:49.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793848+0000", 2024-09-17T18:15:49.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6852999999999999e-05 2024-09-17T18:15:49.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.803070+0000", 2024-09-17T18:15:49.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092216299999999998 2024-09-17T18:15:49.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.803174+0000", 2024-09-17T18:15:49.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010447599999999999 2024-09-17T18:15:49.524 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.525 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.525 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.525 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 43/31 ECSubWrite(tid=48, reqid=osd.7.0:48, at_version=43'36, trim_to=0'0, roll_forward_to=42'32))", 2024-09-17T18:15:49.526 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.793759+0000", 2024-09-17T18:15:49.527 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.664525506, 2024-09-17T18:15:49.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01017883, 2024-09-17T18:15:49.527 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.527 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:49.527 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793759+0000", 2024-09-17T18:15:49.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793759+0000", 2024-09-17T18:15:49.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793760+0000", 2024-09-17T18:15:49.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5000000000000001e-07 2024-09-17T18:15:49.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793801+0000", 2024-09-17T18:15:49.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0781999999999997e-05 2024-09-17T18:15:49.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793823+0000", 2024-09-17T18:15:49.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2319000000000001e-05 2024-09-17T18:15:49.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793840+0000", 2024-09-17T18:15:49.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7354999999999999e-05 2024-09-17T18:15:49.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797458+0000", 2024-09-17T18:15:49.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036173360000000001 2024-09-17T18:15:49.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797473+0000", 2024-09-17T18:15:49.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5743000000000002e-05 2024-09-17T18:15:49.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.803865+0000", 2024-09-17T18:15:49.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063914929999999998 2024-09-17T18:15:49.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.803938+0000", 2024-09-17T18:15:49.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2852e-05 2024-09-17T18:15:49.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.531 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:470 3.5s0 3:a2c8c783:::smithi15432074-23:head [append 0~770048] snapc 10=[10,e,d,c,b,a,9,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:15:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.394208+0000", 2024-09-17T18:15:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.0640761190000001, 2024-09-17T18:15:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013112441000000001, 2024-09-17T18:15:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 470 2024-09-17T18:15:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.394208+0000", 2024-09-17T18:15:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.394208+0000", 2024-09-17T18:15:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.394212+0000", 2024-09-17T18:15:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.783e-06 2024-09-17T18:15:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.396103+0000", 2024-09-17T18:15:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001890536 2024-09-17T18:15:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.396139+0000", 2024-09-17T18:15:49.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6452000000000003e-05 2024-09-17T18:15:49.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.396162+0000", 2024-09-17T18:15:49.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.321e-05 2024-09-17T18:15:49.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.396348+0000", 2024-09-17T18:15:49.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000185627 2024-09-17T18:15:49.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:49.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.396612+0000", 2024-09-17T18:15:49.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026402400000000002 2024-09-17T18:15:49.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.399779+0000", 2024-09-17T18:15:49.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003167034 2024-09-17T18:15:49.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.406389+0000", 2024-09-17T18:15:49.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066103330000000004 2024-09-17T18:15:49.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:49.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.407075+0000", 2024-09-17T18:15:49.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00068585399999999996 2024-09-17T18:15:49.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.407321+0000", 2024-09-17T18:15:49.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024558799999999998 2024-09-17T18:15:49.538 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.538 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.538 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.539 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:471 3.5s0 3:a2c8c783:::smithi15432074-23:head [append 0~475136] snapc 10=[10,e,d,c,b,a,9,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:15:49.539 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.398508+0000", 2024-09-17T18:15:49.539 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.0597762669999999, 2024-09-17T18:15:49.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015127979, 2024-09-17T18:15:49.539 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.539 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.539 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:49.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:49.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:49.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:49.539 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 471 2024-09-17T18:15:49.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.540 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.398508+0000", 2024-09-17T18:15:49.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.398508+0000", 2024-09-17T18:15:49.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.398511+0000", 2024-09-17T18:15:49.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1499999999999999e-06 2024-09-17T18:15:49.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.401134+0000", 2024-09-17T18:15:49.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026232780000000002 2024-09-17T18:15:49.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.401166+0000", 2024-09-17T18:15:49.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1068999999999997e-05 2024-09-17T18:15:49.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.401188+0000", 2024-09-17T18:15:49.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2138999999999999e-05 2024-09-17T18:15:49.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402672+0000", 2024-09-17T18:15:49.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014845800000000001 2024-09-17T18:15:49.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:49.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402945+0000", 2024-09-17T18:15:49.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027317999999999998 2024-09-17T18:15:49.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.404772+0000", 2024-09-17T18:15:49.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018261589999999999 2024-09-17T18:15:49.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.407924+0000", 2024-09-17T18:15:49.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003152434 2024-09-17T18:15:49.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:49.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.413412+0000", 2024-09-17T18:15:49.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054877520000000003 2024-09-17T18:15:49.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.413636+0000", 2024-09-17T18:15:49.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000224238 2024-09-17T18:15:49.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.545 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.545 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:472 3.5s0 3:a2c8c783:::smithi15432074-23:head [append 0~294912] snapc 10=[10,e,d,c,b,a,9,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:15:49.545 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.401285+0000", 2024-09-17T18:15:49.545 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.056998911, 2024-09-17T18:15:49.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013531102999999999, 2024-09-17T18:15:49.545 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.546 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.546 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:49.546 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:49.546 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:49.546 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:49.546 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 472 2024-09-17T18:15:49.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.546 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.401285+0000", 2024-09-17T18:15:49.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.401285+0000", 2024-09-17T18:15:49.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.401309+0000", 2024-09-17T18:15:49.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3693000000000002e-05 2024-09-17T18:15:49.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402070+0000", 2024-09-17T18:15:49.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00076068700000000002 2024-09-17T18:15:49.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402110+0000", 2024-09-17T18:15:49.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0669e-05 2024-09-17T18:15:49.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402131+0000", 2024-09-17T18:15:49.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0632000000000002e-05 2024-09-17T18:15:49.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.408140+0000", 2024-09-17T18:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060090309999999997 2024-09-17T18:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.408291+0000", 2024-09-17T18:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015131399999999999 2024-09-17T18:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.409479+0000", 2024-09-17T18:15:49.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001187958 2024-09-17T18:15:49.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.413958+0000", 2024-09-17T18:15:49.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044783720000000004 2024-09-17T18:15:49.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.414668+0000", 2024-09-17T18:15:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00071016199999999997 2024-09-17T18:15:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.414816+0000", 2024-09-17T18:15:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014858499999999999 2024-09-17T18:15:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:473 3.5s0 3:a2c8c783:::smithi15432074-23:head [setxattr _header (57) in=7b] snapc 10=[10,e,d,c,b,a,9,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:15:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.402167+0000", 2024-09-17T18:15:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.0561171869999999, 2024-09-17T18:15:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017279360000000001, 2024-09-17T18:15:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 473 2024-09-17T18:15:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402167+0000", 2024-09-17T18:15:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402167+0000", 2024-09-17T18:15:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402169+0000", 2024-09-17T18:15:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.916e-06 2024-09-17T18:15:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402190+0000", 2024-09-17T18:15:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1223e-05 2024-09-17T18:15:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402216+0000", 2024-09-17T18:15:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5309000000000001e-05 2024-09-17T18:15:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402231+0000", 2024-09-17T18:15:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5509e-05 2024-09-17T18:15:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.410884+0000", 2024-09-17T18:15:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0086531990000000003 2024-09-17T18:15:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.411174+0000", 2024-09-17T18:15:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028940299999999998 2024-09-17T18:15:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.412548+0000", 2024-09-17T18:15:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001374754 2024-09-17T18:15:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.413961+0000", 2024-09-17T18:15:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014127390000000001 2024-09-17T18:15:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.419201+0000", 2024-09-17T18:15:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052399170000000002 2024-09-17T18:15:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.419446+0000", 2024-09-17T18:15:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024539100000000002 2024-09-17T18:15:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:474 3.5s0 3:a2c8c783:::smithi15432074-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:15:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.402261+0000", 2024-09-17T18:15:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.0560235010000001, 2024-09-17T18:15:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023005754, 2024-09-17T18:15:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 474 2024-09-17T18:15:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402261+0000", 2024-09-17T18:15:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402261+0000", 2024-09-17T18:15:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402262+0000", 2024-09-17T18:15:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4899999999999999e-06 2024-09-17T18:15:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402269+0000", 2024-09-17T18:15:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-17T18:15:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402292+0000", 2024-09-17T18:15:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3223000000000001e-05 2024-09-17T18:15:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402307+0000", 2024-09-17T18:15:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4698999999999999e-05 2024-09-17T18:15:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.414926+0000", 2024-09-17T18:15:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012618704999999999 2024-09-17T18:15:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-17T18:15:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.415062+0000", 2024-09-17T18:15:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135962 2024-09-17T18:15:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.421765+0000", 2024-09-17T18:15:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006702871 2024-09-17T18:15:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.422025+0000", 2024-09-17T18:15:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026092800000000001 2024-09-17T18:15:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.425267+0000", 2024-09-17T18:15:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032411229999999998 2024-09-17T18:15:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:486 3.cs0 3:38dc802b:::smithi15432074-44:head [rollback d] snapc 10=[10,e,d,c,b,a,9,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:15:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.495733+0000", 2024-09-17T18:15:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.96255124199999997, 2024-09-17T18:15:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010914418, 2024-09-17T18:15:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 486 2024-09-17T18:15:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495733+0000", 2024-09-17T18:15:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495733+0000", 2024-09-17T18:15:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495734+0000", 2024-09-17T18:15:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2899999999999999e-06 2024-09-17T18:15:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495742+0000", 2024-09-17T18:15:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.17e-06 2024-09-17T18:15:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495761+0000", 2024-09-17T18:15:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9619e-05 2024-09-17T18:15:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495776+0000", 2024-09-17T18:15:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5143000000000001e-05 2024-09-17T18:15:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.498331+0000", 2024-09-17T18:15:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025548799999999998 2024-09-17T18:15:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.498583+0000", 2024-09-17T18:15:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025148500000000002 2024-09-17T18:15:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.499883+0000", 2024-09-17T18:15:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013001429999999999 2024-09-17T18:15:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.504350+0000", 2024-09-17T18:15:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044670359999999997 2024-09-17T18:15:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.506595+0000", 2024-09-17T18:15:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002244855 2024-09-17T18:15:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.506647+0000", 2024-09-17T18:15:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2797000000000003e-05 2024-09-17T18:15:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:487 3.cs0 3:38dc802b:::smithi15432074-44:head [append 0~0] snapc 10=[10,e,d,c,b,a,9,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:15:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.495799+0000", 2024-09-17T18:15:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.96248540800000004, 2024-09-17T18:15:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011588322, 2024-09-17T18:15:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 487 2024-09-17T18:15:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495799+0000", 2024-09-17T18:15:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495799+0000", 2024-09-17T18:15:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495800+0000", 2024-09-17T18:15:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.217e-06 2024-09-17T18:15:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495809+0000", 2024-09-17T18:15:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5429999999999994e-06 2024-09-17T18:15:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495825+0000", 2024-09-17T18:15:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6646e-05 2024-09-17T18:15:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495838+0000", 2024-09-17T18:15:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2927e-05 2024-09-17T18:15:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.500688+0000", 2024-09-17T18:15:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048501630000000002 2024-09-17T18:15:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.500829+0000", 2024-09-17T18:15:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014030100000000001 2024-09-17T18:15:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.501524+0000", 2024-09-17T18:15:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00069572299999999998 2024-09-17T18:15:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.506771+0000", 2024-09-17T18:15:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052469500000000002 2024-09-17T18:15:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.506866+0000", 2024-09-17T18:15:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4309999999999997e-05 2024-09-17T18:15:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.507387+0000", 2024-09-17T18:15:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00052154199999999995 2024-09-17T18:15:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:500 3.cs0 3:3e0a97af:::smithi15432074-40:head [append 0~0] snapc 10=[10,e,d,c,b,a,9,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:15:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.520851+0000", 2024-09-17T18:15:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.93743370000000004, 2024-09-17T18:15:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011797518, 2024-09-17T18:15:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 500 2024-09-17T18:15:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.520851+0000", 2024-09-17T18:15:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.520851+0000", 2024-09-17T18:15:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.520851+0000", 2024-09-17T18:15:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2200000000000003e-07 2024-09-17T18:15:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.520855+0000", 2024-09-17T18:15:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6899999999999998e-06 2024-09-17T18:15:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.520863+0000", 2024-09-17T18:15:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2619999999999998e-06 2024-09-17T18:15:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.520871+0000", 2024-09-17T18:15:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.413e-06 2024-09-17T18:15:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.524179+0000", 2024-09-17T18:15:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033083359999999998 2024-09-17T18:15:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.524297+0000", 2024-09-17T18:15:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011831499999999999 2024-09-17T18:15:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.526125+0000", 2024-09-17T18:15:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001828103 2024-09-17T18:15:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.529133+0000", 2024-09-17T18:15:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030072889999999998 2024-09-17T18:15:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.532557+0000", 2024-09-17T18:15:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034243170000000001 2024-09-17T18:15:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.532648+0000", 2024-09-17T18:15:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1070999999999996e-05 2024-09-17T18:15:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:49.583 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:49.585 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T18:15:49.585 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:49.583+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:49.686 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:49.682+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:49.756 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:49.756 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:49.756 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:15:49.756 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:49.772 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T18:15:49.787 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:49.785+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:49.889 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:49.886+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:49.894 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:49.894 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:49.894 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:15:49.894 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:15:49.894 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:49.908 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T18:15:49.990 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:49.986+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:50.034 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:50.034 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:15:50.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:15:50.034 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:15:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 39/31 ECSubWrite(tid=112, reqid=client.4565.0:283, at_version=39'42, trim_to=0'0, roll_forward_to=36'38))", 2024-09-17T18:15:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:34.776485+0000", 2024-09-17T18:15:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.254977558, 2024-09-17T18:15:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056460369999999996, 2024-09-17T18:15:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.776485+0000", 2024-09-17T18:15:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.776485+0000", 2024-09-17T18:15:50.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.776486+0000", 2024-09-17T18:15:50.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.649e-06 2024-09-17T18:15:50.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.776530+0000", 2024-09-17T18:15:50.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4292000000000002e-05 2024-09-17T18:15:50.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.776561+0000", 2024-09-17T18:15:50.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0595000000000001e-05 2024-09-17T18:15:50.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.776583+0000", 2024-09-17T18:15:50.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2259000000000002e-05 2024-09-17T18:15:50.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.778018+0000", 2024-09-17T18:15:50.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014344780000000001 2024-09-17T18:15:50.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.778037+0000", 2024-09-17T18:15:50.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8873e-05 2024-09-17T18:15:50.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.782043+0000", 2024-09-17T18:15:50.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004006725 2024-09-17T18:15:50.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.782131+0000", 2024-09-17T18:15:50.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7165999999999999e-05 2024-09-17T18:15:50.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.039 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.039 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.0s2 42/31 ECSubWrite(tid=15, reqid=osd.3.0:14, at_version=0'0, trim_to=0'0, roll_forward_to=42'11))", 2024-09-17T18:15:50.039 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.773246+0000", 2024-09-17T18:15:50.039 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.258215904, 2024-09-17T18:15:50.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051294979999999997, 2024-09-17T18:15:50.040 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.040 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.040 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.040 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.773246+0000", 2024-09-17T18:15:50.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.773246+0000", 2024-09-17T18:15:50.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.773248+0000", 2024-09-17T18:15:50.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-17T18:15:50.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.773266+0000", 2024-09-17T18:15:50.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7832000000000001e-05 2024-09-17T18:15:50.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.773286+0000", 2024-09-17T18:15:50.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9885999999999999e-05 2024-09-17T18:15:50.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.773299+0000", 2024-09-17T18:15:50.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3730000000000001e-05 2024-09-17T18:15:50.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.773428+0000", 2024-09-17T18:15:50.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012870500000000001 2024-09-17T18:15:50.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.773441+0000", 2024-09-17T18:15:50.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2999999999999999e-05 2024-09-17T18:15:50.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.778313+0000", 2024-09-17T18:15:50.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048716510000000003 2024-09-17T18:15:50.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.778376+0000", 2024-09-17T18:15:50.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2943999999999999e-05 2024-09-17T18:15:50.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.045 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.045 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s3 42/31 ECSubWrite(tid=39, reqid=osd.5.0:39, at_version=42'10, trim_to=0'0, roll_forward_to=38'8))", 2024-09-17T18:15:50.045 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.775168+0000", 2024-09-17T18:15:50.045 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.256293586, 2024-09-17T18:15:50.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006571843, 2024-09-17T18:15:50.045 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.045 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.046 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.046 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775168+0000", 2024-09-17T18:15:50.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775168+0000", 2024-09-17T18:15:50.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775169+0000", 2024-09-17T18:15:50.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4e-07 2024-09-17T18:15:50.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775226+0000", 2024-09-17T18:15:50.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7003999999999998e-05 2024-09-17T18:15:50.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775289+0000", 2024-09-17T18:15:50.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2997999999999996e-05 2024-09-17T18:15:50.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775314+0000", 2024-09-17T18:15:50.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4915000000000001e-05 2024-09-17T18:15:50.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775886+0000", 2024-09-17T18:15:50.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057149100000000003 2024-09-17T18:15:50.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775911+0000", 2024-09-17T18:15:50.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5035999999999999e-05 2024-09-17T18:15:50.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.781679+0000", 2024-09-17T18:15:50.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057678470000000004 2024-09-17T18:15:50.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.781740+0000", 2024-09-17T18:15:50.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1711999999999995e-05 2024-09-17T18:15:50.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.049 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.050 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 42/31 ECSubWrite(tid=157, reqid=client.4565.0:339, at_version=42'65, trim_to=0'0, roll_forward_to=40'63))", 2024-09-17T18:15:50.050 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.780013+0000", 2024-09-17T18:15:50.050 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.251449454999999, 2024-09-17T18:15:50.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063106330000000004, 2024-09-17T18:15:50.050 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.050 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.050 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.050 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780013+0000", 2024-09-17T18:15:50.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780013+0000", 2024-09-17T18:15:50.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780013+0000", 2024-09-17T18:15:50.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8199999999999999e-07 2024-09-17T18:15:50.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780187+0000", 2024-09-17T18:15:50.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017382000000000001 2024-09-17T18:15:50.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780207+0000", 2024-09-17T18:15:50.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9593999999999999e-05 2024-09-17T18:15:50.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780221+0000", 2024-09-17T18:15:50.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4191e-05 2024-09-17T18:15:50.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780323+0000", 2024-09-17T18:15:50.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102228 2024-09-17T18:15:50.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780339+0000", 2024-09-17T18:15:50.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5426000000000001e-05 2024-09-17T18:15:50.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.786234+0000", 2024-09-17T18:15:50.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058950929999999997 2024-09-17T18:15:50.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.786323+0000", 2024-09-17T18:15:50.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9499000000000005e-05 2024-09-17T18:15:50.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.056 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.056 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s3 42/31 ECSubWrite(tid=40, reqid=osd.5.0:39, at_version=0'0, trim_to=0'0, roll_forward_to=42'10))", 2024-09-17T18:15:50.056 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.784652+0000", 2024-09-17T18:15:50.056 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.246810103, 2024-09-17T18:15:50.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078691309999999997, 2024-09-17T18:15:50.057 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.057 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.057 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.057 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784652+0000", 2024-09-17T18:15:50.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784652+0000", 2024-09-17T18:15:50.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784654+0000", 2024-09-17T18:15:50.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4830000000000002e-06 2024-09-17T18:15:50.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784682+0000", 2024-09-17T18:15:50.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7572e-05 2024-09-17T18:15:50.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784729+0000", 2024-09-17T18:15:50.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7391000000000001e-05 2024-09-17T18:15:50.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784754+0000", 2024-09-17T18:15:50.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4474999999999999e-05 2024-09-17T18:15:50.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784895+0000", 2024-09-17T18:15:50.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000140696 2024-09-17T18:15:50.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784910+0000", 2024-09-17T18:15:50.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5634e-05 2024-09-17T18:15:50.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.792426+0000", 2024-09-17T18:15:50.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007515341 2024-09-17T18:15:50.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.792521+0000", 2024-09-17T18:15:50.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5538999999999994e-05 2024-09-17T18:15:50.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.061 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.061 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 42/31 ECSubWrite(tid=159, reqid=osd.13.0:159, at_version=42'67, trim_to=0'0, roll_forward_to=40'63))", 2024-09-17T18:15:50.061 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.788253+0000", 2024-09-17T18:15:50.061 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.243208759, 2024-09-17T18:15:50.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045786630000000002, 2024-09-17T18:15:50.061 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.061 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.062 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.062 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788253+0000", 2024-09-17T18:15:50.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788253+0000", 2024-09-17T18:15:50.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788255+0000", 2024-09-17T18:15:50.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.517e-06 2024-09-17T18:15:50.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788289+0000", 2024-09-17T18:15:50.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3695999999999997e-05 2024-09-17T18:15:50.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788316+0000", 2024-09-17T18:15:50.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7546e-05 2024-09-17T18:15:50.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788330+0000", 2024-09-17T18:15:50.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3667e-05 2024-09-17T18:15:50.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788674+0000", 2024-09-17T18:15:50.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034442300000000001 2024-09-17T18:15:50.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788737+0000", 2024-09-17T18:15:50.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2843999999999997e-05 2024-09-17T18:15:50.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.792753+0000", 2024-09-17T18:15:50.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040157700000000001 2024-09-17T18:15:50.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.792832+0000", 2024-09-17T18:15:50.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9200000000000001e-05 2024-09-17T18:15:50.066 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.066 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.066 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.066 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 42/31 ECSubWrite(tid=160, reqid=osd.13.0:160, at_version=42'69, trim_to=0'0, roll_forward_to=40'63))", 2024-09-17T18:15:50.066 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.789009+0000", 2024-09-17T18:15:50.067 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.242453466000001, 2024-09-17T18:15:50.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061681419999999997, 2024-09-17T18:15:50.067 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.067 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.067 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.067 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789009+0000", 2024-09-17T18:15:50.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789009+0000", 2024-09-17T18:15:50.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789010+0000", 2024-09-17T18:15:50.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.178e-06 2024-09-17T18:15:50.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789042+0000", 2024-09-17T18:15:50.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1888999999999999e-05 2024-09-17T18:15:50.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789059+0000", 2024-09-17T18:15:50.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7116999999999999e-05 2024-09-17T18:15:50.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789072+0000", 2024-09-17T18:15:50.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2999999999999999e-05 2024-09-17T18:15:50.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789626+0000", 2024-09-17T18:15:50.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055469600000000003 2024-09-17T18:15:50.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789648+0000", 2024-09-17T18:15:50.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1362e-05 2024-09-17T18:15:50.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.795075+0000", 2024-09-17T18:15:50.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054275139999999996 2024-09-17T18:15:50.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.795177+0000", 2024-09-17T18:15:50.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010138599999999999 2024-09-17T18:15:50.071 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.071 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.071 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.071 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 43/31 ECSubWrite(tid=183, reqid=osd.13.0:183, at_version=43'79, trim_to=0'0, roll_forward_to=42'77))", 2024-09-17T18:15:50.071 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.778765+0000", 2024-09-17T18:15:50.071 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.252696844000001, 2024-09-17T18:15:50.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072569269999999998, 2024-09-17T18:15:50.071 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.071 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.072 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.072 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778765+0000", 2024-09-17T18:15:50.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778765+0000", 2024-09-17T18:15:50.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778766+0000", 2024-09-17T18:15:50.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.54e-07 2024-09-17T18:15:50.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778846+0000", 2024-09-17T18:15:50.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9586999999999995e-05 2024-09-17T18:15:50.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778893+0000", 2024-09-17T18:15:50.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7583999999999997e-05 2024-09-17T18:15:50.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779009+0000", 2024-09-17T18:15:50.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115702 2024-09-17T18:15:50.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779290+0000", 2024-09-17T18:15:50.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000281327 2024-09-17T18:15:50.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779309+0000", 2024-09-17T18:15:50.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8967e-05 2024-09-17T18:15:50.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.785917+0000", 2024-09-17T18:15:50.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066076379999999999 2024-09-17T18:15:50.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786022+0000", 2024-09-17T18:15:50.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105368 2024-09-17T18:15:50.076 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.076 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.076 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.076 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 43/31 ECSubWrite(tid=184, reqid=osd.13.0:184, at_version=43'81, trim_to=0'0, roll_forward_to=42'77))", 2024-09-17T18:15:50.076 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.779073+0000", 2024-09-17T18:15:50.076 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.252389163, 2024-09-17T18:15:50.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072302470000000004, 2024-09-17T18:15:50.077 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.077 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.077 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.077 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779073+0000", 2024-09-17T18:15:50.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779073+0000", 2024-09-17T18:15:50.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779074+0000", 2024-09-17T18:15:50.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1200000000000001e-06 2024-09-17T18:15:50.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779130+0000", 2024-09-17T18:15:50.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6153999999999998e-05 2024-09-17T18:15:50.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779157+0000", 2024-09-17T18:15:50.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6452999999999999e-05 2024-09-17T18:15:50.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779177+0000", 2024-09-17T18:15:50.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0052e-05 2024-09-17T18:15:50.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781445+0000", 2024-09-17T18:15:50.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022686130000000001 2024-09-17T18:15:50.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781470+0000", 2024-09-17T18:15:50.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4249000000000001e-05 2024-09-17T18:15:50.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786228+0000", 2024-09-17T18:15:50.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047580330000000001 2024-09-17T18:15:50.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786303+0000", 2024-09-17T18:15:50.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5573000000000003e-05 2024-09-17T18:15:50.080 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.081 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.081 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.081 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 43/31 ECSubWrite(tid=20, reqid=osd.0.0:20, at_version=43'12, trim_to=0'0, roll_forward_to=35'10))", 2024-09-17T18:15:50.081 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.779543+0000", 2024-09-17T18:15:50.081 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.251918982999999, 2024-09-17T18:15:50.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056962799999999997, 2024-09-17T18:15:50.081 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.081 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.081 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.081 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779543+0000", 2024-09-17T18:15:50.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779543+0000", 2024-09-17T18:15:50.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779544+0000", 2024-09-17T18:15:50.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8599999999999998e-07 2024-09-17T18:15:50.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779589+0000", 2024-09-17T18:15:50.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4947999999999997e-05 2024-09-17T18:15:50.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779612+0000", 2024-09-17T18:15:50.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3533e-05 2024-09-17T18:15:50.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779637+0000", 2024-09-17T18:15:50.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4941999999999999e-05 2024-09-17T18:15:50.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779817+0000", 2024-09-17T18:15:50.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018006200000000001 2024-09-17T18:15:50.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779842+0000", 2024-09-17T18:15:50.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4643000000000001e-05 2024-09-17T18:15:50.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.785150+0000", 2024-09-17T18:15:50.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053080829999999999 2024-09-17T18:15:50.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.785239+0000", 2024-09-17T18:15:50.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9582999999999999e-05 2024-09-17T18:15:50.085 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.085 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.085 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.086 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.0s2 43/31 ECSubWrite(tid=16, reqid=osd.3.0:16, at_version=43'13, trim_to=0'0, roll_forward_to=42'11))", 2024-09-17T18:15:50.086 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.786019+0000", 2024-09-17T18:15:50.086 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.245443087, 2024-09-17T18:15:50.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048927709999999998, 2024-09-17T18:15:50.086 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.086 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.086 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.086 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786019+0000", 2024-09-17T18:15:50.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786019+0000", 2024-09-17T18:15:50.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786020+0000", 2024-09-17T18:15:50.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5700000000000002e-07 2024-09-17T18:15:50.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786058+0000", 2024-09-17T18:15:50.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8581000000000002e-05 2024-09-17T18:15:50.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786079+0000", 2024-09-17T18:15:50.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1342999999999999e-05 2024-09-17T18:15:50.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786095+0000", 2024-09-17T18:15:50.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5849e-05 2024-09-17T18:15:50.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786680+0000", 2024-09-17T18:15:50.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00058422900000000002 2024-09-17T18:15:50.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786705+0000", 2024-09-17T18:15:50.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5125000000000001e-05 2024-09-17T18:15:50.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.790812+0000", 2024-09-17T18:15:50.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041069510000000002 2024-09-17T18:15:50.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.790912+0000", 2024-09-17T18:15:50.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100136 2024-09-17T18:15:50.090 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.090 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.090 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.090 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 43/31 ECSubWrite(tid=21, reqid=osd.0.0:20, at_version=0'0, trim_to=0'0, roll_forward_to=43'12))", 2024-09-17T18:15:50.090 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.791383+0000", 2024-09-17T18:15:50.090 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.240078649000001, 2024-09-17T18:15:50.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056022310000000001, 2024-09-17T18:15:50.091 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.091 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.091 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.091 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791383+0000", 2024-09-17T18:15:50.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791383+0000", 2024-09-17T18:15:50.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791384+0000", 2024-09-17T18:15:50.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9999999999999995e-07 2024-09-17T18:15:50.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791405+0000", 2024-09-17T18:15:50.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0602e-05 2024-09-17T18:15:50.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791441+0000", 2024-09-17T18:15:50.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5707999999999998e-05 2024-09-17T18:15:50.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791460+0000", 2024-09-17T18:15:50.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9660000000000002e-05 2024-09-17T18:15:50.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.792110+0000", 2024-09-17T18:15:50.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00064953899999999998 2024-09-17T18:15:50.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.792134+0000", 2024-09-17T18:15:50.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4289000000000001e-05 2024-09-17T18:15:50.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.796896+0000", 2024-09-17T18:15:50.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047621230000000001 2024-09-17T18:15:50.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.796986+0000", 2024-09-17T18:15:50.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9309999999999997e-05 2024-09-17T18:15:50.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.095 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.095 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s3 43/31 ECSubWrite(tid=46, reqid=osd.5.0:46, at_version=43'12, trim_to=0'0, roll_forward_to=42'10))", 2024-09-17T18:15:50.095 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.793230+0000", 2024-09-17T18:15:50.095 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.238232568000001, 2024-09-17T18:15:50.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062083850000000003, 2024-09-17T18:15:50.095 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.095 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.096 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.096 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793230+0000", 2024-09-17T18:15:50.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793230+0000", 2024-09-17T18:15:50.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793230+0000", 2024-09-17T18:15:50.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5200000000000002e-07 2024-09-17T18:15:50.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793282+0000", 2024-09-17T18:15:50.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1882000000000002e-05 2024-09-17T18:15:50.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793302+0000", 2024-09-17T18:15:50.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0369000000000001e-05 2024-09-17T18:15:50.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793317+0000", 2024-09-17T18:15:50.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5226e-05 2024-09-17T18:15:50.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793458+0000", 2024-09-17T18:15:50.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014025100000000001 2024-09-17T18:15:50.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793486+0000", 2024-09-17T18:15:50.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8309e-05 2024-09-17T18:15:50.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.799325+0000", 2024-09-17T18:15:50.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058389940000000001 2024-09-17T18:15:50.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.799438+0000", 2024-09-17T18:15:50.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112902 2024-09-17T18:15:50.100 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.100 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.100 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.100 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 43/31 ECSubWrite(tid=187, reqid=client.4565.0:365, at_version=43'83, trim_to=0'0, roll_forward_to=43'79))", 2024-09-17T18:15:50.100 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.797068+0000", 2024-09-17T18:15:50.100 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.234394499, 2024-09-17T18:15:50.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055186039999999999, 2024-09-17T18:15:50.100 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.100 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.100 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.100 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797068+0000", 2024-09-17T18:15:50.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797068+0000", 2024-09-17T18:15:50.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797070+0000", 2024-09-17T18:15:50.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0470000000000001e-06 2024-09-17T18:15:50.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797177+0000", 2024-09-17T18:15:50.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010758499999999999 2024-09-17T18:15:50.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797206+0000", 2024-09-17T18:15:50.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9264999999999998e-05 2024-09-17T18:15:50.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797230+0000", 2024-09-17T18:15:50.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3289999999999999e-05 2024-09-17T18:15:50.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797412+0000", 2024-09-17T18:15:50.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181845 2024-09-17T18:15:50.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797435+0000", 2024-09-17T18:15:50.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3108999999999998e-05 2024-09-17T18:15:50.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.802517+0000", 2024-09-17T18:15:50.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050827240000000003 2024-09-17T18:15:50.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.802586+0000", 2024-09-17T18:15:50.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8738999999999994e-05 2024-09-17T18:15:50.104 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.104 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.104 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.104 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 43/31 ECSubWrite(tid=189, reqid=osd.13.0:189, at_version=43'85, trim_to=0'0, roll_forward_to=43'81))", 2024-09-17T18:15:50.105 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.806765+0000", 2024-09-17T18:15:50.105 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.224696856, 2024-09-17T18:15:50.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051205349999999998, 2024-09-17T18:15:50.105 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.105 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.105 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.105 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.806765+0000", 2024-09-17T18:15:50.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.806765+0000", 2024-09-17T18:15:50.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.806767+0000", 2024-09-17T18:15:50.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8729999999999999e-06 2024-09-17T18:15:50.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.806837+0000", 2024-09-17T18:15:50.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0043999999999995e-05 2024-09-17T18:15:50.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.806886+0000", 2024-09-17T18:15:50.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8381000000000003e-05 2024-09-17T18:15:50.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.806911+0000", 2024-09-17T18:15:50.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5004999999999999e-05 2024-09-17T18:15:50.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807068+0000", 2024-09-17T18:15:50.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015728000000000001 2024-09-17T18:15:50.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807101+0000", 2024-09-17T18:15:50.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3458999999999999e-05 2024-09-17T18:15:50.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.811818+0000", 2024-09-17T18:15:50.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047170939999999998 2024-09-17T18:15:50.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.811886+0000", 2024-09-17T18:15:50.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7398999999999996e-05 2024-09-17T18:15:50.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.109 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.109 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s3 43/31 ECSubWrite(tid=47, reqid=osd.5.0:46, at_version=0'0, trim_to=0'0, roll_forward_to=43'12))", 2024-09-17T18:15:50.109 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.810762+0000", 2024-09-17T18:15:50.109 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.220699734, 2024-09-17T18:15:50.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045400070000000004, 2024-09-17T18:15:50.109 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.109 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.109 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.109 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.810762+0000", 2024-09-17T18:15:50.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.810762+0000", 2024-09-17T18:15:50.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.810765+0000", 2024-09-17T18:15:50.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1799999999999999e-06 2024-09-17T18:15:50.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.810793+0000", 2024-09-17T18:15:50.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8166000000000001e-05 2024-09-17T18:15:50.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.810827+0000", 2024-09-17T18:15:50.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4202000000000002e-05 2024-09-17T18:15:50.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.811051+0000", 2024-09-17T18:15:50.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022423000000000001 2024-09-17T18:15:50.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.811394+0000", 2024-09-17T18:15:50.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034278899999999997 2024-09-17T18:15:50.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.811429+0000", 2024-09-17T18:15:50.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4941000000000003e-05 2024-09-17T18:15:50.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.815253+0000", 2024-09-17T18:15:50.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038245409999999999 2024-09-17T18:15:50.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.815302+0000", 2024-09-17T18:15:50.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8958000000000001e-05 2024-09-17T18:15:50.113 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.114 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.114 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.114 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 43/31 ECSubWrite(tid=201, reqid=osd.13.0:201, at_version=43'95, trim_to=0'0, roll_forward_to=43'91))", 2024-09-17T18:15:50.114 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.836371+0000", 2024-09-17T18:15:50.114 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.1950913, 2024-09-17T18:15:50.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055144499999999997, 2024-09-17T18:15:50.114 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.114 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.114 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.114 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.836371+0000", 2024-09-17T18:15:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.836371+0000", 2024-09-17T18:15:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.836372+0000", 2024-09-17T18:15:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.637e-06 2024-09-17T18:15:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.836421+0000", 2024-09-17T18:15:50.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8270999999999999e-05 2024-09-17T18:15:50.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.836443+0000", 2024-09-17T18:15:50.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2201e-05 2024-09-17T18:15:50.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.836455+0000", 2024-09-17T18:15:50.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2021999999999999e-05 2024-09-17T18:15:50.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.836723+0000", 2024-09-17T18:15:50.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000268399 2024-09-17T18:15:50.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.836739+0000", 2024-09-17T18:15:50.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5489999999999999e-05 2024-09-17T18:15:50.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.841799+0000", 2024-09-17T18:15:50.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050599809999999999 2024-09-17T18:15:50.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.841885+0000", 2024-09-17T18:15:50.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6448999999999999e-05 2024-09-17T18:15:50.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.118 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.118 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 43/31 ECSubWrite(tid=30, reqid=client.4565.0:378, at_version=43'21, trim_to=0'0, roll_forward_to=43'18))", 2024-09-17T18:15:50.118 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:39.078036+0000", 2024-09-17T18:15:50.119 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.95342643, 2024-09-17T18:15:50.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053685859999999998, 2024-09-17T18:15:50.119 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.119 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.119 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.119 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:39.078036+0000", 2024-09-17T18:15:50.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:39.078036+0000", 2024-09-17T18:15:50.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:39.078037+0000", 2024-09-17T18:15:50.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8029999999999999e-06 2024-09-17T18:15:50.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:39.078083+0000", 2024-09-17T18:15:50.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5228000000000001e-05 2024-09-17T18:15:50.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:39.078119+0000", 2024-09-17T18:15:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5865000000000003e-05 2024-09-17T18:15:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:39.078196+0000", 2024-09-17T18:15:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7197e-05 2024-09-17T18:15:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:39.078346+0000", 2024-09-17T18:15:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150354 2024-09-17T18:15:50.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:39.078363+0000", 2024-09-17T18:15:50.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6506000000000001e-05 2024-09-17T18:15:50.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:39.083347+0000", 2024-09-17T18:15:50.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049845080000000003 2024-09-17T18:15:50.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:39.083404+0000", 2024-09-17T18:15:50.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7124999999999999e-05 2024-09-17T18:15:50.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.123 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.123 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s3 54/31 ECSubWrite(tid=81, reqid=osd.5.0:81, at_version=54'21, trim_to=0'0, roll_forward_to=53'19))", 2024-09-17T18:15:50.123 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:49.310852+0000", 2024-09-17T18:15:50.123 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.72061017199999999, 2024-09-17T18:15:50.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047710679999999998, 2024-09-17T18:15:50.123 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.123 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.123 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.123 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.310852+0000", 2024-09-17T18:15:50.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.310852+0000", 2024-09-17T18:15:50.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.310852+0000", 2024-09-17T18:15:50.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3700000000000001e-07 2024-09-17T18:15:50.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.310897+0000", 2024-09-17T18:15:50.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4279000000000001e-05 2024-09-17T18:15:50.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.310920+0000", 2024-09-17T18:15:50.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3076000000000001e-05 2024-09-17T18:15:50.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.310935+0000", 2024-09-17T18:15:50.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5633000000000001e-05 2024-09-17T18:15:50.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.311162+0000", 2024-09-17T18:15:50.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022659899999999999 2024-09-17T18:15:50.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.311188+0000", 2024-09-17T18:15:50.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5829e-05 2024-09-17T18:15:50.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.315529+0000", 2024-09-17T18:15:50.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043409049999999999 2024-09-17T18:15:50.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.315623+0000", 2024-09-17T18:15:50.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4309999999999997e-05 2024-09-17T18:15:50.127 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.127 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.127 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.127 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 54/31 ECSubWrite(tid=277, reqid=osd.13.0:277, at_version=54'134, trim_to=0'0, roll_forward_to=53'132))", 2024-09-17T18:15:50.127 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:49.318671+0000", 2024-09-17T18:15:50.128 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.71279148999999997, 2024-09-17T18:15:50.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061435220000000002, 2024-09-17T18:15:50.128 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.128 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.128 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:15:50.128 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.318671+0000", 2024-09-17T18:15:50.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.318671+0000", 2024-09-17T18:15:50.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.318671+0000", 2024-09-17T18:15:50.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7999999999999995e-07 2024-09-17T18:15:50.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.318725+0000", 2024-09-17T18:15:50.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4117999999999999e-05 2024-09-17T18:15:50.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.318762+0000", 2024-09-17T18:15:50.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6918999999999997e-05 2024-09-17T18:15:50.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.318789+0000", 2024-09-17T18:15:50.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6956000000000001e-05 2024-09-17T18:15:50.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.319387+0000", 2024-09-17T18:15:50.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000597903 2024-09-17T18:15:50.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.319430+0000", 2024-09-17T18:15:50.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3142000000000001e-05 2024-09-17T18:15:50.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.324720+0000", 2024-09-17T18:15:50.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052901939999999998 2024-09-17T18:15:50.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.324814+0000", 2024-09-17T18:15:50.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3610000000000007e-05 2024-09-17T18:15:50.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.132 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.132 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.132 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.132 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.132 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:50.133 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T18:15:50.134 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:50.130+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:50.235 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:50.229+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:50.260 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:50.261 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:50.261 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:15:50.261 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:50.275 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T18:15:50.318 INFO:tasks.rados.rados.0.smithi154.stdout:201: done (1 left) 2024-09-17T18:15:50.318 INFO:tasks.rados.rados.0.smithi154.stdout:203: done (0 left) 2024-09-17T18:15:50.318 INFO:tasks.rados.rados.0.smithi154.stdout:204: read oid 14 snap -1 2024-09-17T18:15:50.318 INFO:tasks.rados.rados.0.smithi154.stdout:204: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-17T18:15:50.318 INFO:tasks.rados.rados.0.smithi154.stdout:205: read oid 4 snap -1 2024-09-17T18:15:50.318 INFO:tasks.rados.rados.0.smithi154.stdout:205: expect (ObjNum 75 snap 7 seq_num 75) 2024-09-17T18:15:50.318 INFO:tasks.rados.rados.0.smithi154.stdout:206: snap_remove snap 12 2024-09-17T18:15:50.327 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T18:15:50.335 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:50.335+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:50.401 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:50.401 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:15:50.401 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:15:50.402 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:15:50.402 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:50.416 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T18:15:50.463 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:50.463+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:50.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:50.535+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:50.537 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:15:50.537 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:15:50.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:15:50.537 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:15:50.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.538 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:296 3.ds0 3:b017d8c2:::smithi15432074-22:head [copy-from ver 32] snapc 6=[6,5,4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T18:15:50.538 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:34.786878+0000", 2024-09-17T18:15:50.538 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.746942709000001, 2024-09-17T18:15:50.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027538666, 2024-09-17T18:15:50.538 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.538 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.538 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:50.538 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.538 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.539 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 296 2024-09-17T18:15:50.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.539 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.786878+0000", 2024-09-17T18:15:50.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.786878+0000", 2024-09-17T18:15:50.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.786879+0000", 2024-09-17T18:15:50.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4330000000000001e-06 2024-09-17T18:15:50.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.786889+0000", 2024-09-17T18:15:50.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7089999999999997e-06 2024-09-17T18:15:50.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.786908+0000", 2024-09-17T18:15:50.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9313e-05 2024-09-17T18:15:50.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.786923+0000", 2024-09-17T18:15:50.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4676e-05 2024-09-17T18:15:50.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.787061+0000", 2024-09-17T18:15:50.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013812699999999999 2024-09-17T18:15:50.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.787312+0000", 2024-09-17T18:15:50.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025085400000000001 2024-09-17T18:15:50.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.806732+0000", 2024-09-17T18:15:50.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01941973 2024-09-17T18:15:50.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.813906+0000", 2024-09-17T18:15:50.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071745710000000002 2024-09-17T18:15:50.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:50.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.814271+0000", 2024-09-17T18:15:50.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036478599999999997 2024-09-17T18:15:50.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.814417+0000", 2024-09-17T18:15:50.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014546700000000001 2024-09-17T18:15:50.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.546 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.546 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:339 3.ds0 3:b554fbc1:::smithi15432074-41:head [create,setxattr h^blbcaNtSmmsQtZPdaRtPkhOOgN_Vi\\f`NtsZ[V (561) in=40b,setxattr T (17332) in=1b,setxattr UVoaZteYfmpthpcfl[gebaR\\TdqcNkhPRRdrgsX] (279) in=40b,setxattr bTPgfXb\\YXtXkQag\\Qh`hlXr[posd]]cje]^eebl (1121) in=40b,setxattr hm^gakWSOOOfNOTph^tma]iaNsaqfjqZYb\\seZNW (3297) in=40b,setxattr YiNn[]m_q`YlQlaV^mRn^ (17332) in=21b,setxattr \\tllpkXThmWXSkOopogrdtjY]f^a^sem_krafjfi (947) in=40b,setxattr RXiRZRQVSaUTaZmQT^bfqZhS^mZsqadaPdW]ijm` (1963) in=40b,setxattr WTmsTZhNpU`tZY\\^aROaNdmtYsjjsgWWboehPOP` (19508) in=40b,setxattr UZmWZeWaoiX]jmbn][UadnNkcZc_hdcjidtNsRYo (1999) in=40b,setxattr NSebjRYYQ`SbaatVjZWNab`cenkljRq`^]Xr\\jRm (11788) in=40b,setxattr ip`daUaop[rdbNPo\\^c[Wcelsl]a][RScQZ[kfa^ (18524) in=40b,setxattr qU_qcNcQpNkegs_Od`jieTXX[mto]lsR^jTcYprR (593) in=40b,setxattr dboVg`srq[bReagdR]fX\\Pe`Warrp]\\[XpSipTN[ (1683) in=40b,setxattr ZdTaVj[ScjsOiQ]a_]R[RQWoYohnjd`fi[dYmfs` (840) in=40b,setxattr N_[blmbpstWhtUgW]ZjZ[\\O_erqcnQN]R_V^U\\RT (1015) in=40b,setxattr jXbP_mNsadnq`UVfmc^lfZUs\\r_[ZnrahqTUk^Zp (383) in=40b,setxattr nmemd\\ipehj\\q^UVY_YtSrhZjcabNXhlai_noQSO (807) in=40b,setxattr Rbc\\cahhlcrckUioieUbQnrseNkZkdPf\\rUmNb]S (384) in=40b,setxattr ZiOkXqg^PobTdZgrtZ]]l^Rap_tfSQoUQqaefj]] (69) in=40b] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:50.546 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.763657+0000", 2024-09-17T18:15:50.547 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.770163646, 2024-09-17T18:15:50.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033376057000000001, 2024-09-17T18:15:50.547 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.547 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.547 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:50.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.547 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 339 2024-09-17T18:15:50.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.547 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.763657+0000", 2024-09-17T18:15:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.763657+0000", 2024-09-17T18:15:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.763660+0000", 2024-09-17T18:15:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2389999999999998e-06 2024-09-17T18:15:50.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.763972+0000", 2024-09-17T18:15:50.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031217300000000001 2024-09-17T18:15:50.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764069+0000", 2024-09-17T18:15:50.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6099000000000003e-05 2024-09-17T18:15:50.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764094+0000", 2024-09-17T18:15:50.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5652000000000001e-05 2024-09-17T18:15:50.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764253+0000", 2024-09-17T18:15:50.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000159216 2024-09-17T18:15:50.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:15:50.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764267+0000", 2024-09-17T18:15:50.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.36e-05 2024-09-17T18:15:50.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777749+0000", 2024-09-17T18:15:50.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013481523 2024-09-17T18:15:50.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777928+0000", 2024-09-17T18:15:50.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000179662 2024-09-17T18:15:50.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.779951+0000", 2024-09-17T18:15:50.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020230460000000001 2024-09-17T18:15:50.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.796028+0000", 2024-09-17T18:15:50.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016076788000000002 2024-09-17T18:15:50.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:50.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.796663+0000", 2024-09-17T18:15:50.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00063526800000000003 2024-09-17T18:15:50.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797033+0000", 2024-09-17T18:15:50.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036979100000000001 2024-09-17T18:15:50.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.553 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.553 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.553 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:340 3.as0 3:5b87f4c2:::smithi15432074-21:7 [read 535691~54133,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:50.553 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764141+0000", 2024-09-17T18:15:50.553 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.769679482000001, 2024-09-17T18:15:50.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.032865103999999999, 2024-09-17T18:15:50.553 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.553 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.553 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.554 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 340 2024-09-17T18:15:50.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.554 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764141+0000", 2024-09-17T18:15:50.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764141+0000", 2024-09-17T18:15:50.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764143+0000", 2024-09-17T18:15:50.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-17T18:15:50.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764155+0000", 2024-09-17T18:15:50.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1345999999999999e-05 2024-09-17T18:15:50.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764177+0000", 2024-09-17T18:15:50.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2532e-05 2024-09-17T18:15:50.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764193+0000", 2024-09-17T18:15:50.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6093e-05 2024-09-17T18:15:50.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764315+0000", 2024-09-17T18:15:50.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121931 2024-09-17T18:15:50.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:15:50.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764327+0000", 2024-09-17T18:15:50.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1423000000000001e-05 2024-09-17T18:15:50.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.769504+0000", 2024-09-17T18:15:50.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005177208 2024-09-17T18:15:50.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.769742+0000", 2024-09-17T18:15:50.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023849299999999999 2024-09-17T18:15:50.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797006+0000", 2024-09-17T18:15:50.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027264004000000001 2024-09-17T18:15:50.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.559 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.559 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.559 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:341 3.as0 3:5b87f4c2:::smithi15432074-21:7 [read 0~589824,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:50.559 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764228+0000", 2024-09-17T18:15:50.559 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.769593135999999, 2024-09-17T18:15:50.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034228878999999997, 2024-09-17T18:15:50.559 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.559 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.559 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.560 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.560 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 341 2024-09-17T18:15:50.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.560 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764228+0000", 2024-09-17T18:15:50.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764228+0000", 2024-09-17T18:15:50.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764229+0000", 2024-09-17T18:15:50.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3039999999999999e-06 2024-09-17T18:15:50.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764235+0000", 2024-09-17T18:15:50.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1800000000000001e-06 2024-09-17T18:15:50.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764247+0000", 2024-09-17T18:15:50.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1736000000000001e-05 2024-09-17T18:15:50.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764255+0000", 2024-09-17T18:15:50.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2530000000000004e-06 2024-09-17T18:15:50.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764416+0000", 2024-09-17T18:15:50.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016111899999999999 2024-09-17T18:15:50.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:50.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764432+0000", 2024-09-17T18:15:50.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5846e-05 2024-09-17T18:15:50.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.770739+0000", 2024-09-17T18:15:50.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063069479999999997 2024-09-17T18:15:50.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.770999+0000", 2024-09-17T18:15:50.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025988200000000002 2024-09-17T18:15:50.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.798456+0000", 2024-09-17T18:15:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027457611 2024-09-17T18:15:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:342 3.as0 3:5b87f4c2:::smithi15432074-21:7 [read 0~589824,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764269+0000", 2024-09-17T18:15:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.769551214, 2024-09-17T18:15:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035045893000000002, 2024-09-17T18:15:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 342 2024-09-17T18:15:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764269+0000", 2024-09-17T18:15:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764269+0000", 2024-09-17T18:15:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764270+0000", 2024-09-17T18:15:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7299999999999995e-07 2024-09-17T18:15:50.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764274+0000", 2024-09-17T18:15:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0570000000000003e-06 2024-09-17T18:15:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764283+0000", 2024-09-17T18:15:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2960000000000004e-06 2024-09-17T18:15:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764291+0000", 2024-09-17T18:15:50.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4329999999999998e-06 2024-09-17T18:15:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764533+0000", 2024-09-17T18:15:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024180299999999999 2024-09-17T18:15:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764548+0000", 2024-09-17T18:15:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5172e-05 2024-09-17T18:15:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772076+0000", 2024-09-17T18:15:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075283499999999996 2024-09-17T18:15:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772311+0000", 2024-09-17T18:15:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023469699999999999 2024-09-17T18:15:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.799315+0000", 2024-09-17T18:15:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027004411999999998 2024-09-17T18:15:50.569 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:347 3.fs0 3:fc99b2c2:::smithi15432074-13:head [read 0~1376256,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764375+0000", 2024-09-17T18:15:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.769445315, 2024-09-17T18:15:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026507836, 2024-09-17T18:15:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.570 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 347 2024-09-17T18:15:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764375+0000", 2024-09-17T18:15:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764375+0000", 2024-09-17T18:15:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764376+0000", 2024-09-17T18:15:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3e-07 2024-09-17T18:15:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764380+0000", 2024-09-17T18:15:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1590000000000003e-06 2024-09-17T18:15:50.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764390+0000", 2024-09-17T18:15:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3400000000000004e-06 2024-09-17T18:15:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764396+0000", 2024-09-17T18:15:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8870000000000003e-06 2024-09-17T18:15:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764551+0000", 2024-09-17T18:15:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015497300000000001 2024-09-17T18:15:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764569+0000", 2024-09-17T18:15:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7329e-05 2024-09-17T18:15:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.771652+0000", 2024-09-17T18:15:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070833609999999998 2024-09-17T18:15:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.771775+0000", 2024-09-17T18:15:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012260999999999999 2024-09-17T18:15:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.790883+0000", 2024-09-17T18:15:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019108447000000001 2024-09-17T18:15:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.575 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:348 3.fs0 3:fc99b2c2:::smithi15432074-13:head [read 0~1376256,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764412+0000", 2024-09-17T18:15:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.769408557, 2024-09-17T18:15:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029012948, 2024-09-17T18:15:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 348 2024-09-17T18:15:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764412+0000", 2024-09-17T18:15:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764412+0000", 2024-09-17T18:15:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764413+0000", 2024-09-17T18:15:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0669999999999999e-06 2024-09-17T18:15:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764419+0000", 2024-09-17T18:15:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0299999999999999e-06 2024-09-17T18:15:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764435+0000", 2024-09-17T18:15:50.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6011999999999998e-05 2024-09-17T18:15:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764448+0000", 2024-09-17T18:15:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2646000000000001e-05 2024-09-17T18:15:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764618+0000", 2024-09-17T18:15:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016967300000000001 2024-09-17T18:15:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:50.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764625+0000", 2024-09-17T18:15:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.729e-06 2024-09-17T18:15:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772117+0000", 2024-09-17T18:15:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074916260000000004 2024-09-17T18:15:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772194+0000", 2024-09-17T18:15:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7087000000000002e-05 2024-09-17T18:15:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.793425+0000", 2024-09-17T18:15:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021231078 2024-09-17T18:15:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:349 3.as0 3:57f0af22:::smithi15432074-39:head [read 0~2572288,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764536+0000", 2024-09-17T18:15:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.769284968999999, 2024-09-17T18:15:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037750283000000003, 2024-09-17T18:15:50.581 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 349 2024-09-17T18:15:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764536+0000", 2024-09-17T18:15:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764536+0000", 2024-09-17T18:15:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764538+0000", 2024-09-17T18:15:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.649e-06 2024-09-17T18:15:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764553+0000", 2024-09-17T18:15:50.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4426999999999999e-05 2024-09-17T18:15:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764591+0000", 2024-09-17T18:15:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7975000000000001e-05 2024-09-17T18:15:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764614+0000", 2024-09-17T18:15:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2789000000000002e-05 2024-09-17T18:15:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764724+0000", 2024-09-17T18:15:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110418 2024-09-17T18:15:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764737+0000", 2024-09-17T18:15:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2663000000000001e-05 2024-09-17T18:15:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.773245+0000", 2024-09-17T18:15:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085088690000000005 2024-09-17T18:15:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.773462+0000", 2024-09-17T18:15:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021628399999999999 2024-09-17T18:15:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.802286+0000", 2024-09-17T18:15:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028824209 2024-09-17T18:15:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.586 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:350 3.as0 3:57f0af22:::smithi15432074-39:head [read 0~2572288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764660+0000", 2024-09-17T18:15:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.769160577999999, 2024-09-17T18:15:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.040875872000000001, 2024-09-17T18:15:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 350 2024-09-17T18:15:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764660+0000", 2024-09-17T18:15:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764660+0000", 2024-09-17T18:15:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764662+0000", 2024-09-17T18:15:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5999999999999999e-06 2024-09-17T18:15:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764670+0000", 2024-09-17T18:15:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7690000000000002e-06 2024-09-17T18:15:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764692+0000", 2024-09-17T18:15:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1852999999999999e-05 2024-09-17T18:15:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764709+0000", 2024-09-17T18:15:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6702999999999999e-05 2024-09-17T18:15:50.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764803+0000", 2024-09-17T18:15:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4239000000000004e-05 2024-09-17T18:15:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764816+0000", 2024-09-17T18:15:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3251999999999999e-05 2024-09-17T18:15:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.774347+0000", 2024-09-17T18:15:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095306539999999995 2024-09-17T18:15:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.774622+0000", 2024-09-17T18:15:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000275195 2024-09-17T18:15:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.805536+0000", 2024-09-17T18:15:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030913606999999999 2024-09-17T18:15:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.593 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:351 3.as0 3:57f0af22:::smithi15432074-39:head [read 0~2572288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764738+0000", 2024-09-17T18:15:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.769082208, 2024-09-17T18:15:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050115125000000003, 2024-09-17T18:15:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 351 2024-09-17T18:15:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764738+0000", 2024-09-17T18:15:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764738+0000", 2024-09-17T18:15:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764740+0000", 2024-09-17T18:15:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3689999999999999e-06 2024-09-17T18:15:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764752+0000", 2024-09-17T18:15:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2607e-05 2024-09-17T18:15:50.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764771+0000", 2024-09-17T18:15:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8759000000000001e-05 2024-09-17T18:15:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764786+0000", 2024-09-17T18:15:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4922e-05 2024-09-17T18:15:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764896+0000", 2024-09-17T18:15:50.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010985900000000001 2024-09-17T18:15:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764914+0000", 2024-09-17T18:15:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7963000000000001e-05 2024-09-17T18:15:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.805681+0000", 2024-09-17T18:15:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.040767202000000002 2024-09-17T18:15:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.805820+0000", 2024-09-17T18:15:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013898200000000001 2024-09-17T18:15:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.814854+0000", 2024-09-17T18:15:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090334620000000008 2024-09-17T18:15:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:355 3.as0 3:591714be:::smithi15432074-11:head [read 0~180224,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:50.599 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764838+0000", 2024-09-17T18:15:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.768982573000001, 2024-09-17T18:15:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050658993999999999, 2024-09-17T18:15:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 355 2024-09-17T18:15:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764838+0000", 2024-09-17T18:15:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764838+0000", 2024-09-17T18:15:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764840+0000", 2024-09-17T18:15:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6500000000000001e-06 2024-09-17T18:15:50.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764848+0000", 2024-09-17T18:15:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2099999999999993e-06 2024-09-17T18:15:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764867+0000", 2024-09-17T18:15:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9446e-05 2024-09-17T18:15:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764883+0000", 2024-09-17T18:15:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5116000000000001e-05 2024-09-17T18:15:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764979+0000", 2024-09-17T18:15:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6329000000000006e-05 2024-09-17T18:15:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764993+0000", 2024-09-17T18:15:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3909e-05 2024-09-17T18:15:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.807139+0000", 2024-09-17T18:15:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.042146001000000002 2024-09-17T18:15:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.807373+0000", 2024-09-17T18:15:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023453100000000001 2024-09-17T18:15:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.815497+0000", 2024-09-17T18:15:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081238019999999994 2024-09-17T18:15:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.604 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:356 3.as0 3:591714be:::smithi15432074-11:head [read 137278~42946,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764908+0000", 2024-09-17T18:15:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.768912539, 2024-09-17T18:15:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.051245559000000003, 2024-09-17T18:15:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.605 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 356 2024-09-17T18:15:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764908+0000", 2024-09-17T18:15:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764908+0000", 2024-09-17T18:15:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764909+0000", 2024-09-17T18:15:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.353e-06 2024-09-17T18:15:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764916+0000", 2024-09-17T18:15:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8360000000000003e-06 2024-09-17T18:15:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764934+0000", 2024-09-17T18:15:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7657000000000001e-05 2024-09-17T18:15:50.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764956+0000", 2024-09-17T18:15:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2452000000000001e-05 2024-09-17T18:15:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765079+0000", 2024-09-17T18:15:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012227700000000001 2024-09-17T18:15:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765095+0000", 2024-09-17T18:15:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5985999999999999e-05 2024-09-17T18:15:50.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.808162+0000", 2024-09-17T18:15:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.043067626999999997 2024-09-17T18:15:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.808280+0000", 2024-09-17T18:15:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118016 2024-09-17T18:15:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.816154+0000", 2024-09-17T18:15:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078733550000000003 2024-09-17T18:15:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:357 3.as0 3:591714be:::smithi15432074-11:head [read 0~180224,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764981+0000", 2024-09-17T18:15:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.768839472, 2024-09-17T18:15:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055363373, 2024-09-17T18:15:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.611 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 357 2024-09-17T18:15:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764981+0000", 2024-09-17T18:15:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764981+0000", 2024-09-17T18:15:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764982+0000", 2024-09-17T18:15:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2359999999999999e-06 2024-09-17T18:15:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764990+0000", 2024-09-17T18:15:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5530000000000004e-06 2024-09-17T18:15:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765008+0000", 2024-09-17T18:15:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7629e-05 2024-09-17T18:15:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765022+0000", 2024-09-17T18:15:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3947e-05 2024-09-17T18:15:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765143+0000", 2024-09-17T18:15:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121384 2024-09-17T18:15:50.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765155+0000", 2024-09-17T18:15:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1712999999999999e-05 2024-09-17T18:15:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.809756+0000", 2024-09-17T18:15:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.044601190999999998 2024-09-17T18:15:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.809901+0000", 2024-09-17T18:15:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014498700000000001 2024-09-17T18:15:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.820345+0000", 2024-09-17T18:15:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010443733 2024-09-17T18:15:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:365 3.ds0 3:b4393ba6:::smithi15432074-18:head [copy-from ver 38] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:15:50.616 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.771149+0000", 2024-09-17T18:15:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.762671713, 2024-09-17T18:15:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.042586502999999998, 2024-09-17T18:15:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 365 2024-09-17T18:15:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771149+0000", 2024-09-17T18:15:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771149+0000", 2024-09-17T18:15:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771152+0000", 2024-09-17T18:15:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-06 2024-09-17T18:15:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771167+0000", 2024-09-17T18:15:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4919000000000001e-05 2024-09-17T18:15:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771200+0000", 2024-09-17T18:15:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2515000000000003e-05 2024-09-17T18:15:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771221+0000", 2024-09-17T18:15:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1123000000000001e-05 2024-09-17T18:15:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771375+0000", 2024-09-17T18:15:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015396299999999999 2024-09-17T18:15:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:15:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771395+0000", 2024-09-17T18:15:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-09-17T18:15:50.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.774140+0000", 2024-09-17T18:15:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027452230000000002 2024-09-17T18:15:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.774299+0000", 2024-09-17T18:15:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015924600000000001 2024-09-17T18:15:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.796950+0000", 2024-09-17T18:15:50.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022650358999999998 2024-09-17T18:15:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812885+0000", 2024-09-17T18:15:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015935451 2024-09-17T18:15:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.813546+0000", 2024-09-17T18:15:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066145500000000003 2024-09-17T18:15:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.813735+0000", 2024-09-17T18:15:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018900000000000001 2024-09-17T18:15:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:366 3.ds0 3:b4393ba6:::smithi15432074-18:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:15:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.771279+0000", 2024-09-17T18:15:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.762542099000001, 2024-09-17T18:15:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033426215000000002, 2024-09-17T18:15:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.623 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 366 2024-09-17T18:15:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771279+0000", 2024-09-17T18:15:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771279+0000", 2024-09-17T18:15:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771280+0000", 2024-09-17T18:15:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6700000000000001e-06 2024-09-17T18:15:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771384+0000", 2024-09-17T18:15:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103866 2024-09-17T18:15:50.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771408+0000", 2024-09-17T18:15:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3489000000000002e-05 2024-09-17T18:15:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771442+0000", 2024-09-17T18:15:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4085000000000003e-05 2024-09-17T18:15:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771564+0000", 2024-09-17T18:15:50.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012266499999999999 2024-09-17T18:15:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771581+0000", 2024-09-17T18:15:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7161999999999999e-05 2024-09-17T18:15:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.774574+0000", 2024-09-17T18:15:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029929290000000001 2024-09-17T18:15:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-09-17T18:15:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.774648+0000", 2024-09-17T18:15:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3326999999999998e-05 2024-09-17T18:15:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.804326+0000", 2024-09-17T18:15:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029678067999999998 2024-09-17T18:15:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.804503+0000", 2024-09-17T18:15:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017732699999999999 2024-09-17T18:15:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.804705+0000", 2024-09-17T18:15:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020162700000000001 2024-09-17T18:15:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:416 3.as0 3:57f0af22:::smithi15432074-39:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-17T18:15:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:45.856064+0000", 2024-09-17T18:15:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6777562289999999, 2024-09-17T18:15:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033397346000000001, 2024-09-17T18:15:50.629 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 416 2024-09-17T18:15:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856064+0000", 2024-09-17T18:15:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856064+0000", 2024-09-17T18:15:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856066+0000", 2024-09-17T18:15:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.237e-06 2024-09-17T18:15:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856071+0000", 2024-09-17T18:15:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4689999999999996e-06 2024-09-17T18:15:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856089+0000", 2024-09-17T18:15:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7506000000000001e-05 2024-09-17T18:15:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856102+0000", 2024-09-17T18:15:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3713000000000001e-05 2024-09-17T18:15:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.875096+0000", 2024-09-17T18:15:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018993877999999999 2024-09-17T18:15:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-17T18:15:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.875228+0000", 2024-09-17T18:15:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000132065 2024-09-17T18:15:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.881248+0000", 2024-09-17T18:15:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060196520000000003 2024-09-17T18:15:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.881567+0000", 2024-09-17T18:15:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031875499999999999 2024-09-17T18:15:50.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.889462+0000", 2024-09-17T18:15:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007895071 2024-09-17T18:15:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:417 3.as0 3:591714be:::smithi15432074-11:e [read 0~180224,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-17T18:15:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:45.856120+0000", 2024-09-17T18:15:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6777005479999998, 2024-09-17T18:15:50.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028317588000000001, 2024-09-17T18:15:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 417 2024-09-17T18:15:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856120+0000", 2024-09-17T18:15:50.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856120+0000", 2024-09-17T18:15:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856121+0000", 2024-09-17T18:15:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2270000000000001e-06 2024-09-17T18:15:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856142+0000", 2024-09-17T18:15:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0815999999999999e-05 2024-09-17T18:15:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856160+0000", 2024-09-17T18:15:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7439e-05 2024-09-17T18:15:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856173+0000", 2024-09-17T18:15:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.347e-05 2024-09-17T18:15:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.875304+0000", 2024-09-17T18:15:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019130518999999999 2024-09-17T18:15:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.875447+0000", 2024-09-17T18:15:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143375 2024-09-17T18:15:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.884438+0000", 2024-09-17T18:15:50.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0089907419999999995 2024-09-17T18:15:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:418 3.as0 3:591714be:::smithi15432074-11:e [read 77516~102708,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-17T18:15:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:45.856190+0000", 2024-09-17T18:15:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.677630164, 2024-09-17T18:15:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031900123000000002, 2024-09-17T18:15:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.640 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 418 2024-09-17T18:15:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856190+0000", 2024-09-17T18:15:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856190+0000", 2024-09-17T18:15:50.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856192+0000", 2024-09-17T18:15:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.093e-06 2024-09-17T18:15:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856201+0000", 2024-09-17T18:15:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.73e-06 2024-09-17T18:15:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856218+0000", 2024-09-17T18:15:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6359e-05 2024-09-17T18:15:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856237+0000", 2024-09-17T18:15:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.961e-05 2024-09-17T18:15:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.877256+0000", 2024-09-17T18:15:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021018934999999999 2024-09-17T18:15:50.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.877519+0000", 2024-09-17T18:15:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026259800000000001 2024-09-17T18:15:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.888091+0000", 2024-09-17T18:15:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010571798 2024-09-17T18:15:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:419 3.as0 3:591714be:::smithi15432074-11:e [read 165282~14942,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-17T18:15:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:45.856254+0000", 2024-09-17T18:15:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6775667490000004, 2024-09-17T18:15:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.032807557000000001, 2024-09-17T18:15:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:15:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.645 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 419 2024-09-17T18:15:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856254+0000", 2024-09-17T18:15:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856254+0000", 2024-09-17T18:15:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856255+0000", 2024-09-17T18:15:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-17T18:15:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856261+0000", 2024-09-17T18:15:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.404e-06 2024-09-17T18:15:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856278+0000", 2024-09-17T18:15:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6415000000000001e-05 2024-09-17T18:15:50.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856291+0000", 2024-09-17T18:15:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2836999999999999e-05 2024-09-17T18:15:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.878696+0000", 2024-09-17T18:15:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022405571999999999 2024-09-17T18:15:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.878898+0000", 2024-09-17T18:15:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020193000000000001 2024-09-17T18:15:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.889061+0000", 2024-09-17T18:15:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010163333 2024-09-17T18:15:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:504 3.as0 3:591714be:::smithi15432074-11:head [append 0~0] snapc 10=[10,e,d,c,b,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:49.310261+0000", 2024-09-17T18:15:50.649 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.2235599640000001, 2024-09-17T18:15:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026997790000000001, 2024-09-17T18:15:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:15:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:15:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:15:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:15:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 504 2024-09-17T18:15:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:15:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:15:50.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.310261+0000", 2024-09-17T18:15:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:15:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.310261+0000", 2024-09-17T18:15:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:15:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:15:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.310262+0000", 2024-09-17T18:15:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.06e-06 2024-09-17T18:15:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:15:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.310267+0000", 2024-09-17T18:15:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6269999999999997e-06 2024-09-17T18:15:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:15:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.310284+0000", 2024-09-17T18:15:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6492000000000001e-05 2024-09-17T18:15:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:15:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.310296+0000", 2024-09-17T18:15:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.217e-05 2024-09-17T18:15:50.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.310572+0000", 2024-09-17T18:15:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027638400000000002 2024-09-17T18:15:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.310582+0000", 2024-09-17T18:15:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3030000000000005e-06 2024-09-17T18:15:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:15:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.319618+0000", 2024-09-17T18:15:50.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090363949999999992 2024-09-17T18:15:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:15:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.320017+0000", 2024-09-17T18:15:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039856700000000001 2024-09-17T18:15:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:15:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.321446+0000", 2024-09-17T18:15:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014295759999999999 2024-09-17T18:15:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:15:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.335271+0000", 2024-09-17T18:15:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013824341 2024-09-17T18:15:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:15:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.337169+0000", 2024-09-17T18:15:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001898201 2024-09-17T18:15:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:15:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:15:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:15:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.337258+0000", 2024-09-17T18:15:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9673999999999996e-05 2024-09-17T18:15:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.655 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:15:50.656 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:15:50.656 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:15:50.657 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T18:15:50.658 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:50.653+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:50.758 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:50.755+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:50.788 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:50.788 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:50.788 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:15:50.788 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:50.802 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T18:15:50.827 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T18:15:50.887 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:50.887+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:50.959 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:50.959+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:50.966 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:50.966 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:15:50.967 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:15:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:50.971 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:15:50.972 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:15:50.981 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T18:15:50.993 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:15:50.993 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:15:51.013 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:15:51.013 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:15:51.035 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:15:51.035 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:15:51.054 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:15:51.055 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:15:51.060 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:51.059+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:51.076 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:15:51.076 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:15:51.094 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:15:51.095 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:15:51.117 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:15:51.117 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:15:51.135 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:15:51.136 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:15:51.140 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:51.141 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:51.155 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T18:15:51.157 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:15:51.158 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:15:51.177 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:15:51.177 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:15:51.199 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:51.199+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:51.200 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:15:51.200 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:15:51.218 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:15:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:15:51.240 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:15:51.240 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:15:51.261 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:15:51.261 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:15:51.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:15:51.258+0000 7f6153fff640 0 -- 172.21.15.87:0/408188395 >> [v2:172.21.15.154:6824/3670919160,v1:172.21.15.154:6825/3670919160] conn(0x7f6154222e30 msgr2=0x7f6154225220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T18:15:51.262 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:51.258+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:51.288 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T18:15:51.315 INFO:teuthology.orchestra.run.smithi087.stderr:nodeep-scrub is set 2024-09-17T18:15:51.322 INFO:tasks.rados.rados.0.smithi154.stdout:206: done (2 left) 2024-09-17T18:15:51.322 INFO:tasks.rados.rados.0.smithi154.stdout:207: read oid 9 snap -1 2024-09-17T18:15:51.322 INFO:tasks.rados.rados.0.smithi154.stdout:207: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-17T18:15:51.322 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 7 current snap is 16 2024-09-17T18:15:51.322 INFO:tasks.rados.rados.0.smithi154.stdout:208: seq_num 97 ranges {3358720=475136,3833856=442368,4276224=442368,4718592=278528} 2024-09-17T18:15:51.364 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:51.361+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:51.386 INFO:tasks.rados.rados.0.smithi154.stdout:208: writing smithi15432074-7 from 3358720 to 3833856 tid 1 2024-09-17T18:15:51.391 INFO:tasks.rados.rados.0.smithi154.stdout:208: writing smithi15432074-7 from 3833856 to 4276224 tid 2 2024-09-17T18:15:51.395 INFO:tasks.rados.rados.0.smithi154.stdout:208: writing smithi15432074-7 from 4276224 to 4718592 tid 3 2024-09-17T18:15:51.398 INFO:tasks.rados.rados.0.smithi154.stdout:208: writing smithi15432074-7 from 4718592 to 4997120 tid 4 2024-09-17T18:15:51.398 INFO:tasks.rados.rados.0.smithi154.stdout:209: copy_from oid 29 from oid 15 current snap is 16 2024-09-17T18:15:51.399 INFO:tasks.rados.rados.0.smithi154.stdout:204: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-17T18:15:51.399 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:51.405 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 149065 2024-09-17T18:15:51.406 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:51.411 INFO:tasks.rados.rados.0.smithi154.stdout:205: expect (ObjNum 75 snap 7 seq_num 75) 2024-09-17T18:15:51.426 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1103326 2024-09-17T18:15:51.441 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 752861 2024-09-17T18:15:51.450 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:51.462 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:51.463 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:51.464 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:51.463+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:51.468 INFO:tasks.rados.rados.0.smithi154.stdout:207: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-17T18:15:51.468 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:51.470 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:51.472 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:51.474 INFO:tasks.rados.rados.0.smithi154.stdout:208: finishing write tid 1 to smithi15432074-7 2024-09-17T18:15:51.474 INFO:tasks.rados.rados.0.smithi154.stdout:208: finishing write tid 2 to smithi15432074-7 2024-09-17T18:15:51.474 INFO:tasks.rados.rados.0.smithi154.stdout:209: finishing copy_from to smithi15432074-29 2024-09-17T18:15:51.474 INFO:tasks.rados.rados.0.smithi154.stdout:209: got expected ENOENT (src dne) 2024-09-17T18:15:51.475 INFO:tasks.rados.rados.0.smithi154.stdout:209: finishing copy_from racing read to smithi15432074-29 2024-09-17T18:15:51.475 INFO:tasks.rados.rados.0.smithi154.stdout:208: finishing write tid 3 to smithi15432074-7 2024-09-17T18:15:51.475 INFO:tasks.rados.rados.0.smithi154.stdout:208: finishing write tid 4 to smithi15432074-7 2024-09-17T18:15:51.475 INFO:tasks.rados.rados.0.smithi154.stdout:208: finishing write tid 5 to smithi15432074-7 2024-09-17T18:15:51.475 INFO:tasks.rados.rados.0.smithi154.stdout:208: finishing write tid 6 to smithi15432074-7 2024-09-17T18:15:51.475 INFO:tasks.rados.rados.0.smithi154.stdout:208: oid 7 updating version 0 to 81 2024-09-17T18:15:51.475 INFO:tasks.rados.rados.0.smithi154.stdout:208: oid 7 version 81 is already newer than 79 2024-09-17T18:15:51.475 INFO:tasks.rados.rados.0.smithi154.stdout:208: oid 7 version 81 is already newer than 78 2024-09-17T18:15:51.475 INFO:tasks.rados.rados.0.smithi154.stdout:208: oid 7 updating version 81 to 82 2024-09-17T18:15:51.475 INFO:tasks.rados.rados.0.smithi154.stdout:208: oid 7 version 82 is already newer than 80 2024-09-17T18:15:51.475 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 7 v 82 (ObjNum 97 snap 16 seq_num 97) dirty exists 2024-09-17T18:15:51.475 INFO:tasks.rados.rados.0.smithi154.stdout:208: left oid 7 (ObjNum 97 snap 16 seq_num 97) 2024-09-17T18:15:51.475 INFO:tasks.rados.rados.0.smithi154.stdout:204: done (4 left) 2024-09-17T18:15:51.476 INFO:tasks.rados.rados.0.smithi154.stdout:205: done (3 left) 2024-09-17T18:15:51.476 INFO:tasks.rados.rados.0.smithi154.stdout:207: done (2 left) 2024-09-17T18:15:51.476 INFO:tasks.rados.rados.0.smithi154.stdout:208: done (1 left) 2024-09-17T18:15:51.476 INFO:tasks.rados.rados.0.smithi154.stdout:209: done (0 left) 2024-09-17T18:15:51.476 INFO:tasks.rados.rados.0.smithi154.stdout:210: snap_remove snap 9 2024-09-17T18:15:51.477 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T18:15:51.487 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:15:51.488 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:15:51.565 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:51.563+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:51.658 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T18:15:51.665 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:51.663+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:51.684 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T18:15:51.684 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T18:15:51.685 INFO:tasks.thrashosds.thrasher:Shrinking pool unique_pool_0 2024-09-17T18:15:51.685 INFO:tasks.ceph.ceph_manager.ceph:contract_pool unique_pool_0 by 10 min 16 2024-09-17T18:15:51.685 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:15:51.766 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:51.762+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:51.824 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:51.824 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:51.838 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T18:15:51.887 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:51.887+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:51.968 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:51.966+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:51.973 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T18:15:52.001 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:15:52.001 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:15:52.018 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-09-17T18:15:51.506867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":61358643,"num_objects":96,"num_object_clones":46,"num_object_copies":652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":2,"num_read":298,"num_read_kb":29875,"num_write":551,"num_write_kb":63954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":619,"ondisk_log_size":619,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":571608,"kb_used_data":109972,"kb_used_omap":24,"kb_used_meta":461223,"kb_avail":1509377832,"statfs":{"total":1546188226560,"available":1545602899968,"internally_reserved":0,"allocated":112611328,"data_stored":158845469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":472292433},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5619712,"num_objects":6,"num_object_clones":7,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":-1,"num_read":4,"num_read_kb":3,"num_write":59,"num_write_kb":4880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.660323"},"pg_stats":[{"pgid":"3.f","version":"43'14","reported_seq":101,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T18:15:46.853392+0000","last_change":"2024-09-17T18:15:46.854081+0000","last_active":"2024-09-17T18:15:46.853392+0000","last_peered":"2024-09-17T18:15:46.853392+0000","last_clean":"2024-09-17T18:15:46.853392+0000","last_became_active":"2024-09-17T18:15:28.090920+0000","last_became_peered":"2024-09-17T18:15:28.090920+0000","last_unstale":"2024-09-17T18:15:46.853392+0000","last_undegraded":"2024-09-17T18:15:46.853392+0000","last_fullsized":"2024-09-17T18:15:46.853392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:32.185754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014408800000000001,"stat_sum":{"num_bytes":1376256,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3799,"num_write":8,"num_write_kb":1424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3,15,14,2,11,0],"acting":[13,3,15,14,2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"2"},{"start":"f","length":"1"}]},{"pgid":"3.e","version":"50'7","reported_seq":96,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T18:15:46.848448+0000","last_change":"2024-09-17T18:15:46.849844+0000","last_active":"2024-09-17T18:15:46.848448+0000","last_peered":"2024-09-17T18:15:46.848448+0000","last_clean":"2024-09-17T18:15:46.848448+0000","last_became_active":"2024-09-17T18:15:28.110648+0000","last_became_peered":"2024-09-17T18:15:28.110648+0000","last_unstale":"2024-09-17T18:15:46.848448+0000","last_undegraded":"2024-09-17T18:15:46.848448+0000","last_fullsized":"2024-09-17T18:15:46.848448+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:42.226948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019471779999999999,"stat_sum":{"num_bytes":229376,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":417,"num_write":5,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14,6,13,8,3,12],"acting":[11,14,6,13,8,3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"2"},{"start":"f","length":"1"}]},{"pgid":"3.d","version":"51'106","reported_seq":198,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T18:15:46.908817+0000","last_change":"2024-09-17T18:15:46.853975+0000","last_active":"2024-09-17T18:15:46.908817+0000","last_peered":"2024-09-17T18:15:46.908817+0000","last_clean":"2024-09-17T18:15:46.908817+0000","last_became_active":"2024-09-17T18:15:28.273848+0000","last_became_peered":"2024-09-17T18:15:28.273848+0000","last_unstale":"2024-09-17T18:15:46.908817+0000","last_undegraded":"2024-09-17T18:15:46.908817+0000","last_fullsized":"2024-09-17T18:15:46.908817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.269861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001487868,"stat_sum":{"num_bytes":13320192,"num_objects":20,"num_object_clones":11,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":39,"num_read_kb":2539,"num_write":96,"num_write_kb":13488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,11,15,9,8,4],"acting":[13,1,11,15,9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"2"},{"start":"f","length":"1"}]},{"pgid":"3.c","version":"51'36","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T18:15:46.858267+0000","last_change":"2024-09-17T18:15:46.860513+0000","last_active":"2024-09-17T18:15:46.858267+0000","last_peered":"2024-09-17T18:15:46.858267+0000","last_clean":"2024-09-17T18:15:46.858267+0000","last_became_active":"2024-09-17T18:15:28.112093+0000","last_became_peered":"2024-09-17T18:15:28.112093+0000","last_unstale":"2024-09-17T18:15:46.858267+0000","last_undegraded":"2024-09-17T18:15:46.858267+0000","last_fullsized":"2024-09-17T18:15:46.858267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:47.465692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014792529,"stat_sum":{"num_bytes":5177344,"num_objects":8,"num_object_clones":4,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":20,"num_write_kb":5360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,3,7,12,14],"acting":[5,8,13,3,7,12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"2"},{"start":"f","length":"1"}]},{"pgid":"3.b","version":"53'62","reported_seq":150,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-17T18:15:48.310879+0000","last_change":"2024-09-17T18:15:47.896575+0000","last_active":"2024-09-17T18:15:48.310879+0000","last_peered":"2024-09-17T18:15:48.310879+0000","last_clean":"2024-09-17T18:15:48.310879+0000","last_became_active":"2024-09-17T18:15:28.111526+0000","last_became_peered":"2024-09-17T18:15:28.111526+0000","last_unstale":"2024-09-17T18:15:48.310879+0000","last_undegraded":"2024-09-17T18:15:48.310879+0000","last_fullsized":"2024-09-17T18:15:48.310879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:29.424434+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.047126375999999998,"stat_sum":{"num_bytes":7340032,"num_objects":10,"num_object_clones":6,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":15,"num_read_kb":9,"num_write":73,"num_write_kb":7920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,10,12,11,1,14],"acting":[4,0,10,12,11,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.a","version":"51'56","reported_seq":150,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T18:15:46.863378+0000","last_change":"2024-09-17T18:15:46.864873+0000","last_active":"2024-09-17T18:15:46.863378+0000","last_peered":"2024-09-17T18:15:46.863378+0000","last_clean":"2024-09-17T18:15:46.863378+0000","last_became_active":"2024-09-17T18:15:28.089449+0000","last_became_peered":"2024-09-17T18:15:28.089449+0000","last_unstale":"2024-09-17T18:15:46.863378+0000","last_undegraded":"2024-09-17T18:15:46.863378+0000","last_fullsized":"2024-09-17T18:15:46.863378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:52.316521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012102203000000001,"stat_sum":{"num_bytes":6340608,"num_objects":9,"num_object_clones":4,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":31,"num_read_kb":9440,"num_write":29,"num_write_kb":6528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,6,5,3,15,4],"acting":[13,1,6,5,3,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"2"},{"start":"f","length":"1"}]},{"pgid":"3.9","version":"53'63","reported_seq":156,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-17T18:15:48.534195+0000","last_change":"2024-09-17T18:15:47.892492+0000","last_active":"2024-09-17T18:15:48.534195+0000","last_peered":"2024-09-17T18:15:48.534195+0000","last_clean":"2024-09-17T18:15:48.534195+0000","last_became_active":"2024-09-17T18:15:28.095114+0000","last_became_peered":"2024-09-17T18:15:28.095114+0000","last_unstale":"2024-09-17T18:15:48.534195+0000","last_undegraded":"2024-09-17T18:15:48.534195+0000","last_fullsized":"2024-09-17T18:15:48.534195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:53.706310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037405572999999998,"stat_sum":{"num_bytes":7421952,"num_objects":11,"num_object_clones":7,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":1,"num_read":18,"num_read_kb":2980,"num_write":50,"num_write_kb":6496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,10,11,5,8,3],"acting":[7,2,10,11,5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"4","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.8","version":"53'28","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-17T18:15:48.399544+0000","last_change":"2024-09-17T18:15:47.873970+0000","last_active":"2024-09-17T18:15:48.399544+0000","last_peered":"2024-09-17T18:15:48.399544+0000","last_clean":"2024-09-17T18:15:48.399544+0000","last_became_active":"2024-09-17T18:15:28.088066+0000","last_became_peered":"2024-09-17T18:15:28.088066+0000","last_unstale":"2024-09-17T18:15:48.399544+0000","last_undegraded":"2024-09-17T18:15:48.399544+0000","last_fullsized":"2024-09-17T18:15:48.399544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:32.469539+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.016783972000000001,"stat_sum":{"num_bytes":3391488,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":15,"num_write_kb":4000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,11,3,15,1,7],"acting":[6,0,11,3,15,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4","length":"1"},{"start":"f","length":"1"}]},{"pgid":"1.0","version":"25'112","reported_seq":203,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-17T18:15:48.325411+0000","last_change":"2024-09-17T18:15:13.924291+0000","last_active":"2024-09-17T18:15:48.325411+0000","last_peered":"2024-09-17T18:15:48.325411+0000","last_clean":"2024-09-17T18:15:48.325411+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:15:48.325411+0000","last_undegraded":"2024-09-17T18:15:48.325411+0000","last_fullsized":"2024-09-17T18:15:48.325411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:15:12.533086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.379235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":72,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-17T18:15:48.306024+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:15:48.306024+0000","last_peered":"2024-09-17T18:15:48.306024+0000","last_clean":"2024-09-17T18:15:48.306024+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:15:48.306024+0000","last_undegraded":"2024-09-17T18:15:48.306024+0000","last_fullsized":"2024-09-17T18:15:48.306024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"53'26","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-17T18:15:48.316174+0000","last_change":"2024-09-17T18:15:47.877446+0000","last_active":"2024-09-17T18:15:48.316174+0000","last_peered":"2024-09-17T18:15:48.316174+0000","last_clean":"2024-09-17T18:15:48.316174+0000","last_became_active":"2024-09-17T18:15:28.089102+0000","last_became_peered":"2024-09-17T18:15:28.089102+0000","last_unstale":"2024-09-17T18:15:48.316174+0000","last_undegraded":"2024-09-17T18:15:48.316174+0000","last_fullsized":"2024-09-17T18:15:48.316174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.575481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026966614999999999,"stat_sum":{"num_bytes":1523712,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":29,"num_write_kb":1488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3,13,1,5,10,7],"acting":[14,3,13,1,5,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"4","length":"1"},{"start":"f","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T18:15:45.927257+0000","last_change":"2024-09-17T18:15:16.990099+0000","last_active":"2024-09-17T18:15:45.927257+0000","last_peered":"2024-09-17T18:15:45.927257+0000","last_clean":"2024-09-17T18:15:45.927257+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:15:45.927257+0000","last_undegraded":"2024-09-17T18:15:45.927257+0000","last_fullsized":"2024-09-17T18:15:45.927257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.933228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-17T18:15:48.309706+0000","last_change":"2024-09-17T18:15:47.850524+0000","last_active":"2024-09-17T18:15:48.309706+0000","last_peered":"2024-09-17T18:15:48.309706+0000","last_clean":"2024-09-17T18:15:48.309706+0000","last_became_active":"2024-09-17T18:15:28.094455+0000","last_became_peered":"2024-09-17T18:15:28.094455+0000","last_unstale":"2024-09-17T18:15:48.309706+0000","last_undegraded":"2024-09-17T18:15:48.309706+0000","last_fullsized":"2024-09-17T18:15:48.309706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:48.524564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013592070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,14,10,7,3,2],"acting":[4,13,14,10,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"},{"start":"f","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":71,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-17T18:15:48.305936+0000","last_change":"2024-09-17T18:15:17.499886+0000","last_active":"2024-09-17T18:15:48.305936+0000","last_peered":"2024-09-17T18:15:48.305936+0000","last_clean":"2024-09-17T18:15:48.305936+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:15:48.305936+0000","last_undegraded":"2024-09-17T18:15:48.305936+0000","last_fullsized":"2024-09-17T18:15:48.305936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.366017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"52'15","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-17T18:15:48.316982+0000","last_change":"2024-09-17T18:15:47.883830+0000","last_active":"2024-09-17T18:15:48.316982+0000","last_peered":"2024-09-17T18:15:48.316982+0000","last_clean":"2024-09-17T18:15:48.316982+0000","last_became_active":"2024-09-17T18:15:28.273637+0000","last_became_peered":"2024-09-17T18:15:28.273637+0000","last_unstale":"2024-09-17T18:15:48.316982+0000","last_undegraded":"2024-09-17T18:15:48.316982+0000","last_fullsized":"2024-09-17T18:15:48.316982+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:44.400486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020931219000000001,"stat_sum":{"num_bytes":2441216,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":8,"num_write_kb":2384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,9,2,6,15,4],"acting":[3,7,9,2,6,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"},{"start":"f","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":69,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T18:15:46.852559+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:15:46.852559+0000","last_peered":"2024-09-17T18:15:46.852559+0000","last_clean":"2024-09-17T18:15:46.852559+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:15:46.852559+0000","last_undegraded":"2024-09-17T18:15:46.852559+0000","last_fullsized":"2024-09-17T18:15:46.852559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:19.851941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"43'10","reported_seq":99,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T18:15:46.846682+0000","last_change":"2024-09-17T18:15:46.847662+0000","last_active":"2024-09-17T18:15:46.846682+0000","last_peered":"2024-09-17T18:15:46.846682+0000","last_clean":"2024-09-17T18:15:46.846682+0000","last_became_active":"2024-09-17T18:15:28.272974+0000","last_became_peered":"2024-09-17T18:15:28.272974+0000","last_unstale":"2024-09-17T18:15:46.846682+0000","last_undegraded":"2024-09-17T18:15:46.846682+0000","last_fullsized":"2024-09-17T18:15:46.846682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.497680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001726027,"stat_sum":{"num_bytes":1556480,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":419,"num_write":7,"num_write_kb":1520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4,13,11,2,5],"acting":[10,9,4,13,11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"2","length":"2"},{"start":"f","length":"1"}]},{"pgid":"3.5","version":"43'12","reported_seq":98,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T18:15:46.846601+0000","last_change":"2024-09-17T18:15:46.847308+0000","last_active":"2024-09-17T18:15:46.846601+0000","last_peered":"2024-09-17T18:15:46.846601+0000","last_clean":"2024-09-17T18:15:46.846601+0000","last_became_active":"2024-09-17T18:15:28.275306+0000","last_became_peered":"2024-09-17T18:15:28.275306+0000","last_unstale":"2024-09-17T18:15:46.846601+0000","last_undegraded":"2024-09-17T18:15:46.846601+0000","last_fullsized":"2024-09-17T18:15:46.846601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:44.018600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001471626,"stat_sum":{"num_bytes":376832,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":486,"num_write":24,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,11],"acting":[5,8,4,9,12,0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"2"},{"start":"f","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-17T18:15:48.309626+0000","last_change":"2024-09-17T18:15:16.605178+0000","last_active":"2024-09-17T18:15:48.309626+0000","last_peered":"2024-09-17T18:15:48.309626+0000","last_clean":"2024-09-17T18:15:48.309626+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:15:48.309626+0000","last_undegraded":"2024-09-17T18:15:48.309626+0000","last_fullsized":"2024-09-17T18:15:48.309626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":82,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T18:15:46.844688+0000","last_change":"2024-09-17T18:15:46.845047+0000","last_active":"2024-09-17T18:15:46.844688+0000","last_peered":"2024-09-17T18:15:46.844688+0000","last_clean":"2024-09-17T18:15:46.844688+0000","last_became_active":"2024-09-17T18:15:28.090551+0000","last_became_peered":"2024-09-17T18:15:28.090551+0000","last_unstale":"2024-09-17T18:15:46.844688+0000","last_undegraded":"2024-09-17T18:15:46.844688+0000","last_fullsized":"2024-09-17T18:15:46.844688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:53.053776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061172500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15,4,2,6,10,7],"acting":[8,15,4,2,6,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"2"},{"start":"f","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-17T18:15:48.386852+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:15:48.386852+0000","last_peered":"2024-09-17T18:15:48.386852+0000","last_clean":"2024-09-17T18:15:48.386852+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:15:48.386852+0000","last_undegraded":"2024-09-17T18:15:48.386852+0000","last_fullsized":"2024-09-17T18:15:48.386852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:14.501281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"53'48","reported_seq":157,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-17T18:15:48.322218+0000","last_change":"2024-09-17T18:15:47.897566+0000","last_active":"2024-09-17T18:15:48.322218+0000","last_peered":"2024-09-17T18:15:48.322218+0000","last_clean":"2024-09-17T18:15:48.322218+0000","last_became_active":"2024-09-17T18:15:27.692814+0000","last_became_peered":"2024-09-17T18:15:27.692814+0000","last_unstale":"2024-09-17T18:15:48.322218+0000","last_undegraded":"2024-09-17T18:15:48.322218+0000","last_fullsized":"2024-09-17T18:15:48.322218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:27.746083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046923256000000003,"stat_sum":{"num_bytes":6963200,"num_objects":10,"num_object_clones":5,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":33,"num_read_kb":8169,"num_write":26,"num_write_kb":6800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,0,14,10,13],"acting":[4,11,6,0,14,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"},{"start":"f","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T18:15:46.844341+0000","last_change":"2024-09-17T18:15:17.502621+0000","last_active":"2024-09-17T18:15:46.844341+0000","last_peered":"2024-09-17T18:15:46.844341+0000","last_clean":"2024-09-17T18:15:46.844341+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:15:46.844341+0000","last_undegraded":"2024-09-17T18:15:46.844341+0000","last_fullsized":"2024-09-17T18:15:46.844341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.990534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"43'21","reported_seq":99,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T18:15:45.925420+0000","last_change":"2024-09-17T18:15:38.790907+0000","last_active":"2024-09-17T18:15:45.925420+0000","last_peered":"2024-09-17T18:15:45.925420+0000","last_clean":"2024-09-17T18:15:45.925420+0000","last_became_active":"2024-09-17T18:15:28.272963+0000","last_became_peered":"2024-09-17T18:15:28.272963+0000","last_unstale":"2024-09-17T18:15:45.925420+0000","last_undegraded":"2024-09-17T18:15:45.925420+0000","last_fullsized":"2024-09-17T18:15:45.925420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.772408+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.019482095000000001,"stat_sum":{"num_bytes":3309568,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":1528,"num_write":14,"num_write_kb":3232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14,6,2,5,9,15],"acting":[0,14,6,2,5,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T18:15:46.852450+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:15:46.852450+0000","last_peered":"2024-09-17T18:15:46.852450+0000","last_clean":"2024-09-17T18:15:46.852450+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:15:46.852450+0000","last_undegraded":"2024-09-17T18:15:46.852450+0000","last_fullsized":"2024-09-17T18:15:46.852450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:17.193575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":60768256,"num_objects":92,"num_object_clones":46,"num_object_copies":644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":2,"num_read":212,"num_read_kb":29802,"num_write":404,"num_write_kb":61280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105873408,"data_stored":168013824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247819,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39480,"kb_used_data":8284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332360,"statfs":{"total":96636764160,"available":96596336640,"internally_reserved":0,"allocated":8482816,"data_stored":12278921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247819,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38392,"kb_used_data":7204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333448,"statfs":{"total":96636764160,"available":96597450752,"internally_reserved":0,"allocated":7376896,"data_stored":10463849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280523,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30896,"kb_used_data":3864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340944,"statfs":{"total":96636764160,"available":96605126656,"internally_reserved":0,"allocated":3956736,"data_stored":5771763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313227,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36680,"kb_used_data":5484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335160,"statfs":{"total":96636764160,"available":96599203840,"internally_reserved":0,"allocated":5615616,"data_stored":7862615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280523,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":9416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":9641984,"data_stored":14811635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313227,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":5400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":5529600,"data_stored":7356686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280521,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33620,"kb_used_data":6592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338220,"statfs":{"total":96636764160,"available":96602337280,"internally_reserved":0,"allocated":6750208,"data_stored":8624471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280522,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33268,"kb_used_data":6236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":6385664,"data_stored":9069024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,4,5,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313226,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41416,"kb_used_data":10228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330424,"statfs":{"total":96636764160,"available":96594354176,"internally_reserved":0,"allocated":10473472,"data_stored":15843808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280522,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39444,"kb_used_data":8248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332396,"statfs":{"total":96636764160,"available":96596373504,"internally_reserved":0,"allocated":8445952,"data_stored":12866016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280522,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":4620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":4730880,"data_stored":5525984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247817,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33564,"kb_used_data":6528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338276,"statfs":{"total":96636764160,"available":96602394624,"internally_reserved":0,"allocated":6684672,"data_stored":8350313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247819,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41060,"kb_used_data":9864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330780,"statfs":{"total":96636764160,"available":96594718720,"internally_reserved":0,"allocated":10100736,"data_stored":16032224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247819,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37904,"kb_used_data":6716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333936,"statfs":{"total":96636764160,"available":96597950464,"internally_reserved":0,"allocated":6877184,"data_stored":9294848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247818,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":4848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":4964352,"data_stored":5818985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280521,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":6440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":6594560,"data_stored":8874327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4960256,"data_stored":7516160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8499200,"data_stored":14737408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4059136,"data_stored":5169152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6377472,"data_stored":10149888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10866688,"data_stored":18538496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6459392,"data_stored":8957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5767168,"data_stored":8962048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4657152,"data_stored":7618560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":6299648,"data_stored":10084352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4890624,"data_stored":7020544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":5713920,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":9801728,"data_stored":15486976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":3280896,"data_stored":5414912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":8966144,"data_stored":14454784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":6844416,"data_stored":11706368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":8429568,"data_stored":13484032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:15:52.020 INFO:tasks.ceph.ceph_manager.ceph:would drop below min_pgs, proj 6, currently 16 2024-09-17T18:15:52.069 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:52.066+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:52.152 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T18:15:52.169 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:52.165+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:52.271 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:52.267+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:52.289 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T18:15:52.339 INFO:tasks.rados.rados.0.smithi154.stdout:210: done (0 left) 2024-09-17T18:15:52.339 INFO:tasks.rados.rados.0.smithi154.stdout:211: rmattr oid 47 current snap is 16 2024-09-17T18:15:52.339 INFO:tasks.rados.rados.0.smithi154.stdout:211: done (0 left) 2024-09-17T18:15:52.340 INFO:tasks.rados.rados.0.smithi154.stdout:212: rmattr oid 22 current snap is 16 2024-09-17T18:15:52.340 INFO:tasks.rados.rados.0.smithi154.stdout:212: done (0 left) 2024-09-17T18:15:52.340 INFO:tasks.rados.rados.0.smithi154.stdout:213: snap_remove snap 10 2024-09-17T18:15:52.372 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:52.370+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:52.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T18:15:52.472 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:52.470+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:52.573 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T18:15:52.575 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:52.573+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:52.675 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:52.673+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:52.705 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:52.705 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:52.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T18:15:52.777 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:52.774+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:52.877 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:52.873+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:52.892 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:52.892 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:52.906 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T18:15:52.978 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:15:52.975+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:15:53.074 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:53.074 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:53.079 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:53.079+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:53.088 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T18:15:53.180 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:53.177+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:53.212 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:53.212 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:53.226 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T18:15:53.311 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:53.309+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:53.346 INFO:tasks.rados.rados.0.smithi154.stdout:213: done (0 left) 2024-09-17T18:15:53.346 INFO:tasks.rados.rados.0.smithi154.stdout:214: snap_create 2024-09-17T18:15:53.346 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T18:15:53.382 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:53.379+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:53.408 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:53.408 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:53.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T18:15:53.483 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:53.483+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:53.510 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T18:15:53.584 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:53.583+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:53.588 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:53.588 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:53.602 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T18:15:53.648 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:15:53.648 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:15:53.668 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:15:53.669 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:15:53.685 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:53.683+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:53.689 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:15:53.689 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:15:53.710 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:15:53.711 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:15:53.725 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:53.726 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:53.728 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:15:53.728 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:15:53.740 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T18:15:53.750 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:15:53.750 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:15:53.770 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:15:53.771 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:15:53.785 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:53.783+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:53.789 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:15:53.789 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:15:53.806 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:15:53.806 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:15:53.827 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:15:53.828 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:15:53.849 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:15:53.849 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:15:53.861 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:53.861 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:53.870 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:15:53.870 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:15:53.875 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T18:15:53.888 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:15:53.889 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:15:53.909 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:15:53.910 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:15:53.923 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:53.921+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:53.931 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:15:53.931 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:15:53.949 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:15:53.949 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:15:53.988 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:53.987+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:54.000 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:54.000 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T18:15:54.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T18:15:54.001 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T18:15:54.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.001 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 39/31 ECSubWrite(tid=69, reqid=client.4565.0:269, at_version=39'18, trim_to=0'0, roll_forward_to=36'15))", 2024-09-17T18:15:54.001 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.765975+0000", 2024-09-17T18:15:54.001 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.231403353000001, 2024-09-17T18:15:54.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011777833, 2024-09-17T18:15:54.001 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.001 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.002 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.002 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.765975+0000", 2024-09-17T18:15:54.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.765975+0000", 2024-09-17T18:15:54.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.765977+0000", 2024-09-17T18:15:54.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1799999999999999e-06 2024-09-17T18:15:54.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766243+0000", 2024-09-17T18:15:54.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026578000000000002 2024-09-17T18:15:54.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766276+0000", 2024-09-17T18:15:54.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3646000000000003e-05 2024-09-17T18:15:54.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766299+0000", 2024-09-17T18:15:54.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2263e-05 2024-09-17T18:15:54.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766566+0000", 2024-09-17T18:15:54.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026779100000000003 2024-09-17T18:15:54.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766583+0000", 2024-09-17T18:15:54.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6521999999999999e-05 2024-09-17T18:15:54.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.777685+0000", 2024-09-17T18:15:54.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011102231000000001 2024-09-17T18:15:54.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.777753+0000", 2024-09-17T18:15:54.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7420000000000002e-05 2024-09-17T18:15:54.006 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.006 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.006 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.007 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 39/31 ECSubWrite(tid=70, reqid=client.4565.0:270, at_version=39'19, trim_to=0'0, roll_forward_to=36'15))", 2024-09-17T18:15:54.007 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.766377+0000", 2024-09-17T18:15:54.007 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.231001483, 2024-09-17T18:15:54.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011485324999999999, 2024-09-17T18:15:54.007 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.007 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.007 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.008 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766377+0000", 2024-09-17T18:15:54.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766377+0000", 2024-09-17T18:15:54.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766378+0000", 2024-09-17T18:15:54.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1999999999999999e-06 2024-09-17T18:15:54.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766415+0000", 2024-09-17T18:15:54.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6708999999999997e-05 2024-09-17T18:15:54.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766439+0000", 2024-09-17T18:15:54.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4363e-05 2024-09-17T18:15:54.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766479+0000", 2024-09-17T18:15:54.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9986e-05 2024-09-17T18:15:54.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.767681+0000", 2024-09-17T18:15:54.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0012016660000000001 2024-09-17T18:15:54.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.767705+0000", 2024-09-17T18:15:54.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4403e-05 2024-09-17T18:15:54.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.777803+0000", 2024-09-17T18:15:54.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01009794 2024-09-17T18:15:54.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.777862+0000", 2024-09-17T18:15:54.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9058000000000003e-05 2024-09-17T18:15:54.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.013 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.013 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 42/31 ECSubWrite(tid=88, reqid=client.4565.0:344, at_version=42'22, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:54.013 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:37.771689+0000", 2024-09-17T18:15:54.013 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 16.225689599999999, 2024-09-17T18:15:54.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012504325, 2024-09-17T18:15:54.013 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.013 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.014 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.014 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.771689+0000", 2024-09-17T18:15:54.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.771689+0000", 2024-09-17T18:15:54.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.771689+0000", 2024-09-17T18:15:54.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4499999999999997e-07 2024-09-17T18:15:54.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.771715+0000", 2024-09-17T18:15:54.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6347999999999999e-05 2024-09-17T18:15:54.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.771728+0000", 2024-09-17T18:15:54.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2277e-05 2024-09-17T18:15:54.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.771737+0000", 2024-09-17T18:15:54.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4239999999999999e-06 2024-09-17T18:15:54.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.776002+0000", 2024-09-17T18:15:54.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042652000000000002 2024-09-17T18:15:54.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.776014+0000", 2024-09-17T18:15:54.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1533e-05 2024-09-17T18:15:54.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.784130+0000", 2024-09-17T18:15:54.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0081161659999999993 2024-09-17T18:15:54.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.784193+0000", 2024-09-17T18:15:54.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2831999999999997e-05 2024-09-17T18:15:54.018 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.018 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.018 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.019 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.3s4 43/31 ECSubWrite(tid=16, reqid=osd.10.0:16, at_version=43'10, trim_to=0'0, roll_forward_to=35'8))", 2024-09-17T18:15:54.019 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.778541+0000", 2024-09-17T18:15:54.019 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.218836774, 2024-09-17T18:15:54.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013046759, 2024-09-17T18:15:54.019 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.019 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.019 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.019 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778541+0000", 2024-09-17T18:15:54.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778541+0000", 2024-09-17T18:15:54.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778542+0000", 2024-09-17T18:15:54.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1699999999999998e-07 2024-09-17T18:15:54.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778590+0000", 2024-09-17T18:15:54.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8161999999999997e-05 2024-09-17T18:15:54.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778617+0000", 2024-09-17T18:15:54.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6602999999999999e-05 2024-09-17T18:15:54.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778636+0000", 2024-09-17T18:15:54.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9689000000000001e-05 2024-09-17T18:15:54.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779038+0000", 2024-09-17T18:15:54.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00040146700000000002 2024-09-17T18:15:54.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779063+0000", 2024-09-17T18:15:54.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4822000000000001e-05 2024-09-17T18:15:54.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791491+0000", 2024-09-17T18:15:54.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012428658 2024-09-17T18:15:54.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791588+0000", 2024-09-17T18:15:54.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6741000000000001e-05 2024-09-17T18:15:54.025 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.025 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.025 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.025 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 43/31 ECSubWrite(tid=106, reqid=osd.4.0:104, at_version=0'0, trim_to=0'0, roll_forward_to=43'33))", 2024-09-17T18:15:54.025 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.781180+0000", 2024-09-17T18:15:54.026 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.216198500000001, 2024-09-17T18:15:54.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012022855000000001, 2024-09-17T18:15:54.026 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.026 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.026 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.026 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781180+0000", 2024-09-17T18:15:54.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781180+0000", 2024-09-17T18:15:54.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781182+0000", 2024-09-17T18:15:54.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9700000000000002e-06 2024-09-17T18:15:54.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781210+0000", 2024-09-17T18:15:54.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8419e-05 2024-09-17T18:15:54.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781246+0000", 2024-09-17T18:15:54.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5948999999999998e-05 2024-09-17T18:15:54.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781268+0000", 2024-09-17T18:15:54.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1636000000000001e-05 2024-09-17T18:15:54.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781688+0000", 2024-09-17T18:15:54.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00042073000000000002 2024-09-17T18:15:54.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781712+0000", 2024-09-17T18:15:54.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3963000000000001e-05 2024-09-17T18:15:54.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793132+0000", 2024-09-17T18:15:54.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011419383 2024-09-17T18:15:54.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793203+0000", 2024-09-17T18:15:54.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0804999999999997e-05 2024-09-17T18:15:54.031 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.031 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.031 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.031 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 43/31 ECSubWrite(tid=107, reqid=osd.4.0:107, at_version=43'35, trim_to=0'0, roll_forward_to=43'33))", 2024-09-17T18:15:54.032 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.785298+0000", 2024-09-17T18:15:54.032 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.212079827, 2024-09-17T18:15:54.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014982244, 2024-09-17T18:15:54.032 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.032 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.032 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.032 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785298+0000", 2024-09-17T18:15:54.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785298+0000", 2024-09-17T18:15:54.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785299+0000", 2024-09-17T18:15:54.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0470000000000001e-06 2024-09-17T18:15:54.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785355+0000", 2024-09-17T18:15:54.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5831999999999997e-05 2024-09-17T18:15:54.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785380+0000", 2024-09-17T18:15:54.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4533e-05 2024-09-17T18:15:54.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785399+0000", 2024-09-17T18:15:54.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9182e-05 2024-09-17T18:15:54.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791911+0000", 2024-09-17T18:15:54.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065122569999999996 2024-09-17T18:15:54.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791935+0000", 2024-09-17T18:15:54.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3536e-05 2024-09-17T18:15:54.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.800195+0000", 2024-09-17T18:15:54.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008260323 2024-09-17T18:15:54.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.800281+0000", 2024-09-17T18:15:54.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5533999999999998e-05 2024-09-17T18:15:54.037 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.037 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.037 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.037 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.fs5 43/31 ECSubWrite(tid=186, reqid=osd.13.0:182, at_version=0'0, trim_to=0'0, roll_forward_to=43'14))", 2024-09-17T18:15:54.037 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.789240+0000", 2024-09-17T18:15:54.037 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.208138199, 2024-09-17T18:15:54.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015813436, 2024-09-17T18:15:54.038 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.038 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.038 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.038 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789240+0000", 2024-09-17T18:15:54.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789240+0000", 2024-09-17T18:15:54.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789242+0000", 2024-09-17T18:15:54.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7099999999999999e-06 2024-09-17T18:15:54.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789265+0000", 2024-09-17T18:15:54.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3512000000000001e-05 2024-09-17T18:15:54.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789308+0000", 2024-09-17T18:15:54.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3306000000000002e-05 2024-09-17T18:15:54.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789332+0000", 2024-09-17T18:15:54.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.321e-05 2024-09-17T18:15:54.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.792912+0000", 2024-09-17T18:15:54.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035800799999999998 2024-09-17T18:15:54.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.792935+0000", 2024-09-17T18:15:54.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3516e-05 2024-09-17T18:15:54.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.804968+0000", 2024-09-17T18:15:54.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012033090999999999 2024-09-17T18:15:54.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.805053+0000", 2024-09-17T18:15:54.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5011000000000003e-05 2024-09-17T18:15:54.045 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.045 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.045 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.045 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.bs4 43/31 ECSubWrite(tid=109, reqid=osd.4.0:109, at_version=43'40, trim_to=0'0, roll_forward_to=43'38))", 2024-09-17T18:15:54.045 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.793281+0000", 2024-09-17T18:15:54.045 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.204096789999999, 2024-09-17T18:15:54.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012141458000000001, 2024-09-17T18:15:54.045 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.045 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.046 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.046 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793281+0000", 2024-09-17T18:15:54.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793281+0000", 2024-09-17T18:15:54.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793283+0000", 2024-09-17T18:15:54.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.739e-06 2024-09-17T18:15:54.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793323+0000", 2024-09-17T18:15:54.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0185999999999998e-05 2024-09-17T18:15:54.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793342+0000", 2024-09-17T18:15:54.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9176000000000001e-05 2024-09-17T18:15:54.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793363+0000", 2024-09-17T18:15:54.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0922999999999999e-05 2024-09-17T18:15:54.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793510+0000", 2024-09-17T18:15:54.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014694299999999999 2024-09-17T18:15:54.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793534+0000", 2024-09-17T18:15:54.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3536e-05 2024-09-17T18:15:54.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.805367+0000", 2024-09-17T18:15:54.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011832723 2024-09-17T18:15:54.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.805423+0000", 2024-09-17T18:15:54.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6232e-05 2024-09-17T18:15:54.050 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.050 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.050 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.050 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s3 43/31 ECSubWrite(tid=47, reqid=osd.7.0:47, at_version=43'34, trim_to=0'0, roll_forward_to=42'32))", 2024-09-17T18:15:54.051 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.793292+0000", 2024-09-17T18:15:54.051 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.204085797999999, 2024-09-17T18:15:54.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014048638, 2024-09-17T18:15:54.051 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.051 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.051 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.051 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793292+0000", 2024-09-17T18:15:54.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793292+0000", 2024-09-17T18:15:54.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793293+0000", 2024-09-17T18:15:54.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0499999999999999e-06 2024-09-17T18:15:54.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793348+0000", 2024-09-17T18:15:54.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4339000000000003e-05 2024-09-17T18:15:54.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793381+0000", 2024-09-17T18:15:54.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3015999999999997e-05 2024-09-17T18:15:54.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793403+0000", 2024-09-17T18:15:54.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2152999999999999e-05 2024-09-17T18:15:54.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793546+0000", 2024-09-17T18:15:54.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014272300000000001 2024-09-17T18:15:54.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793566+0000", 2024-09-17T18:15:54.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0843e-05 2024-09-17T18:15:54.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.807251+0000", 2024-09-17T18:15:54.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013684775999999999 2024-09-17T18:15:54.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.807341+0000", 2024-09-17T18:15:54.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9738e-05 2024-09-17T18:15:54.055 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.056 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.056 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.056 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.bs4 43/31 ECSubWrite(tid=110, reqid=osd.4.0:110, at_version=43'42, trim_to=0'0, roll_forward_to=43'38))", 2024-09-17T18:15:54.056 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.793414+0000", 2024-09-17T18:15:54.056 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.203963743999999, 2024-09-17T18:15:54.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017191942000000002, 2024-09-17T18:15:54.056 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.056 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.057 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.057 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793414+0000", 2024-09-17T18:15:54.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793414+0000", 2024-09-17T18:15:54.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793416+0000", 2024-09-17T18:15:54.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.68e-06 2024-09-17T18:15:54.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793465+0000", 2024-09-17T18:15:54.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8939e-05 2024-09-17T18:15:54.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793487+0000", 2024-09-17T18:15:54.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1959000000000001e-05 2024-09-17T18:15:54.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793506+0000", 2024-09-17T18:15:54.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8643000000000001e-05 2024-09-17T18:15:54.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794384+0000", 2024-09-17T18:15:54.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00087825200000000005 2024-09-17T18:15:54.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794407+0000", 2024-09-17T18:15:54.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3329e-05 2024-09-17T18:15:54.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810507+0000", 2024-09-17T18:15:54.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016100079 2024-09-17T18:15:54.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810606+0000", 2024-09-17T18:15:54.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9061000000000006e-05 2024-09-17T18:15:54.061 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.061 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.061 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.061 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s3 43/31 ECSubWrite(tid=48, reqid=osd.7.0:48, at_version=43'36, trim_to=0'0, roll_forward_to=42'32))", 2024-09-17T18:15:54.061 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.793451+0000", 2024-09-17T18:15:54.062 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.203927465, 2024-09-17T18:15:54.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016922466000000001, 2024-09-17T18:15:54.062 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.062 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.062 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.062 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793451+0000", 2024-09-17T18:15:54.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793451+0000", 2024-09-17T18:15:54.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793452+0000", 2024-09-17T18:15:54.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1030000000000001e-06 2024-09-17T18:15:54.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793498+0000", 2024-09-17T18:15:54.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6273000000000002e-05 2024-09-17T18:15:54.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793513+0000", 2024-09-17T18:15:54.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5270000000000001e-05 2024-09-17T18:15:54.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793524+0000", 2024-09-17T18:15:54.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1165999999999999e-05 2024-09-17T18:15:54.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.803042+0000", 2024-09-17T18:15:54.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009517111 2024-09-17T18:15:54.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.803071+0000", 2024-09-17T18:15:54.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9223000000000001e-05 2024-09-17T18:15:54.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810283+0000", 2024-09-17T18:15:54.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072125119999999999 2024-09-17T18:15:54.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810373+0000", 2024-09-17T18:15:54.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9808000000000005e-05 2024-09-17T18:15:54.068 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.068 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.068 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.069 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.5s6 43/31 ECSubWrite(tid=46, reqid=osd.5.0:46, at_version=43'12, trim_to=0'0, roll_forward_to=42'10))", 2024-09-17T18:15:54.069 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.793629+0000", 2024-09-17T18:15:54.069 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.203748652, 2024-09-17T18:15:54.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015350447999999999, 2024-09-17T18:15:54.069 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.069 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.069 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.069 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793629+0000", 2024-09-17T18:15:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793629+0000", 2024-09-17T18:15:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793630+0000", 2024-09-17T18:15:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4600000000000004e-07 2024-09-17T18:15:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793671+0000", 2024-09-17T18:15:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1146000000000002e-05 2024-09-17T18:15:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793695+0000", 2024-09-17T18:15:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4015999999999998e-05 2024-09-17T18:15:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793713+0000", 2024-09-17T18:15:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8076000000000001e-05 2024-09-17T18:15:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793976+0000", 2024-09-17T18:15:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026206999999999999 2024-09-17T18:15:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794001+0000", 2024-09-17T18:15:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5709000000000001e-05 2024-09-17T18:15:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.808902+0000", 2024-09-17T18:15:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014900943 2024-09-17T18:15:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.808980+0000", 2024-09-17T18:15:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7742000000000002e-05 2024-09-17T18:15:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 43/31 ECSubWrite(tid=187, reqid=client.4565.0:365, at_version=43'83, trim_to=0'0, roll_forward_to=43'79))", 2024-09-17T18:15:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.796751+0000", 2024-09-17T18:15:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.200626790999999, 2024-09-17T18:15:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012299391999999999, 2024-09-17T18:15:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796751+0000", 2024-09-17T18:15:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796751+0000", 2024-09-17T18:15:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796753+0000", 2024-09-17T18:15:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0329999999999998e-06 2024-09-17T18:15:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797011+0000", 2024-09-17T18:15:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025788699999999999 2024-09-17T18:15:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797057+0000", 2024-09-17T18:15:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5323e-05 2024-09-17T18:15:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797080+0000", 2024-09-17T18:15:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3642000000000002e-05 2024-09-17T18:15:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797329+0000", 2024-09-17T18:15:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024893099999999998 2024-09-17T18:15:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797355+0000", 2024-09-17T18:15:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5612000000000001e-05 2024-09-17T18:15:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.808990+0000", 2024-09-17T18:15:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011635184999999999 2024-09-17T18:15:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809051+0000", 2024-09-17T18:15:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0779000000000002e-05 2024-09-17T18:15:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 43/31 ECSubWrite(tid=189, reqid=osd.13.0:189, at_version=43'85, trim_to=0'0, roll_forward_to=43'81))", 2024-09-17T18:15:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.806979+0000", 2024-09-17T18:15:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.190398687, 2024-09-17T18:15:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011038406000000001, 2024-09-17T18:15:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.806979+0000", 2024-09-17T18:15:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.806979+0000", 2024-09-17T18:15:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.806982+0000", 2024-09-17T18:15:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1900000000000002e-06 2024-09-17T18:15:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.807033+0000", 2024-09-17T18:15:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1267999999999998e-05 2024-09-17T18:15:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.807103+0000", 2024-09-17T18:15:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0055000000000006e-05 2024-09-17T18:15:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.807127+0000", 2024-09-17T18:15:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3612999999999999e-05 2024-09-17T18:15:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.807681+0000", 2024-09-17T18:15:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000554632 2024-09-17T18:15:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.807705+0000", 2024-09-17T18:15:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3577000000000001e-05 2024-09-17T18:15:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.817925+0000", 2024-09-17T18:15:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010219845999999999 2024-09-17T18:15:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.818018+0000", 2024-09-17T18:15:54.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3225000000000003e-05 2024-09-17T18:15:54.083 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.083 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.083 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.083 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 43/31 ECSubWrite(tid=191, reqid=osd.13.0:191, at_version=43'87, trim_to=0'0, roll_forward_to=43'81))", 2024-09-17T18:15:54.083 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.809245+0000", 2024-09-17T18:15:54.083 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.188132813999999, 2024-09-17T18:15:54.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011584789999999999, 2024-09-17T18:15:54.083 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.084 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.084 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.084 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809245+0000", 2024-09-17T18:15:54.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809245+0000", 2024-09-17T18:15:54.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809247+0000", 2024-09-17T18:15:54.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.683e-06 2024-09-17T18:15:54.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809301+0000", 2024-09-17T18:15:54.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3764999999999998e-05 2024-09-17T18:15:54.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809331+0000", 2024-09-17T18:15:54.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9926000000000001e-05 2024-09-17T18:15:54.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809352+0000", 2024-09-17T18:15:54.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1633000000000001e-05 2024-09-17T18:15:54.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809580+0000", 2024-09-17T18:15:54.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022755099999999999 2024-09-17T18:15:54.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809604+0000", 2024-09-17T18:15:54.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3923000000000001e-05 2024-09-17T18:15:54.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.820715+0000", 2024-09-17T18:15:54.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011110943 2024-09-17T18:15:54.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.820830+0000", 2024-09-17T18:15:54.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011536600000000001 2024-09-17T18:15:54.088 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.088 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.088 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.088 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.3s4 54/31 ECSubWrite(tid=24, reqid=osd.10.0:24, at_version=54'17, trim_to=0'0, roll_forward_to=53'15))", 2024-09-17T18:15:54.088 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.328697+0000", 2024-09-17T18:15:54.089 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6686815990000001, 2024-09-17T18:15:54.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012777594, 2024-09-17T18:15:54.089 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.089 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.089 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.089 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328697+0000", 2024-09-17T18:15:54.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328697+0000", 2024-09-17T18:15:54.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328698+0000", 2024-09-17T18:15:54.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0839999999999999e-06 2024-09-17T18:15:54.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328756+0000", 2024-09-17T18:15:54.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8205000000000003e-05 2024-09-17T18:15:54.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328784+0000", 2024-09-17T18:15:54.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7858999999999999e-05 2024-09-17T18:15:54.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328806+0000", 2024-09-17T18:15:54.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2283e-05 2024-09-17T18:15:54.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328969+0000", 2024-09-17T18:15:54.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016340199999999999 2024-09-17T18:15:54.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328994+0000", 2024-09-17T18:15:54.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4936e-05 2024-09-17T18:15:54.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341350+0000", 2024-09-17T18:15:54.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012355484 2024-09-17T18:15:54.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341474+0000", 2024-09-17T18:15:54.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012434100000000001 2024-09-17T18:15:54.093 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.093 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.093 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.093 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 54/31 ECSubWrite(tid=281, reqid=osd.13.0:281, at_version=54'136, trim_to=0'0, roll_forward_to=53'132))", 2024-09-17T18:15:54.093 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.328882+0000", 2024-09-17T18:15:54.093 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6684960640000002, 2024-09-17T18:15:54.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012618901, 2024-09-17T18:15:54.093 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.094 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.094 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.094 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328882+0000", 2024-09-17T18:15:54.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328882+0000", 2024-09-17T18:15:54.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328883+0000", 2024-09-17T18:15:54.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3239999999999999e-06 2024-09-17T18:15:54.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328928+0000", 2024-09-17T18:15:54.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4864999999999998e-05 2024-09-17T18:15:54.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328951+0000", 2024-09-17T18:15:54.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2512999999999999e-05 2024-09-17T18:15:54.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328969+0000", 2024-09-17T18:15:54.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8185999999999998e-05 2024-09-17T18:15:54.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329160+0000", 2024-09-17T18:15:54.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000190815 2024-09-17T18:15:54.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329186+0000", 2024-09-17T18:15:54.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6630000000000001e-05 2024-09-17T18:15:54.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341402+0000", 2024-09-17T18:15:54.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012215561 2024-09-17T18:15:54.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341501+0000", 2024-09-17T18:15:54.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9006999999999996e-05 2024-09-17T18:15:54.098 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.098 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.098 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.098 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 54/31 ECSubWrite(tid=147, reqid=osd.4.0:147, at_version=54'50, trim_to=0'0, roll_forward_to=53'48))", 2024-09-17T18:15:54.098 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.329157+0000", 2024-09-17T18:15:54.098 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6682216040000002, 2024-09-17T18:15:54.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012598588000000001, 2024-09-17T18:15:54.099 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.099 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.099 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.099 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329157+0000", 2024-09-17T18:15:54.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329157+0000", 2024-09-17T18:15:54.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329159+0000", 2024-09-17T18:15:54.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9999999999999999e-06 2024-09-17T18:15:54.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329209+0000", 2024-09-17T18:15:54.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0071999999999998e-05 2024-09-17T18:15:54.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329238+0000", 2024-09-17T18:15:54.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.906e-05 2024-09-17T18:15:54.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329260+0000", 2024-09-17T18:15:54.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2008999999999999e-05 2024-09-17T18:15:54.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329413+0000", 2024-09-17T18:15:54.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153516 2024-09-17T18:15:54.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329435+0000", 2024-09-17T18:15:54.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2201999999999999e-05 2024-09-17T18:15:54.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341674+0000", 2024-09-17T18:15:54.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012239053999999999 2024-09-17T18:15:54.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341755+0000", 2024-09-17T18:15:54.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0674999999999996e-05 2024-09-17T18:15:54.103 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.103 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.103 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.103 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s2 54/31 ECSubWrite(tid=146, reqid=client.4565.0:510, at_version=54'29, trim_to=0'0, roll_forward_to=53'28))", 2024-09-17T18:15:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.332335+0000", 2024-09-17T18:15:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6650436199999996, 2024-09-17T18:15:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011839348, 2024-09-17T18:15:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332335+0000", 2024-09-17T18:15:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332335+0000", 2024-09-17T18:15:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332340+0000", 2024-09-17T18:15:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.434e-06 2024-09-17T18:15:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332464+0000", 2024-09-17T18:15:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012394700000000001 2024-09-17T18:15:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332490+0000", 2024-09-17T18:15:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5809e-05 2024-09-17T18:15:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332512+0000", 2024-09-17T18:15:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2065999999999998e-05 2024-09-17T18:15:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332916+0000", 2024-09-17T18:15:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00040443199999999998 2024-09-17T18:15:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332938+0000", 2024-09-17T18:15:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1574e-05 2024-09-17T18:15:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.344137+0000", 2024-09-17T18:15:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011198852 2024-09-17T18:15:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.344174+0000", 2024-09-17T18:15:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7234000000000003e-05 2024-09-17T18:15:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 54/31 ECSubWrite(tid=287, reqid=osd.13.0:287, at_version=54'140, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:15:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.346195+0000", 2024-09-17T18:15:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6511827600000002, 2024-09-17T18:15:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012184449999999999, 2024-09-17T18:15:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346195+0000", 2024-09-17T18:15:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346195+0000", 2024-09-17T18:15:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346197+0000", 2024-09-17T18:15:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.486e-06 2024-09-17T18:15:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346253+0000", 2024-09-17T18:15:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5942000000000001e-05 2024-09-17T18:15:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346283+0000", 2024-09-17T18:15:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9796000000000001e-05 2024-09-17T18:15:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346303+0000", 2024-09-17T18:15:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0112999999999999e-05 2024-09-17T18:15:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.347083+0000", 2024-09-17T18:15:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00078017099999999997 2024-09-17T18:15:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.347095+0000", 2024-09-17T18:15:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1640999999999999e-05 2024-09-17T18:15:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.358346+0000", 2024-09-17T18:15:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011251116 2024-09-17T18:15:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.358380+0000", 2024-09-17T18:15:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4184999999999999e-05 2024-09-17T18:15:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.113 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:54.115 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T18:15:54.115 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:15:54.115+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:15:54.216 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:54.215+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:54.286 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:54.286 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:15:54.287 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T18:15:54.287 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:54.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T18:15:54.316 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:54.314+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:54.349 INFO:teuthology.orchestra.run.smithi087.stderr:noscrub is unset 2024-09-17T18:15:54.356 INFO:tasks.rados.rados.0.smithi154.stdout:214: done (0 left) 2024-09-17T18:15:54.356 INFO:tasks.rados.rados.0.smithi154.stdout:215: copy_from oid 15 from oid 2 current snap is 17 2024-09-17T18:15:54.356 INFO:tasks.rados.rados.0.smithi154.stdout:216: copy_from oid 12 from oid 7 current snap is 17 2024-09-17T18:15:54.357 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 17 current snap is 17 2024-09-17T18:15:54.357 INFO:tasks.rados.rados.0.smithi154.stdout:217: seq_num 98 ranges {278528=491520,770048=589824,1359872=557056,1916928=16384} 2024-09-17T18:15:54.361 INFO:tasks.rados.rados.0.smithi154.stdout:217: writing smithi15432074-17 from 278528 to 770048 tid 1 2024-09-17T18:15:54.367 INFO:tasks.rados.rados.0.smithi154.stdout:217: writing smithi15432074-17 from 770048 to 1359872 tid 2 2024-09-17T18:15:54.372 INFO:tasks.rados.rados.0.smithi154.stdout:217: writing smithi15432074-17 from 1359872 to 1916928 tid 3 2024-09-17T18:15:54.372 INFO:tasks.rados.rados.0.smithi154.stdout:217: writing smithi15432074-17 from 1916928 to 1933312 tid 4 2024-09-17T18:15:54.372 INFO:tasks.rados.rados.0.smithi154.stdout:218: snap_create 2024-09-17T18:15:54.387 INFO:tasks.rados.rados.0.smithi154.stdout:215: finishing copy_from racing read to smithi15432074-15 2024-09-17T18:15:54.388 INFO:tasks.rados.rados.0.smithi154.stdout:217: finishing write tid 1 to smithi15432074-17 2024-09-17T18:15:54.388 INFO:tasks.rados.rados.0.smithi154.stdout:217: finishing write tid 2 to smithi15432074-17 2024-09-17T18:15:54.389 INFO:tasks.rados.rados.0.smithi154.stdout:215: finishing copy_from to smithi15432074-15 2024-09-17T18:15:54.389 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 15 v 123 (ObjNum 92 snap 15 seq_num 92) dirty exists 2024-09-17T18:15:54.399 INFO:tasks.rados.rados.0.smithi154.stdout:217: finishing write tid 3 to smithi15432074-17 2024-09-17T18:15:54.399 INFO:tasks.rados.rados.0.smithi154.stdout:217: finishing write tid 4 to smithi15432074-17 2024-09-17T18:15:54.409 INFO:tasks.rados.rados.0.smithi154.stdout:217: finishing write tid 5 to smithi15432074-17 2024-09-17T18:15:54.413 INFO:tasks.rados.rados.0.smithi154.stdout:217: finishing write tid 6 to smithi15432074-17 2024-09-17T18:15:54.413 INFO:tasks.rados.rados.0.smithi154.stdout:217: oid 17 updating version 0 to 124 2024-09-17T18:15:54.413 INFO:tasks.rados.rados.0.smithi154.stdout:217: oid 17 version 124 is already newer than 106 2024-09-17T18:15:54.414 INFO:tasks.rados.rados.0.smithi154.stdout:217: oid 17 updating version 124 to 125 2024-09-17T18:15:54.414 INFO:tasks.rados.rados.0.smithi154.stdout:217: oid 17 updating version 125 to 126 2024-09-17T18:15:54.414 INFO:tasks.rados.rados.0.smithi154.stdout:217: oid 17 version 126 is already newer than 105 2024-09-17T18:15:54.414 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 17 v 126 (ObjNum 98 snap 17 seq_num 98) dirty exists 2024-09-17T18:15:54.414 INFO:tasks.rados.rados.0.smithi154.stdout:217: left oid 17 (ObjNum 98 snap 17 seq_num 98) 2024-09-17T18:15:54.414 INFO:tasks.rados.rados.0.smithi154.stdout:216: finishing copy_from racing read to smithi15432074-12 2024-09-17T18:15:54.419 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:54.418+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:54.419 INFO:tasks.rados.rados.0.smithi154.stdout:216: finishing copy_from to smithi15432074-12 2024-09-17T18:15:54.419 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 12 v 82 (ObjNum 97 snap 16 seq_num 97) dirty exists 2024-09-17T18:15:54.431 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:15:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T18:15:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T18:15:54.432 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:54.446 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T18:15:54.519 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:54.519+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:54.569 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:15:54.569 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T18:15:54.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T18:15:54.570 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T18:15:54.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.570 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:90 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'64, mlcod=24'60)", 2024-09-17T18:15:54.570 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.281166+0000", 2024-09-17T18:15:54.570 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 40.285424747999997, 2024-09-17T18:15:54.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095065170000000008, 2024-09-17T18:15:54.570 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.570 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.570 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:54.570 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281166+0000", 2024-09-17T18:15:54.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281166+0000", 2024-09-17T18:15:54.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281167+0000", 2024-09-17T18:15:54.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0899999999999999e-06 2024-09-17T18:15:54.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281237+0000", 2024-09-17T18:15:54.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9974999999999993e-05 2024-09-17T18:15:54.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281258+0000", 2024-09-17T18:15:54.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0948999999999999e-05 2024-09-17T18:15:54.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281273+0000", 2024-09-17T18:15:54.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4844000000000001e-05 2024-09-17T18:15:54.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281378+0000", 2024-09-17T18:15:54.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104987 2024-09-17T18:15:54.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:54.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281407+0000", 2024-09-17T18:15:54.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8841999999999999e-05 2024-09-17T18:15:54.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:54.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290614+0000", 2024-09-17T18:15:54.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092069390000000008 2024-09-17T18:15:54.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290672+0000", 2024-09-17T18:15:54.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8891000000000002e-05 2024-09-17T18:15:54.574 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.574 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.574 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.574 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:91 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'65, mlcod=24'60)", 2024-09-17T18:15:54.574 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.281625+0000", 2024-09-17T18:15:54.574 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 40.284966122999997, 2024-09-17T18:15:54.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090883079999999998, 2024-09-17T18:15:54.575 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.575 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.575 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:54.575 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281625+0000", 2024-09-17T18:15:54.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281625+0000", 2024-09-17T18:15:54.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281626+0000", 2024-09-17T18:15:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.184e-06 2024-09-17T18:15:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281637+0000", 2024-09-17T18:15:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1153e-05 2024-09-17T18:15:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281657+0000", 2024-09-17T18:15:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0446e-05 2024-09-17T18:15:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281673+0000", 2024-09-17T18:15:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6042999999999999e-05 2024-09-17T18:15:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284250+0000", 2024-09-17T18:15:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002576212 2024-09-17T18:15:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284279+0000", 2024-09-17T18:15:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9788999999999999e-05 2024-09-17T18:15:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290678+0000", 2024-09-17T18:15:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006399035 2024-09-17T18:15:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290713+0000", 2024-09-17T18:15:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4446000000000002e-05 2024-09-17T18:15:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:92 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'66, mlcod=24'60)", 2024-09-17T18:15:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.282093+0000", 2024-09-17T18:15:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 40.284497510999998, 2024-09-17T18:15:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086526520000000003, 2024-09-17T18:15:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282093+0000", 2024-09-17T18:15:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282093+0000", 2024-09-17T18:15:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282094+0000", 2024-09-17T18:15:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7300000000000004e-07 2024-09-17T18:15:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282102+0000", 2024-09-17T18:15:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9869999999999999e-06 2024-09-17T18:15:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282120+0000", 2024-09-17T18:15:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7753000000000001e-05 2024-09-17T18:15:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282135+0000", 2024-09-17T18:15:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5216e-05 2024-09-17T18:15:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284810+0000", 2024-09-17T18:15:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026748789999999998 2024-09-17T18:15:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284862+0000", 2024-09-17T18:15:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1668000000000001e-05 2024-09-17T18:15:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290715+0000", 2024-09-17T18:15:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058529369999999999 2024-09-17T18:15:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290746+0000", 2024-09-17T18:15:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1238999999999997e-05 2024-09-17T18:15:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:95 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'69, mlcod=24'60)", 2024-09-17T18:15:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.283758+0000", 2024-09-17T18:15:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 40.282832980000002, 2024-09-17T18:15:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090648919999999997, 2024-09-17T18:15:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283758+0000", 2024-09-17T18:15:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283758+0000", 2024-09-17T18:15:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283760+0000", 2024-09-17T18:15:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9599999999999999e-06 2024-09-17T18:15:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283771+0000", 2024-09-17T18:15:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1487e-05 2024-09-17T18:15:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283800+0000", 2024-09-17T18:15:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9164999999999999e-05 2024-09-17T18:15:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283818+0000", 2024-09-17T18:15:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8067000000000002e-05 2024-09-17T18:15:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286791+0000", 2024-09-17T18:15:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029726010000000001 2024-09-17T18:15:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286832+0000", 2024-09-17T18:15:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0723000000000003e-05 2024-09-17T18:15:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292715+0000", 2024-09-17T18:15:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058835650000000003 2024-09-17T18:15:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292823+0000", 2024-09-17T18:15:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000107324 2024-09-17T18:15:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:96 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'70, mlcod=24'60)", 2024-09-17T18:15:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.284198+0000", 2024-09-17T18:15:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 40.282392737999999, 2024-09-17T18:15:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086761919999999992, 2024-09-17T18:15:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284198+0000", 2024-09-17T18:15:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284198+0000", 2024-09-17T18:15:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284205+0000", 2024-09-17T18:15:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7039999999999997e-06 2024-09-17T18:15:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284273+0000", 2024-09-17T18:15:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8454000000000006e-05 2024-09-17T18:15:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284297+0000", 2024-09-17T18:15:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3847000000000001e-05 2024-09-17T18:15:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284310+0000", 2024-09-17T18:15:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2826000000000001e-05 2024-09-17T18:15:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.287308+0000", 2024-09-17T18:15:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029979109999999998 2024-09-17T18:15:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:15:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.287336+0000", 2024-09-17T18:15:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8073e-05 2024-09-17T18:15:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:15:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292826+0000", 2024-09-17T18:15:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054905249999999996 2024-09-17T18:15:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292874+0000", 2024-09-17T18:15:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7852000000000002e-05 2024-09-17T18:15:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 39/31 ECSubWrite(tid=113, reqid=client.4565.0:283, at_version=0'0, trim_to=0'0, roll_forward_to=39'42))", 2024-09-17T18:15:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.784542+0000", 2024-09-17T18:15:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.782048512999999, 2024-09-17T18:15:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084139260000000004, 2024-09-17T18:15:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784542+0000", 2024-09-17T18:15:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784542+0000", 2024-09-17T18:15:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784545+0000", 2024-09-17T18:15:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0340000000000001e-06 2024-09-17T18:15:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784583+0000", 2024-09-17T18:15:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7394999999999997e-05 2024-09-17T18:15:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784763+0000", 2024-09-17T18:15:54.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018085599999999999 2024-09-17T18:15:54.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784791+0000", 2024-09-17T18:15:54.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7152999999999999e-05 2024-09-17T18:15:54.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785281+0000", 2024-09-17T18:15:54.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049054100000000005 2024-09-17T18:15:54.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785602+0000", 2024-09-17T18:15:54.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032048500000000002 2024-09-17T18:15:54.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.792898+0000", 2024-09-17T18:15:54.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072960669999999998 2024-09-17T18:15:54.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.792956+0000", 2024-09-17T18:15:54.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8394999999999999e-05 2024-09-17T18:15:54.598 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.598 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.598 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.598 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 43/31 ECSubWrite(tid=184, reqid=osd.13.0:184, at_version=43'81, trim_to=0'0, roll_forward_to=42'77))", 2024-09-17T18:15:54.599 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.777979+0000", 2024-09-17T18:15:54.599 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.788612003000001, 2024-09-17T18:15:54.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011903690999999999, 2024-09-17T18:15:54.599 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.599 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.599 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.599 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777979+0000", 2024-09-17T18:15:54.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777979+0000", 2024-09-17T18:15:54.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777981+0000", 2024-09-17T18:15:54.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9230000000000001e-06 2024-09-17T18:15:54.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778028+0000", 2024-09-17T18:15:54.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7624999999999999e-05 2024-09-17T18:15:54.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778061+0000", 2024-09-17T18:15:54.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2329000000000002e-05 2024-09-17T18:15:54.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778084+0000", 2024-09-17T18:15:54.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3597000000000001e-05 2024-09-17T18:15:54.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778224+0000", 2024-09-17T18:15:54.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000139596 2024-09-17T18:15:54.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778247+0000", 2024-09-17T18:15:54.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3456e-05 2024-09-17T18:15:54.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789790+0000", 2024-09-17T18:15:54.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011542943999999999 2024-09-17T18:15:54.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789882+0000", 2024-09-17T18:15:54.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2220999999999997e-05 2024-09-17T18:15:54.603 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.603 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.603 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.603 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 43/31 ECSubWrite(tid=187, reqid=client.4565.0:365, at_version=43'83, trim_to=0'0, roll_forward_to=43'79))", 2024-09-17T18:15:54.603 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.797287+0000", 2024-09-17T18:15:54.603 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.769303811, 2024-09-17T18:15:54.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011900196, 2024-09-17T18:15:54.603 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.603 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.604 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.604 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797287+0000", 2024-09-17T18:15:54.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797287+0000", 2024-09-17T18:15:54.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797289+0000", 2024-09-17T18:15:54.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1100000000000001e-06 2024-09-17T18:15:54.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797415+0000", 2024-09-17T18:15:54.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012599 2024-09-17T18:15:54.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797448+0000", 2024-09-17T18:15:54.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2866e-05 2024-09-17T18:15:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797470+0000", 2024-09-17T18:15:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1722e-05 2024-09-17T18:15:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797684+0000", 2024-09-17T18:15:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021480800000000001 2024-09-17T18:15:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797708+0000", 2024-09-17T18:15:54.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4063e-05 2024-09-17T18:15:54.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809114+0000", 2024-09-17T18:15:54.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011405279000000001 2024-09-17T18:15:54.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809187+0000", 2024-09-17T18:15:54.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3357999999999998e-05 2024-09-17T18:15:54.607 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.607 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.607 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s4 43/31 ECSubWrite(tid=137, reqid=osd.6.0:136, at_version=0'0, trim_to=0'0, roll_forward_to=43'21))", 2024-09-17T18:15:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.800888+0000", 2024-09-17T18:15:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.765703030999999, 2024-09-17T18:15:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082579720000000006, 2024-09-17T18:15:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.800888+0000", 2024-09-17T18:15:54.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.800888+0000", 2024-09-17T18:15:54.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.800889+0000", 2024-09-17T18:15:54.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.779e-06 2024-09-17T18:15:54.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.800918+0000", 2024-09-17T18:15:54.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8223000000000001e-05 2024-09-17T18:15:54.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.800945+0000", 2024-09-17T18:15:54.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6959000000000001e-05 2024-09-17T18:15:54.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.800966+0000", 2024-09-17T18:15:54.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1212999999999998e-05 2024-09-17T18:15:54.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.801104+0000", 2024-09-17T18:15:54.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013809 2024-09-17T18:15:54.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.801128+0000", 2024-09-17T18:15:54.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4448999999999999e-05 2024-09-17T18:15:54.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809040+0000", 2024-09-17T18:15:54.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079118550000000006 2024-09-17T18:15:54.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809146+0000", 2024-09-17T18:15:54.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105404 2024-09-17T18:15:54.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.612 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.612 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 43/31 ECSubWrite(tid=191, reqid=osd.13.0:191, at_version=43'87, trim_to=0'0, roll_forward_to=43'81))", 2024-09-17T18:15:54.613 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.809389+0000", 2024-09-17T18:15:54.613 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.757201292, 2024-09-17T18:15:54.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082897890000000005, 2024-09-17T18:15:54.613 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.613 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.613 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.613 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809389+0000", 2024-09-17T18:15:54.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809389+0000", 2024-09-17T18:15:54.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809391+0000", 2024-09-17T18:15:54.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7570000000000001e-06 2024-09-17T18:15:54.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809469+0000", 2024-09-17T18:15:54.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8164000000000006e-05 2024-09-17T18:15:54.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809527+0000", 2024-09-17T18:15:54.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7843000000000002e-05 2024-09-17T18:15:54.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809549+0000", 2024-09-17T18:15:54.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1951999999999999e-05 2024-09-17T18:15:54.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809765+0000", 2024-09-17T18:15:54.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021605800000000001 2024-09-17T18:15:54.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809796+0000", 2024-09-17T18:15:54.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0565000000000003e-05 2024-09-17T18:15:54.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.817599+0000", 2024-09-17T18:15:54.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0078028849999999999 2024-09-17T18:15:54.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.817679+0000", 2024-09-17T18:15:54.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0564999999999999e-05 2024-09-17T18:15:54.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.617 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.617 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.as5 54/31 ECSubWrite(tid=278, reqid=client.4565.0:503, at_version=54'72, trim_to=0'0, roll_forward_to=52'68))", 2024-09-17T18:15:54.617 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.319767+0000", 2024-09-17T18:15:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.246824052, 2024-09-17T18:15:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092036860000000009, 2024-09-17T18:15:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319767+0000", 2024-09-17T18:15:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319767+0000", 2024-09-17T18:15:54.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319769+0000", 2024-09-17T18:15:54.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9970000000000001e-06 2024-09-17T18:15:54.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319816+0000", 2024-09-17T18:15:54.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7802000000000001e-05 2024-09-17T18:15:54.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319850+0000", 2024-09-17T18:15:54.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3958999999999998e-05 2024-09-17T18:15:54.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319873+0000", 2024-09-17T18:15:54.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2133e-05 2024-09-17T18:15:54.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.323357+0000", 2024-09-17T18:15:54.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003484872 2024-09-17T18:15:54.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.323384+0000", 2024-09-17T18:15:54.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7067999999999999e-05 2024-09-17T18:15:54.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328876+0000", 2024-09-17T18:15:54.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054916069999999999 2024-09-17T18:15:54.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328970+0000", 2024-09-17T18:15:54.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4247999999999996e-05 2024-09-17T18:15:54.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.622 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.622 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s4 54/31 ECSubWrite(tid=147, reqid=osd.6.0:147, at_version=54'31, trim_to=0'0, roll_forward_to=53'28))", 2024-09-17T18:15:54.622 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.339770+0000", 2024-09-17T18:15:54.622 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.2268207789999996, 2024-09-17T18:15:54.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020146240999999999, 2024-09-17T18:15:54.622 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.622 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.622 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.623 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339770+0000", 2024-09-17T18:15:54.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339770+0000", 2024-09-17T18:15:54.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339772+0000", 2024-09-17T18:15:54.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4200000000000001e-06 2024-09-17T18:15:54.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339846+0000", 2024-09-17T18:15:54.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3957999999999999e-05 2024-09-17T18:15:54.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339891+0000", 2024-09-17T18:15:54.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5132000000000001e-05 2024-09-17T18:15:54.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339916+0000", 2024-09-17T18:15:54.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4542e-05 2024-09-17T18:15:54.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.340222+0000", 2024-09-17T18:15:54.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030566300000000002 2024-09-17T18:15:54.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.340249+0000", 2024-09-17T18:15:54.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6996e-05 2024-09-17T18:15:54.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.359838+0000", 2024-09-17T18:15:54.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019589558 2024-09-17T18:15:54.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.359916+0000", 2024-09-17T18:15:54.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7972000000000005e-05 2024-09-17T18:15:54.626 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.626 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.626 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.627 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 54/31 ECSubWrite(tid=285, reqid=osd.13.0:281, at_version=0'0, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:15:54.627 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.342575+0000", 2024-09-17T18:15:54.627 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.2240161260000004, 2024-09-17T18:15:54.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019330185, 2024-09-17T18:15:54.627 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.627 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.627 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.627 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342575+0000", 2024-09-17T18:15:54.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342575+0000", 2024-09-17T18:15:54.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342576+0000", 2024-09-17T18:15:54.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8160000000000001e-06 2024-09-17T18:15:54.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342605+0000", 2024-09-17T18:15:54.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8683e-05 2024-09-17T18:15:54.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342639+0000", 2024-09-17T18:15:54.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4279000000000002e-05 2024-09-17T18:15:54.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342663+0000", 2024-09-17T18:15:54.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3672e-05 2024-09-17T18:15:54.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342819+0000", 2024-09-17T18:15:54.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015606300000000001 2024-09-17T18:15:54.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342843+0000", 2024-09-17T18:15:54.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3643e-05 2024-09-17T18:15:54.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.361867+0000", 2024-09-17T18:15:54.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019024627999999998 2024-09-17T18:15:54.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.361905+0000", 2024-09-17T18:15:54.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7401000000000003e-05 2024-09-17T18:15:54.631 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.631 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.631 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.632 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s4 54/31 ECSubWrite(tid=148, reqid=client.4565.0:511, at_version=54'32, trim_to=0'0, roll_forward_to=53'28))", 2024-09-17T18:15:54.632 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.344921+0000", 2024-09-17T18:15:54.632 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.221670005, 2024-09-17T18:15:54.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015237298, 2024-09-17T18:15:54.632 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.632 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.632 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.632 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.344921+0000", 2024-09-17T18:15:54.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.344921+0000", 2024-09-17T18:15:54.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.344922+0000", 2024-09-17T18:15:54.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.773e-06 2024-09-17T18:15:54.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345818+0000", 2024-09-17T18:15:54.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000895457 2024-09-17T18:15:54.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345844+0000", 2024-09-17T18:15:54.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5653e-05 2024-09-17T18:15:54.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345862+0000", 2024-09-17T18:15:54.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8159999999999999e-05 2024-09-17T18:15:54.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346476+0000", 2024-09-17T18:15:54.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00061441800000000004 2024-09-17T18:15:54.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346503+0000", 2024-09-17T18:15:54.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6395999999999999e-05 2024-09-17T18:15:54.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.360103+0000", 2024-09-17T18:15:54.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013600259999999999 2024-09-17T18:15:54.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.360158+0000", 2024-09-17T18:15:54.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5180999999999999e-05 2024-09-17T18:15:54.636 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.636 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.636 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.636 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 54/31 ECSubWrite(tid=286, reqid=osd.13.0:286, at_version=54'138, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:15:54.636 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.345075+0000", 2024-09-17T18:15:54.636 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.2215155060000003, 2024-09-17T18:15:54.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020430077000000001, 2024-09-17T18:15:54.637 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.637 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.637 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.637 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345075+0000", 2024-09-17T18:15:54.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345075+0000", 2024-09-17T18:15:54.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345077+0000", 2024-09-17T18:15:54.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3570000000000001e-06 2024-09-17T18:15:54.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345167+0000", 2024-09-17T18:15:54.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0760999999999994e-05 2024-09-17T18:15:54.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345213+0000", 2024-09-17T18:15:54.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5595e-05 2024-09-17T18:15:54.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345235+0000", 2024-09-17T18:15:54.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2416999999999999e-05 2024-09-17T18:15:54.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345649+0000", 2024-09-17T18:15:54.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041404899999999999 2024-09-17T18:15:54.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345674+0000", 2024-09-17T18:15:54.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4746e-05 2024-09-17T18:15:54.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.365456+0000", 2024-09-17T18:15:54.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019782401000000002 2024-09-17T18:15:54.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.365505+0000", 2024-09-17T18:15:54.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8751000000000001e-05 2024-09-17T18:15:54.641 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.641 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.641 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.641 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.as5 54/31 ECSubWrite(tid=284, reqid=osd.13.0:284, at_version=54'79, trim_to=0'0, roll_forward_to=54'77))", 2024-09-17T18:15:54.641 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.345312+0000", 2024-09-17T18:15:54.641 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.221278882, 2024-09-17T18:15:54.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018630066000000001, 2024-09-17T18:15:54.641 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.641 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.641 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.642 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345312+0000", 2024-09-17T18:15:54.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345312+0000", 2024-09-17T18:15:54.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345313+0000", 2024-09-17T18:15:54.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4300000000000001e-06 2024-09-17T18:15:54.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345375+0000", 2024-09-17T18:15:54.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1838e-05 2024-09-17T18:15:54.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345402+0000", 2024-09-17T18:15:54.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7022999999999999e-05 2024-09-17T18:15:54.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345423+0000", 2024-09-17T18:15:54.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0426000000000001e-05 2024-09-17T18:15:54.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345535+0000", 2024-09-17T18:15:54.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112342 2024-09-17T18:15:54.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345549+0000", 2024-09-17T18:15:54.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3961000000000001e-05 2024-09-17T18:15:54.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.363902+0000", 2024-09-17T18:15:54.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018353103999999999 2024-09-17T18:15:54.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.363942+0000", 2024-09-17T18:15:54.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9941999999999998e-05 2024-09-17T18:15:54.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.645 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.646 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 54/31 ECSubWrite(tid=287, reqid=osd.13.0:287, at_version=54'140, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:15:54.646 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.345481+0000", 2024-09-17T18:15:54.646 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.2211101060000003, 2024-09-17T18:15:54.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020077805000000001, 2024-09-17T18:15:54.646 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.646 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.646 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.646 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345481+0000", 2024-09-17T18:15:54.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345481+0000", 2024-09-17T18:15:54.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345482+0000", 2024-09-17T18:15:54.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7000000000000003e-07 2024-09-17T18:15:54.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345555+0000", 2024-09-17T18:15:54.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3407999999999999e-05 2024-09-17T18:15:54.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345577+0000", 2024-09-17T18:15:54.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2255999999999998e-05 2024-09-17T18:15:54.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345595+0000", 2024-09-17T18:15:54.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7957000000000001e-05 2024-09-17T18:15:54.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.358768+0000", 2024-09-17T18:15:54.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013172690000000001 2024-09-17T18:15:54.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.358795+0000", 2024-09-17T18:15:54.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7268999999999999e-05 2024-09-17T18:15:54.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.365526+0000", 2024-09-17T18:15:54.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0067310099999999999 2024-09-17T18:15:54.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.365558+0000", 2024-09-17T18:15:54.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2245e-05 2024-09-17T18:15:54.650 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.650 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.650 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.651 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.6s6 54/31 ECSubWrite(tid=49, reqid=osd.0.0:48, at_version=0'0, trim_to=0'0, roll_forward_to=54'34))", 2024-09-17T18:15:54.651 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.351224+0000", 2024-09-17T18:15:54.651 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.2153665929999997, 2024-09-17T18:15:54.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088463369999999993, 2024-09-17T18:15:54.651 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.651 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.651 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.651 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351224+0000", 2024-09-17T18:15:54.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351224+0000", 2024-09-17T18:15:54.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351226+0000", 2024-09-17T18:15:54.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3769999999999999e-06 2024-09-17T18:15:54.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351255+0000", 2024-09-17T18:15:54.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8138999999999999e-05 2024-09-17T18:15:54.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351297+0000", 2024-09-17T18:15:54.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2611999999999998e-05 2024-09-17T18:15:54.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351324+0000", 2024-09-17T18:15:54.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6463000000000001e-05 2024-09-17T18:15:54.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351493+0000", 2024-09-17T18:15:54.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169226 2024-09-17T18:15:54.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351519+0000", 2024-09-17T18:15:54.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6023000000000001e-05 2024-09-17T18:15:54.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.360000+0000", 2024-09-17T18:15:54.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084808360000000003 2024-09-17T18:15:54.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.360070+0000", 2024-09-17T18:15:54.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0661000000000007e-05 2024-09-17T18:15:54.655 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.655 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.655 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.655 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s4 54/31 ECSubWrite(tid=149, reqid=client.4565.0:512, at_version=54'33, trim_to=0'0, roll_forward_to=54'29))", 2024-09-17T18:15:54.655 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.352853+0000", 2024-09-17T18:15:54.655 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.2137379199999998, 2024-09-17T18:15:54.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011039973999999999, 2024-09-17T18:15:54.656 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.656 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.656 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.656 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.352853+0000", 2024-09-17T18:15:54.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.352853+0000", 2024-09-17T18:15:54.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.352855+0000", 2024-09-17T18:15:54.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.046e-06 2024-09-17T18:15:54.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.353203+0000", 2024-09-17T18:15:54.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034835200000000001 2024-09-17T18:15:54.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.353236+0000", 2024-09-17T18:15:54.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2699e-05 2024-09-17T18:15:54.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.353259+0000", 2024-09-17T18:15:54.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3091999999999998e-05 2024-09-17T18:15:54.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.354551+0000", 2024-09-17T18:15:54.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0012925219999999999 2024-09-17T18:15:54.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.354578+0000", 2024-09-17T18:15:54.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6122000000000002e-05 2024-09-17T18:15:54.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.363806+0000", 2024-09-17T18:15:54.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092280060000000004 2024-09-17T18:15:54.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.363893+0000", 2024-09-17T18:15:54.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7134999999999998e-05 2024-09-17T18:15:54.659 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.660 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.660 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.660 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 54/31 ECSubWrite(tid=288, reqid=client.4565.0:517, at_version=54'142, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:15:54.660 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.355522+0000", 2024-09-17T18:15:54.660 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.2110682390000003, 2024-09-17T18:15:54.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014893826000000001, 2024-09-17T18:15:54.660 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:15:54.660 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:15:54.660 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:15:54.660 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:15:54.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:15:54.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.355522+0000", 2024-09-17T18:15:54.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:15:54.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.355522+0000", 2024-09-17T18:15:54.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:15:54.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:15:54.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.355525+0000", 2024-09-17T18:15:54.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1720000000000001e-06 2024-09-17T18:15:54.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:15:54.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.355716+0000", 2024-09-17T18:15:54.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019125199999999999 2024-09-17T18:15:54.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:15:54.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.355743+0000", 2024-09-17T18:15:54.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7625000000000001e-05 2024-09-17T18:15:54.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:15:54.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.355762+0000", 2024-09-17T18:15:54.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8688000000000001e-05 2024-09-17T18:15:54.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:15:54.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.363075+0000", 2024-09-17T18:15:54.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073125309999999997 2024-09-17T18:15:54.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:15:54.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.363091+0000", 2024-09-17T18:15:54.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6223999999999999e-05 2024-09-17T18:15:54.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:15:54.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.370340+0000", 2024-09-17T18:15:54.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072494159999999998 2024-09-17T18:15:54.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:15:54.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:15:54.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:15:54.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.370416+0000", 2024-09-17T18:15:54.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5918000000000001e-05 2024-09-17T18:15:54.664 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.665 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.665 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.665 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:15:54.665 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:15:54.665 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:15:54.666 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T18:15:54.667 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:54.662+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:54.767 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:54.766+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:54.798 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:54.798 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:54.798 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-17T18:15:54.798 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:54.813 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T18:15:54.868 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:54.865+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:54.969 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:54.965+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:54.978 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-17T18:15:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-17T18:15:54.979 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:54.995 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T18:15:55.070 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:55.067+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:55.119 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-17T18:15:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-17T18:15:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-17T18:15:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 42/31 ECSubWrite(tid=87, reqid=client.4565.0:358, at_version=42'26, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.771519+0000", 2024-09-17T18:15:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.343786684000001, 2024-09-17T18:15:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090010019999999993, 2024-09-17T18:15:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771519+0000", 2024-09-17T18:15:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771519+0000", 2024-09-17T18:15:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771521+0000", 2024-09-17T18:15:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.528e-06 2024-09-17T18:15:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771559+0000", 2024-09-17T18:15:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7567000000000001e-05 2024-09-17T18:15:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771587+0000", 2024-09-17T18:15:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8561e-05 2024-09-17T18:15:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771603+0000", 2024-09-17T18:15:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5654e-05 2024-09-17T18:15:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771678+0000", 2024-09-17T18:15:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630999999999995e-05 2024-09-17T18:15:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771687+0000", 2024-09-17T18:15:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9809999999999992e-06 2024-09-17T18:15:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780476+0000", 2024-09-17T18:15:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087883019999999996 2024-09-17T18:15:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780520+0000", 2024-09-17T18:15:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4777999999999997e-05 2024-09-17T18:15:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.7s3 42/31 ECSubWrite(tid=88, reqid=client.4565.0:344, at_version=42'22, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.771639+0000", 2024-09-17T18:15:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.343666751000001, 2024-09-17T18:15:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0089162240000000004, 2024-09-17T18:15:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771639+0000", 2024-09-17T18:15:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771639+0000", 2024-09-17T18:15:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771640+0000", 2024-09-17T18:15:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.68e-07 2024-09-17T18:15:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771697+0000", 2024-09-17T18:15:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6586000000000003e-05 2024-09-17T18:15:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771714+0000", 2024-09-17T18:15:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7269e-05 2024-09-17T18:15:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771728+0000", 2024-09-17T18:15:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3777999999999999e-05 2024-09-17T18:15:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771858+0000", 2024-09-17T18:15:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013013400000000001 2024-09-17T18:15:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771871+0000", 2024-09-17T18:15:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3609e-05 2024-09-17T18:15:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780540+0000", 2024-09-17T18:15:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086685059999999994 2024-09-17T18:15:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780556+0000", 2024-09-17T18:15:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5673999999999999e-05 2024-09-17T18:15:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.8s1 42/31 ECSubWrite(tid=134, reqid=osd.6.0:133, at_version=0'0, trim_to=0'0, roll_forward_to=42'17))", 2024-09-17T18:15:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.773401+0000", 2024-09-17T18:15:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.341904894999999, 2024-09-17T18:15:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0098034449999999992, 2024-09-17T18:15:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773401+0000", 2024-09-17T18:15:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773401+0000", 2024-09-17T18:15:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773403+0000", 2024-09-17T18:15:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.75e-06 2024-09-17T18:15:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773424+0000", 2024-09-17T18:15:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1339e-05 2024-09-17T18:15:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773455+0000", 2024-09-17T18:15:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0539e-05 2024-09-17T18:15:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773471+0000", 2024-09-17T18:15:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6453e-05 2024-09-17T18:15:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773629+0000", 2024-09-17T18:15:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015783099999999999 2024-09-17T18:15:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773645+0000", 2024-09-17T18:15:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5882000000000001e-05 2024-09-17T18:15:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783144+0000", 2024-09-17T18:15:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094992210000000004 2024-09-17T18:15:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783205+0000", 2024-09-17T18:15:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0430000000000002e-05 2024-09-17T18:15:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.5s5 42/31 ECSubWrite(tid=39, reqid=osd.5.0:39, at_version=42'10, trim_to=0'0, roll_forward_to=38'8))", 2024-09-17T18:15:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.775279+0000", 2024-09-17T18:15:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.340027593999999, 2024-09-17T18:15:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0079475259999999999, 2024-09-17T18:15:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775279+0000", 2024-09-17T18:15:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775279+0000", 2024-09-17T18:15:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775279+0000", 2024-09-17T18:15:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3700000000000001e-07 2024-09-17T18:15:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775306+0000", 2024-09-17T18:15:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7109000000000001e-05 2024-09-17T18:15:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775325+0000", 2024-09-17T18:15:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8603000000000001e-05 2024-09-17T18:15:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775334+0000", 2024-09-17T18:15:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0750000000000004e-06 2024-09-17T18:15:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775675+0000", 2024-09-17T18:15:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034130500000000003 2024-09-17T18:15:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775683+0000", 2024-09-17T18:15:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2919999999999996e-06 2024-09-17T18:15:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783169+0000", 2024-09-17T18:15:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074853339999999997 2024-09-17T18:15:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783226+0000", 2024-09-17T18:15:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7470999999999999e-05 2024-09-17T18:15:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.7s3 42/31 ECSubWrite(tid=89, reqid=client.4565.0:345, at_version=42'23, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.775369+0000", 2024-09-17T18:15:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.339936984000001, 2024-09-17T18:15:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0079552900000000003, 2024-09-17T18:15:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775369+0000", 2024-09-17T18:15:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775369+0000", 2024-09-17T18:15:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775370+0000", 2024-09-17T18:15:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8699999999999995e-07 2024-09-17T18:15:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775393+0000", 2024-09-17T18:15:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3896e-05 2024-09-17T18:15:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775403+0000", 2024-09-17T18:15:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1169999999999993e-06 2024-09-17T18:15:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775409+0000", 2024-09-17T18:15:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.861e-06 2024-09-17T18:15:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775615+0000", 2024-09-17T18:15:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000205145 2024-09-17T18:15:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775631+0000", 2024-09-17T18:15:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6631999999999999e-05 2024-09-17T18:15:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783300+0000", 2024-09-17T18:15:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0076691390000000002 2024-09-17T18:15:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783324+0000", 2024-09-17T18:15:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4012999999999999e-05 2024-09-17T18:15:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 42/31 ECSubWrite(tid=90, reqid=client.4565.0:359, at_version=42'27, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.775430+0000", 2024-09-17T18:15:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.339876402000002, 2024-09-17T18:15:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078051919999999999, 2024-09-17T18:15:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775430+0000", 2024-09-17T18:15:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775430+0000", 2024-09-17T18:15:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775430+0000", 2024-09-17T18:15:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.53e-07 2024-09-17T18:15:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775451+0000", 2024-09-17T18:15:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1013e-05 2024-09-17T18:15:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775458+0000", 2024-09-17T18:15:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.277e-06 2024-09-17T18:15:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775464+0000", 2024-09-17T18:15:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8950000000000003e-06 2024-09-17T18:15:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775930+0000", 2024-09-17T18:15:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00046549800000000001 2024-09-17T18:15:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775938+0000", 2024-09-17T18:15:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4649999999999994e-06 2024-09-17T18:15:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783193+0000", 2024-09-17T18:15:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0072553180000000002 2024-09-17T18:15:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783235+0000", 2024-09-17T18:15:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1473000000000001e-05 2024-09-17T18:15:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.7s3 42/31 ECSubWrite(tid=91, reqid=client.4565.0:352, at_version=42'25, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:15:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.775481+0000", 2024-09-17T18:15:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.339825471000001, 2024-09-17T18:15:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085477750000000005, 2024-09-17T18:15:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775481+0000", 2024-09-17T18:15:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775481+0000", 2024-09-17T18:15:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775481+0000", 2024-09-17T18:15:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2099999999999998e-07 2024-09-17T18:15:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775517+0000", 2024-09-17T18:15:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6279000000000003e-05 2024-09-17T18:15:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775526+0000", 2024-09-17T18:15:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9129999999999992e-06 2024-09-17T18:15:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775533+0000", 2024-09-17T18:15:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4760000000000003e-06 2024-09-17T18:15:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776055+0000", 2024-09-17T18:15:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052192199999999997 2024-09-17T18:15:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776069+0000", 2024-09-17T18:15:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4749999999999999e-05 2024-09-17T18:15:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783980+0000", 2024-09-17T18:15:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0079110670000000008 2024-09-17T18:15:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.784028+0000", 2024-09-17T18:15:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8047000000000003e-05 2024-09-17T18:15:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 42/31 ECSubWrite(tid=92, reqid=client.4565.0:360, at_version=42'28, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:15:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.775543+0000", 2024-09-17T18:15:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.339762731, 2024-09-17T18:15:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077258910000000004, 2024-09-17T18:15:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775543+0000", 2024-09-17T18:15:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775543+0000", 2024-09-17T18:15:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775544+0000", 2024-09-17T18:15:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8200000000000001e-07 2024-09-17T18:15:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775556+0000", 2024-09-17T18:15:55.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1963999999999999e-05 2024-09-17T18:15:55.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775562+0000", 2024-09-17T18:15:55.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4099999999999996e-06 2024-09-17T18:15:55.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775574+0000", 2024-09-17T18:15:55.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2401e-05 2024-09-17T18:15:55.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776274+0000", 2024-09-17T18:15:55.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00069985000000000002 2024-09-17T18:15:55.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776281+0000", 2024-09-17T18:15:55.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0160000000000003e-06 2024-09-17T18:15:55.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783239+0000", 2024-09-17T18:15:55.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069581920000000002 2024-09-17T18:15:55.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783269+0000", 2024-09-17T18:15:55.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9776000000000001e-05 2024-09-17T18:15:55.161 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.161 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.161 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.161 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 42/31 ECSubWrite(tid=101, reqid=osd.4.0:99, at_version=0'0, trim_to=0'0, roll_forward_to=42'34))", 2024-09-17T18:15:55.161 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.804262+0000", 2024-09-17T18:15:55.161 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.311043864999998, 2024-09-17T18:15:55.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078186479999999992, 2024-09-17T18:15:55.162 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.162 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.162 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:55.162 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804262+0000", 2024-09-17T18:15:55.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804262+0000", 2024-09-17T18:15:55.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804263+0000", 2024-09-17T18:15:55.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4700000000000001e-07 2024-09-17T18:15:55.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804271+0000", 2024-09-17T18:15:55.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4330000000000004e-06 2024-09-17T18:15:55.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804284+0000", 2024-09-17T18:15:55.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2228e-05 2024-09-17T18:15:55.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804292+0000", 2024-09-17T18:15:55.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1380000000000007e-06 2024-09-17T18:15:55.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804368+0000", 2024-09-17T18:15:55.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6019999999999994e-05 2024-09-17T18:15:55.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.804379+0000", 2024-09-17T18:15:55.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1484000000000001e-05 2024-09-17T18:15:55.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.812043+0000", 2024-09-17T18:15:55.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0076641010000000004 2024-09-17T18:15:55.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.812081+0000", 2024-09-17T18:15:55.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7496999999999997e-05 2024-09-17T18:15:55.166 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.166 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.166 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.166 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:368 3.6s0 3:66d3fbbd:::smithi15432074-29:head [rollback 7] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:15:55.166 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:38.990290+0000", 2024-09-17T18:15:55.166 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.125016106, 2024-09-17T18:15:55.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087172710000000004, 2024-09-17T18:15:55.166 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.166 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.166 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.167 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.167 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.167 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.167 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 368 2024-09-17T18:15:55.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.167 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990290+0000", 2024-09-17T18:15:55.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990290+0000", 2024-09-17T18:15:55.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990290+0000", 2024-09-17T18:15:55.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8999999999999997e-07 2024-09-17T18:15:55.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990294+0000", 2024-09-17T18:15:55.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.631e-06 2024-09-17T18:15:55.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990305+0000", 2024-09-17T18:15:55.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0661e-05 2024-09-17T18:15:55.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990308+0000", 2024-09-17T18:15:55.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6969999999999999e-06 2024-09-17T18:15:55.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.991920+0000", 2024-09-17T18:15:55.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001611112 2024-09-17T18:15:55.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.992004+0000", 2024-09-17T18:15:55.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4002e-05 2024-09-17T18:15:55.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.992483+0000", 2024-09-17T18:15:55.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00047893499999999999 2024-09-17T18:15:55.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.993769+0000", 2024-09-17T18:15:55.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012866100000000001 2024-09-17T18:15:55.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.998968+0000", 2024-09-17T18:15:55.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051993619999999999 2024-09-17T18:15:55.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.999007+0000", 2024-09-17T18:15:55.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8770999999999999e-05 2024-09-17T18:15:55.172 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.172 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.172 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.172 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:369 3.6s0 3:66d3fbbd:::smithi15432074-29:head [append 0~0] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:15:55.172 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:38.990317+0000", 2024-09-17T18:15:55.172 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.124989389, 2024-09-17T18:15:55.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0088636789999999993, 2024-09-17T18:15:55.172 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.172 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.172 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 369 2024-09-17T18:15:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990317+0000", 2024-09-17T18:15:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990317+0000", 2024-09-17T18:15:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990317+0000", 2024-09-17T18:15:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9100000000000004e-07 2024-09-17T18:15:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990320+0000", 2024-09-17T18:15:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3819999999999998e-06 2024-09-17T18:15:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990325+0000", 2024-09-17T18:15:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4040000000000003e-06 2024-09-17T18:15:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990333+0000", 2024-09-17T18:15:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4740000000000005e-06 2024-09-17T18:15:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.992744+0000", 2024-09-17T18:15:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002410223 2024-09-17T18:15:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.992844+0000", 2024-09-17T18:15:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100203 2024-09-17T18:15:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.993311+0000", 2024-09-17T18:15:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00046744199999999999 2024-09-17T18:15:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.994001+0000", 2024-09-17T18:15:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00068924700000000004 2024-09-17T18:15:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.999149+0000", 2024-09-17T18:15:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051487219999999997 2024-09-17T18:15:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.999180+0000", 2024-09-17T18:15:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1090999999999998e-05 2024-09-17T18:15:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:376 3.6s0 3:6126409b:::smithi15432074-43:head [append 0~671744] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:15:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.069257+0000", 2024-09-17T18:15:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.046049154999999, 2024-09-17T18:15:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0097659919999999994, 2024-09-17T18:15:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 376 2024-09-17T18:15:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.069257+0000", 2024-09-17T18:15:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.069257+0000", 2024-09-17T18:15:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.069258+0000", 2024-09-17T18:15:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.347e-06 2024-09-17T18:15:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070218+0000", 2024-09-17T18:15:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00095974999999999999 2024-09-17T18:15:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070230+0000", 2024-09-17T18:15:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1867e-05 2024-09-17T18:15:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070237+0000", 2024-09-17T18:15:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630000000000003e-06 2024-09-17T18:15:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.071273+0000", 2024-09-17T18:15:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010355329999999999 2024-09-17T18:15:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.071421+0000", 2024-09-17T18:15:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000147596 2024-09-17T18:15:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.073068+0000", 2024-09-17T18:15:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016475859999999999 2024-09-17T18:15:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.076443+0000", 2024-09-17T18:15:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033753059999999998 2024-09-17T18:15:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.078917+0000", 2024-09-17T18:15:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002473931 2024-09-17T18:15:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.079023+0000", 2024-09-17T18:15:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105513 2024-09-17T18:15:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:377 3.6s0 3:6126409b:::smithi15432074-43:head [append 0~98304] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:15:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.070254+0000", 2024-09-17T18:15:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.045052241, 2024-09-17T18:15:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011803045, 2024-09-17T18:15:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 377 2024-09-17T18:15:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070254+0000", 2024-09-17T18:15:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070254+0000", 2024-09-17T18:15:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070255+0000", 2024-09-17T18:15:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.23e-07 2024-09-17T18:15:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070295+0000", 2024-09-17T18:15:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0540999999999997e-05 2024-09-17T18:15:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070306+0000", 2024-09-17T18:15:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0564000000000001e-05 2024-09-17T18:15:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070313+0000", 2024-09-17T18:15:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8979999999999999e-06 2024-09-17T18:15:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.074474+0000", 2024-09-17T18:15:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004161718 2024-09-17T18:15:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.074608+0000", 2024-09-17T18:15:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013348599999999999 2024-09-17T18:15:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.075463+0000", 2024-09-17T18:15:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085558400000000005 2024-09-17T18:15:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.076770+0000", 2024-09-17T18:15:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013061839999999999 2024-09-17T18:15:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.081960+0000", 2024-09-17T18:15:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005190643 2024-09-17T18:15:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.082057+0000", 2024-09-17T18:15:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6603999999999999e-05 2024-09-17T18:15:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:378 3.6s0 3:6126409b:::smithi15432074-43:head [setxattr _header (56) in=7b] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:15:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.070324+0000", 2024-09-17T18:15:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.044982545, 2024-09-17T18:15:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013464016000000001, 2024-09-17T18:15:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 378 2024-09-17T18:15:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070324+0000", 2024-09-17T18:15:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070324+0000", 2024-09-17T18:15:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070324+0000", 2024-09-17T18:15:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.82e-07 2024-09-17T18:15:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070327+0000", 2024-09-17T18:15:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.101e-06 2024-09-17T18:15:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070334+0000", 2024-09-17T18:15:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.922e-06 2024-09-17T18:15:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070340+0000", 2024-09-17T18:15:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4750000000000001e-06 2024-09-17T18:15:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.076926+0000", 2024-09-17T18:15:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065863370000000003 2024-09-17T18:15:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.077071+0000", 2024-09-17T18:15:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014542799999999999 2024-09-17T18:15:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.077737+0000", 2024-09-17T18:15:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00066590699999999998 2024-09-17T18:15:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.078436+0000", 2024-09-17T18:15:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00069889500000000005 2024-09-17T18:15:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.083638+0000", 2024-09-17T18:15:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052022270000000002 2024-09-17T18:15:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.083788+0000", 2024-09-17T18:15:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000149142 2024-09-17T18:15:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:379 3.6s0 3:6126409b:::smithi15432074-43:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:15:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.070348+0000", 2024-09-17T18:15:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.044958382000001, 2024-09-17T18:15:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015030777, 2024-09-17T18:15:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:15:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 379 2024-09-17T18:15:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070348+0000", 2024-09-17T18:15:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070348+0000", 2024-09-17T18:15:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070348+0000", 2024-09-17T18:15:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3799999999999997e-07 2024-09-17T18:15:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070351+0000", 2024-09-17T18:15:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0170000000000001e-06 2024-09-17T18:15:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070359+0000", 2024-09-17T18:15:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2160000000000006e-06 2024-09-17T18:15:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070366+0000", 2024-09-17T18:15:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8129999999999998e-06 2024-09-17T18:15:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.078205+0000", 2024-09-17T18:15:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007839047 2024-09-17T18:15:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for rw locks", 2024-09-17T18:15:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.078327+0000", 2024-09-17T18:15:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012210000000000001 2024-09-17T18:15:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.084385+0000", 2024-09-17T18:15:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060574699999999997 2024-09-17T18:15:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.084512+0000", 2024-09-17T18:15:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000127086 2024-09-17T18:15:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.085378+0000", 2024-09-17T18:15:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086649000000000003 2024-09-17T18:15:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.7s3 53/31 ECSubWrite(tid=142, reqid=client.4565.0:451, at_version=53'48, trim_to=0'0, roll_forward_to=52'46))", 2024-09-17T18:15:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:48.319167+0000", 2024-09-17T18:15:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.7961386839999998, 2024-09-17T18:15:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071868089999999997, 2024-09-17T18:15:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:48.319167+0000", 2024-09-17T18:15:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:48.319167+0000", 2024-09-17T18:15:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:48.319168+0000", 2024-09-17T18:15:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8999999999999998e-07 2024-09-17T18:15:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:48.319309+0000", 2024-09-17T18:15:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014154400000000001 2024-09-17T18:15:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:48.319324+0000", 2024-09-17T18:15:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4982e-05 2024-09-17T18:15:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:48.319336+0000", 2024-09-17T18:15:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1556000000000001e-05 2024-09-17T18:15:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:48.320192+0000", 2024-09-17T18:15:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000856696 2024-09-17T18:15:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:48.320207+0000", 2024-09-17T18:15:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4167e-05 2024-09-17T18:15:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:48.326318+0000", 2024-09-17T18:15:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061118429999999996 2024-09-17T18:15:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:48.326354+0000", 2024-09-17T18:15:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5731000000000001e-05 2024-09-17T18:15:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:505 3.6s0 3:6f149d43:::smithi15432074-47:head [read 0~2244608,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310195+0000", 2024-09-17T18:15:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.8051113829999998, 2024-09-17T18:15:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024697646, 2024-09-17T18:15:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:15:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 505 2024-09-17T18:15:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310195+0000", 2024-09-17T18:15:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310195+0000", 2024-09-17T18:15:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310199+0000", 2024-09-17T18:15:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0600000000000001e-06 2024-09-17T18:15:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310216+0000", 2024-09-17T18:15:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6728999999999999e-05 2024-09-17T18:15:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310259+0000", 2024-09-17T18:15:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3915999999999998e-05 2024-09-17T18:15:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310286+0000", 2024-09-17T18:15:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6990000000000001e-05 2024-09-17T18:15:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310531+0000", 2024-09-17T18:15:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024485099999999998 2024-09-17T18:15:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-17T18:15:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310552+0000", 2024-09-17T18:15:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0954999999999998e-05 2024-09-17T18:15:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.316293+0000", 2024-09-17T18:15:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057404810000000004 2024-09-17T18:15:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.316555+0000", 2024-09-17T18:15:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026257100000000002 2024-09-17T18:15:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.334892+0000", 2024-09-17T18:15:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018337092999999999 2024-09-17T18:15:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:506 3.6s0 3:6f149d43:::smithi15432074-47:head [read 970914~1273694,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310344+0000", 2024-09-17T18:15:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.8049624399999997, 2024-09-17T18:15:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025596168999999998, 2024-09-17T18:15:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:15:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 506 2024-09-17T18:15:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310344+0000", 2024-09-17T18:15:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310344+0000", 2024-09-17T18:15:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310345+0000", 2024-09-17T18:15:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.443e-06 2024-09-17T18:15:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310354+0000", 2024-09-17T18:15:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5799999999999992e-06 2024-09-17T18:15:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310380+0000", 2024-09-17T18:15:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6556000000000001e-05 2024-09-17T18:15:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310401+0000", 2024-09-17T18:15:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0667000000000001e-05 2024-09-17T18:15:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310820+0000", 2024-09-17T18:15:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00041894300000000002 2024-09-17T18:15:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310838+0000", 2024-09-17T18:15:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8156e-05 2024-09-17T18:15:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.317663+0000", 2024-09-17T18:15:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068248120000000004 2024-09-17T18:15:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.317905+0000", 2024-09-17T18:15:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024252400000000001 2024-09-17T18:15:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.335940+0000", 2024-09-17T18:15:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018034488000000001 2024-09-17T18:15:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:507 3.6s0 3:6f149d43:::smithi15432074-47:head [read 0~2244608,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310509+0000", 2024-09-17T18:15:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.8047968140000004, 2024-09-17T18:15:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028949084999999999, 2024-09-17T18:15:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:15:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 507 2024-09-17T18:15:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310509+0000", 2024-09-17T18:15:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310509+0000", 2024-09-17T18:15:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310511+0000", 2024-09-17T18:15:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5629999999999999e-06 2024-09-17T18:15:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310520+0000", 2024-09-17T18:15:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3940000000000002e-06 2024-09-17T18:15:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310545+0000", 2024-09-17T18:15:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4892000000000002e-05 2024-09-17T18:15:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310561+0000", 2024-09-17T18:15:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6157000000000001e-05 2024-09-17T18:15:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310936+0000", 2024-09-17T18:15:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00037458400000000002 2024-09-17T18:15:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310952+0000", 2024-09-17T18:15:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.592e-05 2024-09-17T18:15:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.318680+0000", 2024-09-17T18:15:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077277200000000004 2024-09-17T18:15:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.318909+0000", 2024-09-17T18:15:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000229714 2024-09-17T18:15:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339458+0000", 2024-09-17T18:15:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020549141 2024-09-17T18:15:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpReadReply(3.6s0 53/31 ECSubReadReply(tid=44, attrs_read=0))", 2024-09-17T18:15:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.322520+0000", 2024-09-17T18:15:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.7927864810000003, 2024-09-17T18:15:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01243506, 2024-09-17T18:15:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.322520+0000", 2024-09-17T18:15:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.322520+0000", 2024-09-17T18:15:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.322521+0000", 2024-09-17T18:15:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2529999999999999e-06 2024-09-17T18:15:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.331725+0000", 2024-09-17T18:15:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092041380000000006 2024-09-17T18:15:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.331750+0000", 2024-09-17T18:15:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5086e-05 2024-09-17T18:15:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.331767+0000", 2024-09-17T18:15:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6736e-05 2024-09-17T18:15:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.332185+0000", 2024-09-17T18:15:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00041827699999999999 2024-09-17T18:15:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.334955+0000", 2024-09-17T18:15:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0027695699999999998 2024-09-17T18:15:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.227 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.227 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:55.228 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T18:15:55.229 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:55.226+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:55.330 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:55.327+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:55.360 INFO:tasks.rados.rados.0.smithi154.stdout:215: done (3 left) 2024-09-17T18:15:55.361 INFO:tasks.rados.rados.0.smithi154.stdout:216: done (2 left) 2024-09-17T18:15:55.361 INFO:tasks.rados.rados.0.smithi154.stdout:217: done (1 left) 2024-09-17T18:15:55.361 INFO:tasks.rados.rados.0.smithi154.stdout:218: done (0 left) 2024-09-17T18:15:55.361 INFO:tasks.rados.rados.0.smithi154.stdout:219: snap_create 2024-09-17T18:15:55.407 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:55.407 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:55.407 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-17T18:15:55.407 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:55.421 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T18:15:55.431 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:55.429+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:55.532 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:55.529+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:55.544 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:55.544 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:55.544 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-17T18:15:55.544 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-17T18:15:55.544 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:55.558 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T18:15:55.633 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:55.631+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:55.676 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:55.676 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-17T18:15:55.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-17T18:15:55.676 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-17T18:15:55.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.676 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:244 3.bs0 3:df05abfe:::smithi15432074-30:head [append 0~704512] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-17T18:15:55.677 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.722442+0000", 2024-09-17T18:15:55.677 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.951391451999999, 2024-09-17T18:15:55.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0097415169999999999, 2024-09-17T18:15:55.677 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.677 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.677 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.677 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.678 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.678 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.678 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 244 2024-09-17T18:15:55.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.678 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.722442+0000", 2024-09-17T18:15:55.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.722442+0000", 2024-09-17T18:15:55.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.722446+0000", 2024-09-17T18:15:55.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.331e-06 2024-09-17T18:15:55.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.724140+0000", 2024-09-17T18:15:55.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001694657 2024-09-17T18:15:55.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.724176+0000", 2024-09-17T18:15:55.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6103999999999999e-05 2024-09-17T18:15:55.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.724193+0000", 2024-09-17T18:15:55.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6195999999999999e-05 2024-09-17T18:15:55.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.724275+0000", 2024-09-17T18:15:55.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2599e-05 2024-09-17T18:15:55.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.724355+0000", 2024-09-17T18:15:55.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9742999999999999e-05 2024-09-17T18:15:55.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725248+0000", 2024-09-17T18:15:55.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089344999999999995 2024-09-17T18:15:55.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728840+0000", 2024-09-17T18:15:55.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035920090000000002 2024-09-17T18:15:55.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.732106+0000", 2024-09-17T18:15:55.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003265511 2024-09-17T18:15:55.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.732184+0000", 2024-09-17T18:15:55.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7917000000000006e-05 2024-09-17T18:15:55.683 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.683 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.683 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.683 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:343 3.7s0 3:ef12b1fb:::smithi15432074-35:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:55.683 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763631+0000", 2024-09-17T18:15:55.683 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.910202492, 2024-09-17T18:15:55.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028740952, 2024-09-17T18:15:55.683 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.683 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.684 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.684 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.684 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.684 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.684 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 343 2024-09-17T18:15:55.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.684 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763631+0000", 2024-09-17T18:15:55.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763631+0000", 2024-09-17T18:15:55.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763634+0000", 2024-09-17T18:15:55.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8700000000000001e-06 2024-09-17T18:15:55.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763644+0000", 2024-09-17T18:15:55.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4800000000000007e-06 2024-09-17T18:15:55.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763670+0000", 2024-09-17T18:15:55.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6499000000000002e-05 2024-09-17T18:15:55.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763684+0000", 2024-09-17T18:15:55.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.342e-05 2024-09-17T18:15:55.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763779+0000", 2024-09-17T18:15:55.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5001999999999996e-05 2024-09-17T18:15:55.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-17T18:15:55.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763788+0000", 2024-09-17T18:15:55.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4490000000000005e-06 2024-09-17T18:15:55.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.768186+0000", 2024-09-17T18:15:55.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043976350000000004 2024-09-17T18:15:55.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.768335+0000", 2024-09-17T18:15:55.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014973800000000001 2024-09-17T18:15:55.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.769389+0000", 2024-09-17T18:15:55.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010536409999999999 2024-09-17T18:15:55.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778459+0000", 2024-09-17T18:15:55.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090703020000000006 2024-09-17T18:15:55.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792276+0000", 2024-09-17T18:15:55.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013816716 2024-09-17T18:15:55.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792372+0000", 2024-09-17T18:15:55.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6199999999999994e-05 2024-09-17T18:15:55.691 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.691 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.691 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.691 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:344 3.7s0 3:ef12b1fb:::smithi15432074-35:head [rollback 6] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:55.691 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763714+0000", 2024-09-17T18:15:55.691 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.910120097, 2024-09-17T18:15:55.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.031319132999999999, 2024-09-17T18:15:55.691 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.692 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.692 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.692 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.692 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.692 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.692 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 344 2024-09-17T18:15:55.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.692 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763714+0000", 2024-09-17T18:15:55.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763714+0000", 2024-09-17T18:15:55.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763714+0000", 2024-09-17T18:15:55.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5099999999999999e-07 2024-09-17T18:15:55.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763718+0000", 2024-09-17T18:15:55.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4970000000000001e-06 2024-09-17T18:15:55.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763729+0000", 2024-09-17T18:15:55.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0736e-05 2024-09-17T18:15:55.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763735+0000", 2024-09-17T18:15:55.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8229999999999997e-06 2024-09-17T18:15:55.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763871+0000", 2024-09-17T18:15:55.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013522100000000001 2024-09-17T18:15:55.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:55.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763876+0000", 2024-09-17T18:15:55.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.558e-06 2024-09-17T18:15:55.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.770394+0000", 2024-09-17T18:15:55.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065179189999999996 2024-09-17T18:15:55.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.770558+0000", 2024-09-17T18:15:55.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016384900000000001 2024-09-17T18:15:55.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771591+0000", 2024-09-17T18:15:55.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001033525 2024-09-17T18:15:55.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778461+0000", 2024-09-17T18:15:55.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068693390000000003 2024-09-17T18:15:55.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.794971+0000", 2024-09-17T18:15:55.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016509751 2024-09-17T18:15:55.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795033+0000", 2024-09-17T18:15:55.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2263999999999999e-05 2024-09-17T18:15:55.699 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.699 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.700 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.700 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:345 3.7s0 3:ef12b1fb:::smithi15432074-35:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:55.700 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763766+0000", 2024-09-17T18:15:55.700 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.910067938000001, 2024-09-17T18:15:55.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.031400627, 2024-09-17T18:15:55.701 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.701 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.701 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.701 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.701 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.701 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.701 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 345 2024-09-17T18:15:55.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.701 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763766+0000", 2024-09-17T18:15:55.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763766+0000", 2024-09-17T18:15:55.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763766+0000", 2024-09-17T18:15:55.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-17T18:15:55.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763780+0000", 2024-09-17T18:15:55.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3183000000000001e-05 2024-09-17T18:15:55.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763809+0000", 2024-09-17T18:15:55.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9167999999999999e-05 2024-09-17T18:15:55.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763816+0000", 2024-09-17T18:15:55.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7700000000000004e-06 2024-09-17T18:15:55.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763948+0000", 2024-09-17T18:15:55.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013241500000000001 2024-09-17T18:15:55.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:55.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763952+0000", 2024-09-17T18:15:55.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9949999999999999e-06 2024-09-17T18:15:55.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772256+0000", 2024-09-17T18:15:55.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0083035609999999992 2024-09-17T18:15:55.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772431+0000", 2024-09-17T18:15:55.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000175864 2024-09-17T18:15:55.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773218+0000", 2024-09-17T18:15:55.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00078638500000000001 2024-09-17T18:15:55.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778464+0000", 2024-09-17T18:15:55.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052463689999999999 2024-09-17T18:15:55.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795129+0000", 2024-09-17T18:15:55.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016664447999999998 2024-09-17T18:15:55.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795166+0000", 2024-09-17T18:15:55.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7880000000000003e-05 2024-09-17T18:15:55.707 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.707 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.707 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.707 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:352 3.7s0 3:e2d87ed6:::smithi15432074-32:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:55.707 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763830+0000", 2024-09-17T18:15:55.707 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.910003543999998, 2024-09-17T18:15:55.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.031647704999999998, 2024-09-17T18:15:55.707 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.707 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.708 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.708 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.708 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.708 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.708 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 352 2024-09-17T18:15:55.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.708 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763830+0000", 2024-09-17T18:15:55.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763830+0000", 2024-09-17T18:15:55.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763831+0000", 2024-09-17T18:15:55.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3300000000000002e-07 2024-09-17T18:15:55.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763834+0000", 2024-09-17T18:15:55.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1480000000000002e-06 2024-09-17T18:15:55.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763844+0000", 2024-09-17T18:15:55.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8740000000000007e-06 2024-09-17T18:15:55.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763861+0000", 2024-09-17T18:15:55.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7380999999999998e-05 2024-09-17T18:15:55.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763994+0000", 2024-09-17T18:15:55.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013322900000000001 2024-09-17T18:15:55.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:55.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763998+0000", 2024-09-17T18:15:55.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6770000000000001e-06 2024-09-17T18:15:55.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773657+0000", 2024-09-17T18:15:55.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0096587779999999998 2024-09-17T18:15:55.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773769+0000", 2024-09-17T18:15:55.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000112469 2024-09-17T18:15:55.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775181+0000", 2024-09-17T18:15:55.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00141125 2024-09-17T18:15:55.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.782500+0000", 2024-09-17T18:15:55.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0073196290000000002 2024-09-17T18:15:55.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795418+0000", 2024-09-17T18:15:55.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012917699 2024-09-17T18:15:55.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795478+0000", 2024-09-17T18:15:55.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0037999999999997e-05 2024-09-17T18:15:55.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.714 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.714 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:353 3.7s0 3:e2d87ed6:::smithi15432074-32:head [rollback 5] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:55.714 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763899+0000", 2024-09-17T18:15:55.715 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.909934648, 2024-09-17T18:15:55.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.037287898, 2024-09-17T18:15:55.715 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.715 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.715 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.715 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.715 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.715 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.715 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 353 2024-09-17T18:15:55.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.715 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763899+0000", 2024-09-17T18:15:55.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763899+0000", 2024-09-17T18:15:55.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763900+0000", 2024-09-17T18:15:55.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6499999999999999e-07 2024-09-17T18:15:55.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763903+0000", 2024-09-17T18:15:55.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4089999999999999e-06 2024-09-17T18:15:55.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763915+0000", 2024-09-17T18:15:55.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1377e-05 2024-09-17T18:15:55.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763921+0000", 2024-09-17T18:15:55.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6619999999999999e-06 2024-09-17T18:15:55.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764038+0000", 2024-09-17T18:15:55.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117268 2024-09-17T18:15:55.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:55.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764045+0000", 2024-09-17T18:15:55.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2519999999999996e-06 2024-09-17T18:15:55.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776881+0000", 2024-09-17T18:15:55.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012836683999999999 2024-09-17T18:15:55.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776973+0000", 2024-09-17T18:15:55.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1181999999999995e-05 2024-09-17T18:15:55.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.777499+0000", 2024-09-17T18:15:55.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052648199999999999 2024-09-17T18:15:55.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.782503+0000", 2024-09-17T18:15:55.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0050035330000000001 2024-09-17T18:15:55.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801117+0000", 2024-09-17T18:15:55.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018614557 2024-09-17T18:15:55.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801187+0000", 2024-09-17T18:15:55.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9926999999999996e-05 2024-09-17T18:15:55.721 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.721 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.721 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.721 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:354 3.7s0 3:e2d87ed6:::smithi15432074-32:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:55.721 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763944+0000", 2024-09-17T18:15:55.721 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.909890122, 2024-09-17T18:15:55.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.037407294000000001, 2024-09-17T18:15:55.722 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.722 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.722 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.722 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.722 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.722 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.722 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 354 2024-09-17T18:15:55.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.722 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763944+0000", 2024-09-17T18:15:55.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763944+0000", 2024-09-17T18:15:55.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763944+0000", 2024-09-17T18:15:55.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0699999999999997e-07 2024-09-17T18:15:55.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763947+0000", 2024-09-17T18:15:55.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1379999999999999e-06 2024-09-17T18:15:55.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763956+0000", 2024-09-17T18:15:55.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3340000000000002e-06 2024-09-17T18:15:55.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763962+0000", 2024-09-17T18:15:55.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9070000000000004e-06 2024-09-17T18:15:55.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764112+0000", 2024-09-17T18:15:55.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000150359 2024-09-17T18:15:55.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:55.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764120+0000", 2024-09-17T18:15:55.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9300000000000003e-06 2024-09-17T18:15:55.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778500+0000", 2024-09-17T18:15:55.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014380469 2024-09-17T18:15:55.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778584+0000", 2024-09-17T18:15:55.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3978000000000001e-05 2024-09-17T18:15:55.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778997+0000", 2024-09-17T18:15:55.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000413075 2024-09-17T18:15:55.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.782506+0000", 2024-09-17T18:15:55.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035086150000000001 2024-09-17T18:15:55.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801311+0000", 2024-09-17T18:15:55.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018804647000000001 2024-09-17T18:15:55.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801351+0000", 2024-09-17T18:15:55.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0334999999999999e-05 2024-09-17T18:15:55.733 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.733 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.733 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.734 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:358 3.bs0 3:df05abfe:::smithi15432074-30:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:55.734 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.764224+0000", 2024-09-17T18:15:55.734 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.909609680999999, 2024-09-17T18:15:55.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028742235000000001, 2024-09-17T18:15:55.734 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.734 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.735 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.735 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.735 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.735 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.735 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 358 2024-09-17T18:15:55.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.736 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764224+0000", 2024-09-17T18:15:55.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764224+0000", 2024-09-17T18:15:55.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764226+0000", 2024-09-17T18:15:55.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7439999999999999e-06 2024-09-17T18:15:55.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764233+0000", 2024-09-17T18:15:55.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.294e-06 2024-09-17T18:15:55.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764251+0000", 2024-09-17T18:15:55.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8096000000000001e-05 2024-09-17T18:15:55.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764261+0000", 2024-09-17T18:15:55.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5089999999999999e-06 2024-09-17T18:15:55.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764381+0000", 2024-09-17T18:15:55.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000119911 2024-09-17T18:15:55.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-17T18:15:55.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764389+0000", 2024-09-17T18:15:55.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1489999999999994e-06 2024-09-17T18:15:55.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.770178+0000", 2024-09-17T18:15:55.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057893149999999997 2024-09-17T18:15:55.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.770354+0000", 2024-09-17T18:15:55.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017578200000000001 2024-09-17T18:15:55.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771556+0000", 2024-09-17T18:15:55.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012016399999999999 2024-09-17T18:15:55.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773874+0000", 2024-09-17T18:15:55.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023185810000000001 2024-09-17T18:15:55.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792865+0000", 2024-09-17T18:15:55.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018991340999999998 2024-09-17T18:15:55.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792966+0000", 2024-09-17T18:15:55.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010087299999999999 2024-09-17T18:15:55.747 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.747 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.747 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.747 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:359 3.bs0 3:df05abfe:::smithi15432074-30:head [rollback 4] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:55.747 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.764292+0000", 2024-09-17T18:15:55.747 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.909541754999999, 2024-09-17T18:15:55.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028870689000000001, 2024-09-17T18:15:55.748 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.748 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.748 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.748 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.748 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.748 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.748 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 359 2024-09-17T18:15:55.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.748 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764292+0000", 2024-09-17T18:15:55.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764292+0000", 2024-09-17T18:15:55.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764293+0000", 2024-09-17T18:15:55.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8000000000000004e-07 2024-09-17T18:15:55.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764299+0000", 2024-09-17T18:15:55.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0719999999999996e-06 2024-09-17T18:15:55.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764325+0000", 2024-09-17T18:15:55.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6489e-05 2024-09-17T18:15:55.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764337+0000", 2024-09-17T18:15:55.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1096e-05 2024-09-17T18:15:55.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764445+0000", 2024-09-17T18:15:55.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000108256 2024-09-17T18:15:55.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:55.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764453+0000", 2024-09-17T18:15:55.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5799999999999992e-06 2024-09-17T18:15:55.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772725+0000", 2024-09-17T18:15:55.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082712089999999999 2024-09-17T18:15:55.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772821+0000", 2024-09-17T18:15:55.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6620999999999995e-05 2024-09-17T18:15:55.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773493+0000", 2024-09-17T18:15:55.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00067135899999999995 2024-09-17T18:15:55.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781853+0000", 2024-09-17T18:15:55.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0083605039999999995 2024-09-17T18:15:55.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.793103+0000", 2024-09-17T18:15:55.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011249687 2024-09-17T18:15:55.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.793163+0000", 2024-09-17T18:15:55.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9935999999999997e-05 2024-09-17T18:15:55.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.754 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.754 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:360 3.bs0 3:df05abfe:::smithi15432074-30:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:15:55.754 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.764354+0000", 2024-09-17T18:15:55.754 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.909479799, 2024-09-17T18:15:55.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.030712617000000001, 2024-09-17T18:15:55.754 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.754 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.754 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.754 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.754 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.755 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.755 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 360 2024-09-17T18:15:55.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.755 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764354+0000", 2024-09-17T18:15:55.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764354+0000", 2024-09-17T18:15:55.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764355+0000", 2024-09-17T18:15:55.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1200000000000001e-07 2024-09-17T18:15:55.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764359+0000", 2024-09-17T18:15:55.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5179999999999998e-06 2024-09-17T18:15:55.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764372+0000", 2024-09-17T18:15:55.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2284e-05 2024-09-17T18:15:55.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764383+0000", 2024-09-17T18:15:55.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1687e-05 2024-09-17T18:15:55.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764511+0000", 2024-09-17T18:15:55.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012773799999999999 2024-09-17T18:15:55.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:55.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764522+0000", 2024-09-17T18:15:55.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0898e-05 2024-09-17T18:15:55.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774059+0000", 2024-09-17T18:15:55.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0095365880000000004 2024-09-17T18:15:55.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774152+0000", 2024-09-17T18:15:55.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3352999999999999e-05 2024-09-17T18:15:55.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774946+0000", 2024-09-17T18:15:55.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00079374800000000004 2024-09-17T18:15:55.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781856+0000", 2024-09-17T18:15:55.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006910406 2024-09-17T18:15:55.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795004+0000", 2024-09-17T18:15:55.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01314805 2024-09-17T18:15:55.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795067+0000", 2024-09-17T18:15:55.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2434999999999994e-05 2024-09-17T18:15:55.761 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.761 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.761 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.761 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:370 3.7s0 3:ea689e14:::smithi15432074-27:head [append 0~524288] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:15:55.761 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.039539+0000", 2024-09-17T18:15:55.761 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.634294905000001, 2024-09-17T18:15:55.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010125532, 2024-09-17T18:15:55.761 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.761 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.761 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.762 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.762 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.762 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.762 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 370 2024-09-17T18:15:55.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.762 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.039539+0000", 2024-09-17T18:15:55.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.039539+0000", 2024-09-17T18:15:55.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.039541+0000", 2024-09-17T18:15:55.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.306e-06 2024-09-17T18:15:55.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.040600+0000", 2024-09-17T18:15:55.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001058315 2024-09-17T18:15:55.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.040639+0000", 2024-09-17T18:15:55.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9168999999999997e-05 2024-09-17T18:15:55.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.040657+0000", 2024-09-17T18:15:55.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8235000000000001e-05 2024-09-17T18:15:55.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.040760+0000", 2024-09-17T18:15:55.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000103515 2024-09-17T18:15:55.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.040892+0000", 2024-09-17T18:15:55.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013173300000000001 2024-09-17T18:15:55.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.042027+0000", 2024-09-17T18:15:55.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001135149 2024-09-17T18:15:55.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.043794+0000", 2024-09-17T18:15:55.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017666890000000001 2024-09-17T18:15:55.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.049444+0000", 2024-09-17T18:15:55.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056499580000000001 2024-09-17T18:15:55.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.049664+0000", 2024-09-17T18:15:55.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00022046300000000001 2024-09-17T18:15:55.767 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.767 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.767 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.767 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:508 3.7s0 3:ef12b1fb:::smithi15432074-35:head [copy-from ver 49] snapc 10=[10,e,d,c,b,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:55.767 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310195+0000", 2024-09-17T18:15:55.767 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.3636387379999997, 2024-09-17T18:15:55.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.056996193000000001, 2024-09-17T18:15:55.767 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.767 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.767 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.767 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.768 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.768 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.768 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 508 2024-09-17T18:15:55.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.768 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310195+0000", 2024-09-17T18:15:55.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310195+0000", 2024-09-17T18:15:55.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310199+0000", 2024-09-17T18:15:55.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.777e-06 2024-09-17T18:15:55.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310215+0000", 2024-09-17T18:15:55.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6648999999999999e-05 2024-09-17T18:15:55.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310262+0000", 2024-09-17T18:15:55.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6885000000000003e-05 2024-09-17T18:15:55.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310286+0000", 2024-09-17T18:15:55.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4029999999999999e-05 2024-09-17T18:15:55.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310465+0000", 2024-09-17T18:15:55.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017908900000000001 2024-09-17T18:15:55.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-17T18:15:55.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310488+0000", 2024-09-17T18:15:55.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2370000000000001e-05 2024-09-17T18:15:55.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.318449+0000", 2024-09-17T18:15:55.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0079614909999999994 2024-09-17T18:15:55.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.318706+0000", 2024-09-17T18:15:55.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00025651999999999999 2024-09-17T18:15:55.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.349677+0000", 2024-09-17T18:15:55.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.030971423000000001 2024-09-17T18:15:55.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.358861+0000", 2024-09-17T18:15:55.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0091838010000000001 2024-09-17T18:15:55.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.367112+0000", 2024-09-17T18:15:55.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082507459999999998 2024-09-17T18:15:55.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.367191+0000", 2024-09-17T18:15:55.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9412000000000005e-05 2024-09-17T18:15:55.776 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.777 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.777 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:509 3.7s0 3:ef12b1fb:::smithi15432074-35:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:55.777 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310343+0000", 2024-09-17T18:15:55.777 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.3634907150000002, 2024-09-17T18:15:55.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.044603753000000003, 2024-09-17T18:15:55.778 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.778 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.778 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:15:55.778 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.778 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.778 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.778 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 509 2024-09-17T18:15:55.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.778 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310343+0000", 2024-09-17T18:15:55.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310343+0000", 2024-09-17T18:15:55.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310345+0000", 2024-09-17T18:15:55.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.646e-06 2024-09-17T18:15:55.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310355+0000", 2024-09-17T18:15:55.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0094e-05 2024-09-17T18:15:55.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310377+0000", 2024-09-17T18:15:55.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2402e-05 2024-09-17T18:15:55.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310395+0000", 2024-09-17T18:15:55.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7706999999999998e-05 2024-09-17T18:15:55.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310659+0000", 2024-09-17T18:15:55.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026424 2024-09-17T18:15:55.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:15:55.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310678+0000", 2024-09-17T18:15:55.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8573e-05 2024-09-17T18:15:55.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320109+0000", 2024-09-17T18:15:55.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094309330000000007 2024-09-17T18:15:55.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for blocked object", 2024-09-17T18:15:55.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320251+0000", 2024-09-17T18:15:55.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014214300000000001 2024-09-17T18:15:55.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354626+0000", 2024-09-17T18:15:55.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.034374926 2024-09-17T18:15:55.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354762+0000", 2024-09-17T18:15:55.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013625900000000001 2024-09-17T18:15:55.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354947+0000", 2024-09-17T18:15:55.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00018483 2024-09-17T18:15:55.783 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.783 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.783 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.783 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:515 3.bs0 3:d6f6dcd5:::smithi15432074-7:head [copy-from ver 28] snapc 10=[10,e,d,c,b,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:55.783 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.339764+0000", 2024-09-17T18:15:55.784 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.3340700080000003, 2024-09-17T18:15:55.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.055974778000000003, 2024-09-17T18:15:55.784 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.784 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.784 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.784 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.784 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.784 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.784 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 515 2024-09-17T18:15:55.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.784 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339764+0000", 2024-09-17T18:15:55.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339764+0000", 2024-09-17T18:15:55.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339767+0000", 2024-09-17T18:15:55.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.54e-06 2024-09-17T18:15:55.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339783+0000", 2024-09-17T18:15:55.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5460000000000001e-05 2024-09-17T18:15:55.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339828+0000", 2024-09-17T18:15:55.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4776e-05 2024-09-17T18:15:55.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339849+0000", 2024-09-17T18:15:55.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1319e-05 2024-09-17T18:15:55.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339954+0000", 2024-09-17T18:15:55.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105138 2024-09-17T18:15:55.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340099+0000", 2024-09-17T18:15:55.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014509500000000001 2024-09-17T18:15:55.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.386415+0000", 2024-09-17T18:15:55.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.046316261999999997 2024-09-17T18:15:55.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.392450+0000", 2024-09-17T18:15:55.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060346050000000002 2024-09-17T18:15:55.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.395617+0000", 2024-09-17T18:15:55.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031672219999999999 2024-09-17T18:15:55.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.395739+0000", 2024-09-17T18:15:55.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012136100000000001 2024-09-17T18:15:55.789 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.789 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.789 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.789 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:516 3.bs0 3:d6f6dcd5:::smithi15432074-7:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:55.789 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.340134+0000", 2024-09-17T18:15:55.789 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.3336994449999997, 2024-09-17T18:15:55.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.050807849000000002, 2024-09-17T18:15:55.789 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.789 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.790 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:15:55.790 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.790 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.790 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.790 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 516 2024-09-17T18:15:55.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.790 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340134+0000", 2024-09-17T18:15:55.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340134+0000", 2024-09-17T18:15:55.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340136+0000", 2024-09-17T18:15:55.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.951e-06 2024-09-17T18:15:55.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340145+0000", 2024-09-17T18:15:55.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4630000000000001e-06 2024-09-17T18:15:55.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340170+0000", 2024-09-17T18:15:55.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4805000000000001e-05 2024-09-17T18:15:55.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340190+0000", 2024-09-17T18:15:55.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0761999999999999e-05 2024-09-17T18:15:55.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340326+0000", 2024-09-17T18:15:55.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013571500000000001 2024-09-17T18:15:55.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for blocked object", 2024-09-17T18:15:55.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340392+0000", 2024-09-17T18:15:55.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6311999999999998e-05 2024-09-17T18:15:55.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.390622+0000", 2024-09-17T18:15:55.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.050229577999999997 2024-09-17T18:15:55.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.390771+0000", 2024-09-17T18:15:55.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000149271 2024-09-17T18:15:55.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.390942+0000", 2024-09-17T18:15:55.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017099199999999999 2024-09-17T18:15:55.794 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.795 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.795 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.as6 54/31 ECSubWrite(tid=284, reqid=osd.13.0:284, at_version=54'79, trim_to=0'0, roll_forward_to=54'77))", 2024-09-17T18:15:55.795 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.345088+0000", 2024-09-17T18:15:55.795 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.3287461030000003, 2024-09-17T18:15:55.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092295539999999992, 2024-09-17T18:15:55.795 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.795 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.795 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:55.795 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345088+0000", 2024-09-17T18:15:55.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345088+0000", 2024-09-17T18:15:55.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345095+0000", 2024-09-17T18:15:55.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1999999999999997e-06 2024-09-17T18:15:55.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345145+0000", 2024-09-17T18:15:55.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9772999999999999e-05 2024-09-17T18:15:55.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345173+0000", 2024-09-17T18:15:55.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7855e-05 2024-09-17T18:15:55.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345201+0000", 2024-09-17T18:15:55.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8693000000000001e-05 2024-09-17T18:15:55.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345338+0000", 2024-09-17T18:15:55.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013673 2024-09-17T18:15:55.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345355+0000", 2024-09-17T18:15:55.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6840000000000001e-05 2024-09-17T18:15:55.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354255+0000", 2024-09-17T18:15:55.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0089004040000000006 2024-09-17T18:15:55.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354317+0000", 2024-09-17T18:15:55.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2058999999999997e-05 2024-09-17T18:15:55.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.799 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.800 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds6 54/31 ECSubWrite(tid=287, reqid=osd.13.0:287, at_version=54'140, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:15:55.800 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.345259+0000", 2024-09-17T18:15:55.800 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.3285750170000004, 2024-09-17T18:15:55.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0091023990000000006, 2024-09-17T18:15:55.800 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.800 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.800 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:55.800 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345259+0000", 2024-09-17T18:15:55.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345259+0000", 2024-09-17T18:15:55.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345260+0000", 2024-09-17T18:15:55.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7000000000000003e-07 2024-09-17T18:15:55.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345310+0000", 2024-09-17T18:15:55.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0232999999999998e-05 2024-09-17T18:15:55.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345334+0000", 2024-09-17T18:15:55.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3845e-05 2024-09-17T18:15:55.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345353+0000", 2024-09-17T18:15:55.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9227000000000001e-05 2024-09-17T18:15:55.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345443+0000", 2024-09-17T18:15:55.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9783000000000004e-05 2024-09-17T18:15:55.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.345457+0000", 2024-09-17T18:15:55.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3757999999999999e-05 2024-09-17T18:15:55.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354306+0000", 2024-09-17T18:15:55.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0088495840000000006 2024-09-17T18:15:55.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354361+0000", 2024-09-17T18:15:55.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4999e-05 2024-09-17T18:15:55.804 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.804 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.804 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.805 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:519 3.bs0 3:d3397481:::smithi15432074-20:head [rollback a] snapc 10=[10,e,d,c,b,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:55.805 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.354477+0000", 2024-09-17T18:15:55.805 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.3193567809999998, 2024-09-17T18:15:55.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010109909, 2024-09-17T18:15:55.805 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.805 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.805 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.805 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.805 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.805 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.805 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 519 2024-09-17T18:15:55.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.806 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354477+0000", 2024-09-17T18:15:55.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354477+0000", 2024-09-17T18:15:55.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354478+0000", 2024-09-17T18:15:55.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4559999999999999e-06 2024-09-17T18:15:55.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354485+0000", 2024-09-17T18:15:55.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8040000000000004e-06 2024-09-17T18:15:55.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354505+0000", 2024-09-17T18:15:55.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9324999999999999e-05 2024-09-17T18:15:55.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354523+0000", 2024-09-17T18:15:55.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8173999999999999e-05 2024-09-17T18:15:55.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.359062+0000", 2024-09-17T18:15:55.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045387559999999997 2024-09-17T18:15:55.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.359203+0000", 2024-09-17T18:15:55.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014103400000000001 2024-09-17T18:15:55.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.360017+0000", 2024-09-17T18:15:55.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00081424500000000001 2024-09-17T18:15:55.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.364292+0000", 2024-09-17T18:15:55.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042751589999999997 2024-09-17T18:15:55.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.364430+0000", 2024-09-17T18:15:55.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000138474 2024-09-17T18:15:55.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.364587+0000", 2024-09-17T18:15:55.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000156482 2024-09-17T18:15:55.810 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.810 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.810 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.810 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:520 3.bs0 3:d3397481:::smithi15432074-20:head [append 0~0] snapc 10=[10,e,d,c,b,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:55.811 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.354550+0000", 2024-09-17T18:15:55.811 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.3192839330000004, 2024-09-17T18:15:55.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010549131999999999, 2024-09-17T18:15:55.811 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.811 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.811 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:55.811 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:15:55.811 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:15:55.811 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:55.811 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 520 2024-09-17T18:15:55.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.811 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354550+0000", 2024-09-17T18:15:55.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354550+0000", 2024-09-17T18:15:55.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354551+0000", 2024-09-17T18:15:55.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2529999999999999e-06 2024-09-17T18:15:55.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354557+0000", 2024-09-17T18:15:55.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8069999999999996e-06 2024-09-17T18:15:55.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354575+0000", 2024-09-17T18:15:55.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8156e-05 2024-09-17T18:15:55.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354589+0000", 2024-09-17T18:15:55.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3886000000000001e-05 2024-09-17T18:15:55.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.361041+0000", 2024-09-17T18:15:55.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064523860000000001 2024-09-17T18:15:55.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.361207+0000", 2024-09-17T18:15:55.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000165668 2024-09-17T18:15:55.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:55.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.361704+0000", 2024-09-17T18:15:55.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00049718600000000005 2024-09-17T18:15:55.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:55.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.364592+0000", 2024-09-17T18:15:55.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028878459999999999 2024-09-17T18:15:55.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:15:55.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.364963+0000", 2024-09-17T18:15:55.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000371009 2024-09-17T18:15:55.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.365099+0000", 2024-09-17T18:15:55.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013593500000000001 2024-09-17T18:15:55.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.816 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.816 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(osd.13.22:7 3.bs0 3:d6f6dcd5:::smithi15432074-7:head [assert-version v82,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-17T18:15:55.816 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:54.361564+0000", 2024-09-17T18:15:55.816 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.3122702980000001, 2024-09-17T18:15:55.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014200974999999999, 2024-09-17T18:15:55.816 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:55.817 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:55.817 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:15:55.817 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:55.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:55.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.361564+0000", 2024-09-17T18:15:55.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:55.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.361564+0000", 2024-09-17T18:15:55.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:55.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:55.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.361568+0000", 2024-09-17T18:15:55.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6670000000000004e-06 2024-09-17T18:15:55.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:55.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.361588+0000", 2024-09-17T18:15:55.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9755999999999999e-05 2024-09-17T18:15:55.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:55.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.361631+0000", 2024-09-17T18:15:55.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3455999999999999e-05 2024-09-17T18:15:55.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:55.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.361653+0000", 2024-09-17T18:15:55.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1552999999999998e-05 2024-09-17T18:15:55.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.361774+0000", 2024-09-17T18:15:55.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000120591 2024-09-17T18:15:55.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-17T18:15:55.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.361785+0000", 2024-09-17T18:15:55.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1385e-05 2024-09-17T18:15:55.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:55.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.366211+0000", 2024-09-17T18:15:55.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044265060000000002 2024-09-17T18:15:55.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:15:55.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.366323+0000", 2024-09-17T18:15:55.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011120699999999999 2024-09-17T18:15:55.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:55.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:55.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:55.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.375764+0000", 2024-09-17T18:15:55.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094418539999999995 2024-09-17T18:15:55.821 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.821 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.821 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.821 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:55.821 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:55.821 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:55.823 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T18:15:55.823 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:55.819+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:55.924 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:55.922+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:55.951 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:55.951 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:55.952 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-17T18:15:55.952 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:55.966 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T18:15:55.967 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T18:15:56.051 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:56.050+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:56.124 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:15:56.124 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-17T18:15:56.124 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-17T18:15:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:56.125 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:56.122+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:56.140 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T18:15:56.148 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:15:56.149 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:15:56.170 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:15:56.170 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:15:56.190 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:15:56.191 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:15:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:15:56.211 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:15:56.227 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:56.226+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:15:56.229 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:15:56.249 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:15:56.250 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:15:56.264 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:15:56.264 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-17T18:15:56.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-17T18:15:56.264 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-17T18:15:56.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.264 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs1 37/31 ECSubWrite(tid=30, reqid=client.4565.0:241, at_version=37'15, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:15:56.265 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.704949+0000", 2024-09-17T18:15:56.265 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.558055245999999, 2024-09-17T18:15:56.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045940199999999999, 2024-09-17T18:15:56.265 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.265 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.265 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.265 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.704949+0000", 2024-09-17T18:15:56.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.704949+0000", 2024-09-17T18:15:56.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.704950+0000", 2024-09-17T18:15:56.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5400000000000002e-07 2024-09-17T18:15:56.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.705005+0000", 2024-09-17T18:15:56.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5566000000000003e-05 2024-09-17T18:15:56.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.705037+0000", 2024-09-17T18:15:56.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2150999999999998e-05 2024-09-17T18:15:56.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.705063+0000", 2024-09-17T18:15:56.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5822000000000001e-05 2024-09-17T18:15:56.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.705246+0000", 2024-09-17T18:15:56.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000183086 2024-09-17T18:15:56.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.705260+0000", 2024-09-17T18:15:56.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4217e-05 2024-09-17T18:15:56.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.709475+0000", 2024-09-17T18:15:56.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042142120000000002 2024-09-17T18:15:56.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.709543+0000", 2024-09-17T18:15:56.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8612e-05 2024-09-17T18:15:56.269 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.269 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.269 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.270 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs1 37/31 ECSubWrite(tid=31, reqid=client.4565.0:242, at_version=37'16, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:15:56.270 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.706489+0000", 2024-09-17T18:15:56.270 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.556515188999999, 2024-09-17T18:15:56.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060626710000000004, 2024-09-17T18:15:56.270 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.270 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.270 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.270 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706489+0000", 2024-09-17T18:15:56.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706489+0000", 2024-09-17T18:15:56.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706491+0000", 2024-09-17T18:15:56.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.689e-06 2024-09-17T18:15:56.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706535+0000", 2024-09-17T18:15:56.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3600999999999998e-05 2024-09-17T18:15:56.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706565+0000", 2024-09-17T18:15:56.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0281999999999999e-05 2024-09-17T18:15:56.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706582+0000", 2024-09-17T18:15:56.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6711e-05 2024-09-17T18:15:56.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706778+0000", 2024-09-17T18:15:56.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00019613899999999999 2024-09-17T18:15:56.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706801+0000", 2024-09-17T18:15:56.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3703999999999999e-05 2024-09-17T18:15:56.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.712460+0000", 2024-09-17T18:15:56.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056587479999999999 2024-09-17T18:15:56.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.712552+0000", 2024-09-17T18:15:56.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1797000000000002e-05 2024-09-17T18:15:56.274 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.274 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.274 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.274 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs1 37/31 ECSubWrite(tid=32, reqid=client.4565.0:243, at_version=37'17, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:15:56.274 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.707477+0000", 2024-09-17T18:15:56.274 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.555527189999999, 2024-09-17T18:15:56.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005556732, 2024-09-17T18:15:56.274 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.275 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.275 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.275 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707477+0000", 2024-09-17T18:15:56.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707477+0000", 2024-09-17T18:15:56.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707479+0000", 2024-09-17T18:15:56.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.717e-06 2024-09-17T18:15:56.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707515+0000", 2024-09-17T18:15:56.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6501999999999997e-05 2024-09-17T18:15:56.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707541+0000", 2024-09-17T18:15:56.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5113000000000002e-05 2024-09-17T18:15:56.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707562+0000", 2024-09-17T18:15:56.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1585000000000001e-05 2024-09-17T18:15:56.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707638+0000", 2024-09-17T18:15:56.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5597000000000001e-05 2024-09-17T18:15:56.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707653+0000", 2024-09-17T18:15:56.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4783000000000001e-05 2024-09-17T18:15:56.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.712999+0000", 2024-09-17T18:15:56.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053467159999999996 2024-09-17T18:15:56.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.713034+0000", 2024-09-17T18:15:56.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4718999999999997e-05 2024-09-17T18:15:56.279 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.279 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.279 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.279 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.9s5 42/31 ECSubWrite(tid=42, reqid=osd.7.0:42, at_version=42'30, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:15:56.279 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.776164+0000", 2024-09-17T18:15:56.279 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.486840320999999, 2024-09-17T18:15:56.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416520000000001, 2024-09-17T18:15:56.279 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.279 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.279 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.279 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776164+0000", 2024-09-17T18:15:56.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776164+0000", 2024-09-17T18:15:56.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776165+0000", 2024-09-17T18:15:56.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.398e-06 2024-09-17T18:15:56.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776203+0000", 2024-09-17T18:15:56.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7314999999999998e-05 2024-09-17T18:15:56.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776223+0000", 2024-09-17T18:15:56.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9721e-05 2024-09-17T18:15:56.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776237+0000", 2024-09-17T18:15:56.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4110999999999999e-05 2024-09-17T18:15:56.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776405+0000", 2024-09-17T18:15:56.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016826300000000001 2024-09-17T18:15:56.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776420+0000", 2024-09-17T18:15:56.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4918e-05 2024-09-17T18:15:56.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780959+0000", 2024-09-17T18:15:56.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045393229999999996 2024-09-17T18:15:56.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781006+0000", 2024-09-17T18:15:56.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6603000000000001e-05 2024-09-17T18:15:56.283 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.283 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.284 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.284 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 42/31 ECSubWrite(tid=160, reqid=osd.13.0:160, at_version=42'69, trim_to=0'0, roll_forward_to=40'63))", 2024-09-17T18:15:56.284 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.792028+0000", 2024-09-17T18:15:56.284 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.470976114999999, 2024-09-17T18:15:56.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058500109999999996, 2024-09-17T18:15:56.284 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.284 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.284 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.284 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792028+0000", 2024-09-17T18:15:56.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792028+0000", 2024-09-17T18:15:56.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792029+0000", 2024-09-17T18:15:56.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8999999999999997e-07 2024-09-17T18:15:56.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792053+0000", 2024-09-17T18:15:56.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4172000000000002e-05 2024-09-17T18:15:56.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792062+0000", 2024-09-17T18:15:56.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2e-06 2024-09-17T18:15:56.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792071+0000", 2024-09-17T18:15:56.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6880000000000005e-06 2024-09-17T18:15:56.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792774+0000", 2024-09-17T18:15:56.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00070302699999999995 2024-09-17T18:15:56.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792790+0000", 2024-09-17T18:15:56.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6093e-05 2024-09-17T18:15:56.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797821+0000", 2024-09-17T18:15:56.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0050305710000000002 2024-09-17T18:15:56.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797878+0000", 2024-09-17T18:15:56.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7769999999999997e-05 2024-09-17T18:15:56.288 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.288 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.288 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.288 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.9s5 42/31 ECSubWrite(tid=43, reqid=osd.7.0:42, at_version=0'0, trim_to=0'0, roll_forward_to=42'30))", 2024-09-17T18:15:56.288 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.795617+0000", 2024-09-17T18:15:56.289 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.467387758000001, 2024-09-17T18:15:56.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054555130000000004, 2024-09-17T18:15:56.289 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.289 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.289 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.289 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795617+0000", 2024-09-17T18:15:56.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795617+0000", 2024-09-17T18:15:56.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795617+0000", 2024-09-17T18:15:56.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3799999999999996e-07 2024-09-17T18:15:56.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795628+0000", 2024-09-17T18:15:56.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0868e-05 2024-09-17T18:15:56.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795640+0000", 2024-09-17T18:15:56.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1327e-05 2024-09-17T18:15:56.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795646+0000", 2024-09-17T18:15:56.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9089999999999997e-06 2024-09-17T18:15:56.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795702+0000", 2024-09-17T18:15:56.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6654999999999999e-05 2024-09-17T18:15:56.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795710+0000", 2024-09-17T18:15:56.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.43e-06 2024-09-17T18:15:56.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801022+0000", 2024-09-17T18:15:56.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005311975 2024-09-17T18:15:56.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801072+0000", 2024-09-17T18:15:56.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0611e-05 2024-09-17T18:15:56.293 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.293 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.294 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.294 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.9s5 42/31 ECSubWrite(tid=45, reqid=osd.7.0:45, at_version=42'32, trim_to=0'0, roll_forward_to=42'30))", 2024-09-17T18:15:56.294 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.797426+0000", 2024-09-17T18:15:56.294 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.465578217000001, 2024-09-17T18:15:56.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063823029999999998, 2024-09-17T18:15:56.294 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.294 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.294 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.294 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.294 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797426+0000", 2024-09-17T18:15:56.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.295 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797426+0000", 2024-09-17T18:15:56.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.295 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797427+0000", 2024-09-17T18:15:56.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2099999999999997e-07 2024-09-17T18:15:56.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797440+0000", 2024-09-17T18:15:56.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3254e-05 2024-09-17T18:15:56.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797448+0000", 2024-09-17T18:15:56.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4239999999999993e-06 2024-09-17T18:15:56.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797453+0000", 2024-09-17T18:15:56.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4440000000000001e-06 2024-09-17T18:15:56.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797511+0000", 2024-09-17T18:15:56.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8357999999999999e-05 2024-09-17T18:15:56.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797522+0000", 2024-09-17T18:15:56.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.08e-05 2024-09-17T18:15:56.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.803773+0000", 2024-09-17T18:15:56.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062510480000000004 2024-09-17T18:15:56.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.803809+0000", 2024-09-17T18:15:56.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5454000000000003e-05 2024-09-17T18:15:56.299 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.299 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.299 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.299 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 42/31 ECSubWrite(tid=161, reqid=osd.13.0:160, at_version=0'0, trim_to=0'0, roll_forward_to=42'69))", 2024-09-17T18:15:56.299 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.802324+0000", 2024-09-17T18:15:56.299 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.460680707000002, 2024-09-17T18:15:56.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042799580000000004, 2024-09-17T18:15:56.299 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.299 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.299 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.299 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.802324+0000", 2024-09-17T18:15:56.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.802324+0000", 2024-09-17T18:15:56.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.802325+0000", 2024-09-17T18:15:56.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.632e-06 2024-09-17T18:15:56.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.802344+0000", 2024-09-17T18:15:56.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9069999999999999e-05 2024-09-17T18:15:56.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.802372+0000", 2024-09-17T18:15:56.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7297e-05 2024-09-17T18:15:56.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.802388+0000", 2024-09-17T18:15:56.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6463000000000001e-05 2024-09-17T18:15:56.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.802470+0000", 2024-09-17T18:15:56.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1502999999999995e-05 2024-09-17T18:15:56.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.802480+0000", 2024-09-17T18:15:56.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0203e-05 2024-09-17T18:15:56.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.806554+0000", 2024-09-17T18:15:56.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040742770000000003 2024-09-17T18:15:56.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.806604+0000", 2024-09-17T18:15:56.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9512999999999998e-05 2024-09-17T18:15:56.304 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.304 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.304 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.304 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 42/31 ECSubWrite(tid=163, reqid=osd.13.0:163, at_version=42'73, trim_to=0'0, roll_forward_to=42'69))", 2024-09-17T18:15:56.304 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.809504+0000", 2024-09-17T18:15:56.304 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.453500493, 2024-09-17T18:15:56.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058964129999999997, 2024-09-17T18:15:56.304 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.304 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.304 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.305 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809504+0000", 2024-09-17T18:15:56.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809504+0000", 2024-09-17T18:15:56.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809505+0000", 2024-09-17T18:15:56.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.114e-06 2024-09-17T18:15:56.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809538+0000", 2024-09-17T18:15:56.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3356999999999999e-05 2024-09-17T18:15:56.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809562+0000", 2024-09-17T18:15:56.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3407000000000001e-05 2024-09-17T18:15:56.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809579+0000", 2024-09-17T18:15:56.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7048e-05 2024-09-17T18:15:56.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809633+0000", 2024-09-17T18:15:56.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4338000000000001e-05 2024-09-17T18:15:56.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809638+0000", 2024-09-17T18:15:56.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8899999999999998e-06 2024-09-17T18:15:56.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.815347+0000", 2024-09-17T18:15:56.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057087709999999996 2024-09-17T18:15:56.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.815400+0000", 2024-09-17T18:15:56.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3488e-05 2024-09-17T18:15:56.308 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.308 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.309 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.309 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 42/31 ECSubWrite(tid=172, reqid=osd.13.0:172, at_version=42'77, trim_to=0'0, roll_forward_to=42'73))", 2024-09-17T18:15:56.309 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.820063+0000", 2024-09-17T18:15:56.309 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.442941356999999, 2024-09-17T18:15:56.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047871040000000004, 2024-09-17T18:15:56.309 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.309 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.309 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.309 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820063+0000", 2024-09-17T18:15:56.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820063+0000", 2024-09-17T18:15:56.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820064+0000", 2024-09-17T18:15:56.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5999999999999991e-07 2024-09-17T18:15:56.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820092+0000", 2024-09-17T18:15:56.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7557000000000001e-05 2024-09-17T18:15:56.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820107+0000", 2024-09-17T18:15:56.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5206e-05 2024-09-17T18:15:56.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820116+0000", 2024-09-17T18:15:56.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3130000000000004e-06 2024-09-17T18:15:56.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820210+0000", 2024-09-17T18:15:56.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4116999999999994e-05 2024-09-17T18:15:56.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820228+0000", 2024-09-17T18:15:56.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7825e-05 2024-09-17T18:15:56.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.824807+0000", 2024-09-17T18:15:56.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045786050000000003 2024-09-17T18:15:56.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.824850+0000", 2024-09-17T18:15:56.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3520999999999999e-05 2024-09-17T18:15:56.313 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.314 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.314 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.314 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.5s1 54/31 ECSubWrite(tid=81, reqid=osd.5.0:81, at_version=54'21, trim_to=0'0, roll_forward_to=53'19))", 2024-09-17T18:15:56.314 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310843+0000", 2024-09-17T18:15:56.314 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.9521612319999999, 2024-09-17T18:15:56.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013234032, 2024-09-17T18:15:56.314 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.314 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.314 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.314 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310843+0000", 2024-09-17T18:15:56.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310843+0000", 2024-09-17T18:15:56.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310844+0000", 2024-09-17T18:15:56.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8299999999999996e-07 2024-09-17T18:15:56.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310928+0000", 2024-09-17T18:15:56.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4201000000000002e-05 2024-09-17T18:15:56.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310977+0000", 2024-09-17T18:15:56.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9376000000000003e-05 2024-09-17T18:15:56.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.311003+0000", 2024-09-17T18:15:56.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5123e-05 2024-09-17T18:15:56.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.313724+0000", 2024-09-17T18:15:56.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002721462 2024-09-17T18:15:56.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.313759+0000", 2024-09-17T18:15:56.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4935999999999999e-05 2024-09-17T18:15:56.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.323837+0000", 2024-09-17T18:15:56.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010078129 2024-09-17T18:15:56.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.324077+0000", 2024-09-17T18:15:56.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000240122 2024-09-17T18:15:56.318 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.318 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.319 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.319 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 54/31 ECSubWrite(tid=277, reqid=osd.13.0:277, at_version=54'134, trim_to=0'0, roll_forward_to=53'132))", 2024-09-17T18:15:56.319 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.319173+0000", 2024-09-17T18:15:56.319 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.9438313029999996, 2024-09-17T18:15:56.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060233880000000002, 2024-09-17T18:15:56.319 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.319 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.319 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.319 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319173+0000", 2024-09-17T18:15:56.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319173+0000", 2024-09-17T18:15:56.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319174+0000", 2024-09-17T18:15:56.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5300000000000003e-07 2024-09-17T18:15:56.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319245+0000", 2024-09-17T18:15:56.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0905e-05 2024-09-17T18:15:56.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319281+0000", 2024-09-17T18:15:56.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6211999999999998e-05 2024-09-17T18:15:56.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319355+0000", 2024-09-17T18:15:56.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4004999999999994e-05 2024-09-17T18:15:56.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.321073+0000", 2024-09-17T18:15:56.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001718383 2024-09-17T18:15:56.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.321100+0000", 2024-09-17T18:15:56.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7123000000000001e-05 2024-09-17T18:15:56.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.325137+0000", 2024-09-17T18:15:56.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040366890000000004 2024-09-17T18:15:56.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.325197+0000", 2024-09-17T18:15:56.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9317999999999997e-05 2024-09-17T18:15:56.323 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.323 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.323 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.324 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs1 54/31 ECSubWrite(tid=82, reqid=osd.5.0:82, at_version=54'50, trim_to=0'0, roll_forward_to=53'48))", 2024-09-17T18:15:56.324 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.320067+0000", 2024-09-17T18:15:56.324 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.9429374040000003, 2024-09-17T18:15:56.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047460669999999996, 2024-09-17T18:15:56.324 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.324 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.324 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.324 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320067+0000", 2024-09-17T18:15:56.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320067+0000", 2024-09-17T18:15:56.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320069+0000", 2024-09-17T18:15:56.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2730000000000001e-06 2024-09-17T18:15:56.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320140+0000", 2024-09-17T18:15:56.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1057999999999996e-05 2024-09-17T18:15:56.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320178+0000", 2024-09-17T18:15:56.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7316e-05 2024-09-17T18:15:56.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320200+0000", 2024-09-17T18:15:56.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2599000000000002e-05 2024-09-17T18:15:56.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320551+0000", 2024-09-17T18:15:56.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000351085 2024-09-17T18:15:56.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320577+0000", 2024-09-17T18:15:56.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5236999999999999e-05 2024-09-17T18:15:56.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.324712+0000", 2024-09-17T18:15:56.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004135288 2024-09-17T18:15:56.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.324813+0000", 2024-09-17T18:15:56.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000101211 2024-09-17T18:15:56.328 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.328 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.328 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.328 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs1 54/31 ECSubWrite(tid=83, reqid=osd.5.0:83, at_version=54'52, trim_to=0'0, roll_forward_to=53'48))", 2024-09-17T18:15:56.328 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.320258+0000", 2024-09-17T18:15:56.328 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.9427459919999999, 2024-09-17T18:15:56.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005694681, 2024-09-17T18:15:56.329 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.329 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.329 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.329 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320258+0000", 2024-09-17T18:15:56.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320258+0000", 2024-09-17T18:15:56.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320260+0000", 2024-09-17T18:15:56.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1260000000000001e-06 2024-09-17T18:15:56.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320311+0000", 2024-09-17T18:15:56.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1808999999999998e-05 2024-09-17T18:15:56.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320342+0000", 2024-09-17T18:15:56.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0176e-05 2024-09-17T18:15:56.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320360+0000", 2024-09-17T18:15:56.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8899999999999999e-05 2024-09-17T18:15:56.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.322647+0000", 2024-09-17T18:15:56.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002286986 2024-09-17T18:15:56.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.322674+0000", 2024-09-17T18:15:56.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6758999999999999e-05 2024-09-17T18:15:56.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.325866+0000", 2024-09-17T18:15:56.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031921810000000001 2024-09-17T18:15:56.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.325953+0000", 2024-09-17T18:15:56.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6743999999999995e-05 2024-09-17T18:15:56.333 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.333 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.333 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.333 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.9s5 54/31 ECSubWrite(tid=78, reqid=osd.7.0:78, at_version=54'67, trim_to=0'0, roll_forward_to=53'63))", 2024-09-17T18:15:56.333 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.341575+0000", 2024-09-17T18:15:56.333 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.9214289969999996, 2024-09-17T18:15:56.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049319150000000003, 2024-09-17T18:15:56.333 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.333 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.334 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.334 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341575+0000", 2024-09-17T18:15:56.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341575+0000", 2024-09-17T18:15:56.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341578+0000", 2024-09-17T18:15:56.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1569999999999998e-06 2024-09-17T18:15:56.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341638+0000", 2024-09-17T18:15:56.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0696000000000003e-05 2024-09-17T18:15:56.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341674+0000", 2024-09-17T18:15:56.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5505e-05 2024-09-17T18:15:56.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341726+0000", 2024-09-17T18:15:56.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2646999999999999e-05 2024-09-17T18:15:56.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341910+0000", 2024-09-17T18:15:56.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00018374 2024-09-17T18:15:56.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341938+0000", 2024-09-17T18:15:56.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7538999999999998e-05 2024-09-17T18:15:56.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.346404+0000", 2024-09-17T18:15:56.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044663940000000003 2024-09-17T18:15:56.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.346507+0000", 2024-09-17T18:15:56.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000103237 2024-09-17T18:15:56.338 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.338 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.338 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.338 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 54/31 ECSubWrite(tid=285, reqid=osd.13.0:281, at_version=0'0, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:15:56.338 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.342921+0000", 2024-09-17T18:15:56.338 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.9200837630000001, 2024-09-17T18:15:56.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043414170000000002, 2024-09-17T18:15:56.338 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.339 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.339 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.339 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.342921+0000", 2024-09-17T18:15:56.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.342921+0000", 2024-09-17T18:15:56.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.342923+0000", 2024-09-17T18:15:56.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.04e-06 2024-09-17T18:15:56.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.342983+0000", 2024-09-17T18:15:56.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9815000000000002e-05 2024-09-17T18:15:56.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.343028+0000", 2024-09-17T18:15:56.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5212e-05 2024-09-17T18:15:56.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.343055+0000", 2024-09-17T18:15:56.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7039999999999999e-05 2024-09-17T18:15:56.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.343337+0000", 2024-09-17T18:15:56.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028183 2024-09-17T18:15:56.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.343359+0000", 2024-09-17T18:15:56.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2753000000000001e-05 2024-09-17T18:15:56.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347150+0000", 2024-09-17T18:15:56.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037908389999999998 2024-09-17T18:15:56.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347262+0000", 2024-09-17T18:15:56.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111888 2024-09-17T18:15:56.343 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.343 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.343 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.343 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 54/31 ECSubWrite(tid=286, reqid=osd.13.0:286, at_version=54'138, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:15:56.343 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.347140+0000", 2024-09-17T18:15:56.343 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.9158648469999999, 2024-09-17T18:15:56.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005171948, 2024-09-17T18:15:56.344 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.344 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.344 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.344 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347140+0000", 2024-09-17T18:15:56.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347140+0000", 2024-09-17T18:15:56.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347142+0000", 2024-09-17T18:15:56.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4399999999999999e-06 2024-09-17T18:15:56.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347206+0000", 2024-09-17T18:15:56.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3968999999999997e-05 2024-09-17T18:15:56.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347252+0000", 2024-09-17T18:15:56.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6282000000000002e-05 2024-09-17T18:15:56.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347269+0000", 2024-09-17T18:15:56.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6486000000000001e-05 2024-09-17T18:15:56.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347410+0000", 2024-09-17T18:15:56.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000140877 2024-09-17T18:15:56.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347434+0000", 2024-09-17T18:15:56.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4399000000000001e-05 2024-09-17T18:15:56.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.352199+0000", 2024-09-17T18:15:56.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047649880000000004 2024-09-17T18:15:56.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.352312+0000", 2024-09-17T18:15:56.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000112507 2024-09-17T18:15:56.348 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.348 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.348 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.348 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 54/31 ECSubWrite(tid=287, reqid=osd.13.0:287, at_version=54'140, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:15:56.348 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.347311+0000", 2024-09-17T18:15:56.348 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.9156936509999998, 2024-09-17T18:15:56.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066967789999999999, 2024-09-17T18:15:56.349 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.349 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.349 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.349 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347311+0000", 2024-09-17T18:15:56.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347311+0000", 2024-09-17T18:15:56.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347312+0000", 2024-09-17T18:15:56.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.04e-06 2024-09-17T18:15:56.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347377+0000", 2024-09-17T18:15:56.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5566000000000002e-05 2024-09-17T18:15:56.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347400+0000", 2024-09-17T18:15:56.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2719000000000001e-05 2024-09-17T18:15:56.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347420+0000", 2024-09-17T18:15:56.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9633e-05 2024-09-17T18:15:56.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.348462+0000", 2024-09-17T18:15:56.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010427279999999999 2024-09-17T18:15:56.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.348476+0000", 2024-09-17T18:15:56.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3207000000000001e-05 2024-09-17T18:15:56.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.353921+0000", 2024-09-17T18:15:56.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054453970000000003 2024-09-17T18:15:56.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354008+0000", 2024-09-17T18:15:56.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6489000000000005e-05 2024-09-17T18:15:56.353 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.353 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.353 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.353 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 54/31 ECSubWrite(tid=290, reqid=osd.13.0:290, at_version=54'144, trim_to=0'0, roll_forward_to=54'140))", 2024-09-17T18:15:56.353 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.367440+0000", 2024-09-17T18:15:56.353 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.8955646289999999, 2024-09-17T18:15:56.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004371069, 2024-09-17T18:15:56.353 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.353 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.354 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.354 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.367440+0000", 2024-09-17T18:15:56.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.367440+0000", 2024-09-17T18:15:56.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.367441+0000", 2024-09-17T18:15:56.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4160000000000001e-06 2024-09-17T18:15:56.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.367478+0000", 2024-09-17T18:15:56.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6971000000000002e-05 2024-09-17T18:15:56.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.367504+0000", 2024-09-17T18:15:56.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5673e-05 2024-09-17T18:15:56.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.367520+0000", 2024-09-17T18:15:56.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6189999999999999e-05 2024-09-17T18:15:56.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.368229+0000", 2024-09-17T18:15:56.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00070862300000000002 2024-09-17T18:15:56.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.368243+0000", 2024-09-17T18:15:56.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4122e-05 2024-09-17T18:15:56.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.371765+0000", 2024-09-17T18:15:56.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035219769999999999 2024-09-17T18:15:56.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.371811+0000", 2024-09-17T18:15:56.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6097000000000003e-05 2024-09-17T18:15:56.358 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.358 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.358 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.358 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 59/31 ECSubWrite(tid=341, reqid=client.4565.0:547, at_version=59'182, trim_to=0'0, roll_forward_to=58'180))", 2024-09-17T18:15:56.358 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:54.406166+0000", 2024-09-17T18:15:56.358 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.856838108, 2024-09-17T18:15:56.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006947717, 2024-09-17T18:15:56.358 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:15:56.359 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:15:56.359 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:15:56.359 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:15:56.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:15:56.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.406166+0000", 2024-09-17T18:15:56.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:15:56.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.406166+0000", 2024-09-17T18:15:56.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:15:56.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:15:56.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.406167+0000", 2024-09-17T18:15:56.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9599999999999999e-07 2024-09-17T18:15:56.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:15:56.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.409059+0000", 2024-09-17T18:15:56.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002891911 2024-09-17T18:15:56.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:15:56.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.409074+0000", 2024-09-17T18:15:56.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5498e-05 2024-09-17T18:15:56.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:15:56.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.409087+0000", 2024-09-17T18:15:56.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2877000000000001e-05 2024-09-17T18:15:56.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:15:56.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.409202+0000", 2024-09-17T18:15:56.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114904 2024-09-17T18:15:56.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:15:56.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.409213+0000", 2024-09-17T18:15:56.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0478e-05 2024-09-17T18:15:56.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:15:56.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.413074+0000", 2024-09-17T18:15:56.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038615429999999998 2024-09-17T18:15:56.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:15:56.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:15:56.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:15:56.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.413114+0000", 2024-09-17T18:15:56.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9910000000000002e-05 2024-09-17T18:15:56.363 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.363 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.363 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.363 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:15:56.363 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:15:56.363 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:15:56.364 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:15:56.365 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:15:56.365 INFO:tasks.rados.rados.0.smithi154.stdout:219: done (0 left) 2024-09-17T18:15:56.365 INFO:tasks.rados.rados.0.smithi154.stdout:220: rollback oid 11 current snap is 19 2024-09-17T18:15:56.365 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 11 to 18 2024-09-17T18:15:56.365 INFO:tasks.rados.rados.0.smithi154.stdout:221: read oid 21 snap -1 2024-09-17T18:15:56.365 INFO:tasks.rados.rados.0.smithi154.stdout:221: expect (ObjNum 35 snap 0 seq_num 35) 2024-09-17T18:15:56.366 INFO:tasks.rados.rados.0.smithi154.stdout:222: rmattr oid 44 current snap is 19 2024-09-17T18:15:56.366 INFO:tasks.rados.rados.0.smithi154.stdout:222: done (2 left) 2024-09-17T18:15:56.366 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 5 current snap is 19 2024-09-17T18:15:56.366 INFO:tasks.rados.rados.0.smithi154.stdout:223: seq_num 99 ranges {0=507904,507904=606208,1114112=557056} 2024-09-17T18:15:56.366 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:56.361+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:56.367 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T18:15:56.367 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:15:56.367 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:15:56.368 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:15:56.368 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:15:56.368 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:15:56.368 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:15:56.369 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:15:56.369 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:15:56.371 INFO:tasks.rados.rados.0.smithi154.stdout:223: writing smithi15432074-5 from 0 to 507904 tid 1 2024-09-17T18:15:56.372 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:15:56.372 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:15:56.375 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T18:15:56.383 INFO:tasks.rados.rados.0.smithi154.stdout:223: writing smithi15432074-5 from 507904 to 1114112 tid 2 2024-09-17T18:15:56.392 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:15:56.392 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:15:56.394 INFO:tasks.rados.rados.0.smithi154.stdout:223: writing smithi15432074-5 from 1114112 to 1671168 tid 3 2024-09-17T18:15:56.394 INFO:tasks.rados.rados.0.smithi154.stdout:224: rollback oid 10 current snap is 19 2024-09-17T18:15:56.394 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 10 to 18 2024-09-17T18:15:56.394 INFO:tasks.rados.rados.0.smithi154.stdout:220: finishing rollback tid 0 to smithi15432074-11 2024-09-17T18:15:56.394 INFO:tasks.rados.rados.0.smithi154.stdout:223: finishing write tid 1 to smithi15432074-5 2024-09-17T18:15:56.395 INFO:tasks.rados.rados.0.smithi154.stdout:220: finishing rollback tid 1 to smithi15432074-11 2024-09-17T18:15:56.395 INFO:tasks.rados.rados.0.smithi154.stdout:220: finishing rollback tid 2 to smithi15432074-11 2024-09-17T18:15:56.395 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 11 v 129 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-09-17T18:15:56.395 INFO:tasks.rados.rados.0.smithi154.stdout:220: done (3 left) 2024-09-17T18:15:56.395 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 2 current snap is 19 2024-09-17T18:15:56.395 INFO:tasks.rados.rados.0.smithi154.stdout:221: expect (ObjNum 35 snap 0 seq_num 35) 2024-09-17T18:15:56.404 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 580351 2024-09-17T18:15:56.404 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:56.416 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:15:56.416 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:15:56.420 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:56.433 INFO:tasks.rados.rados.0.smithi154.stdout:223: finishing write tid 2 to smithi15432074-5 2024-09-17T18:15:56.433 INFO:tasks.rados.rados.0.smithi154.stdout:223: finishing write tid 3 to smithi15432074-5 2024-09-17T18:15:56.433 INFO:tasks.rados.rados.0.smithi154.stdout:223: finishing write tid 4 to smithi15432074-5 2024-09-17T18:15:56.433 INFO:tasks.rados.rados.0.smithi154.stdout:225: seq_num 100 ranges {1671168=524288,2195456=753664,2949120=409600} 2024-09-17T18:15:56.437 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:15:56.438 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:15:56.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:15:56.434+0000 7f8bc4d34640 0 -- 172.21.15.87:0/1822018376 >> [v2:172.21.15.154:6824/3670919160,v1:172.21.15.154:6825/3670919160] conn(0x7f8bc021fb20 msgr2=0x7f8bc0221f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T18:15:56.464 INFO:tasks.rados.rados.0.smithi154.stdout:225: writing smithi15432074-2 from 1671168 to 2195456 tid 1 2024-09-17T18:15:56.465 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:56.461+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:56.474 INFO:tasks.rados.rados.0.smithi154.stdout:225: writing smithi15432074-2 from 2195456 to 2949120 tid 2 2024-09-17T18:15:56.480 INFO:tasks.rados.rados.0.smithi154.stdout:225: writing smithi15432074-2 from 2949120 to 3358720 tid 3 2024-09-17T18:15:56.480 INFO:tasks.rados.rados.0.smithi154.stdout:221: done (3 left) 2024-09-17T18:15:56.480 INFO:tasks.rados.rados.0.smithi154.stdout:226: read oid 8 snap -1 2024-09-17T18:15:56.480 INFO:tasks.rados.rados.0.smithi154.stdout:226: expect (ObjNum 7 snap 0 seq_num 7) 2024-09-17T18:15:56.480 INFO:tasks.rados.rados.0.smithi154.stdout:227: snap_remove snap 8 2024-09-17T18:15:56.480 INFO:tasks.rados.rados.0.smithi154.stdout:224: finishing rollback tid 0 to smithi15432074-10 2024-09-17T18:15:56.480 INFO:tasks.rados.rados.0.smithi154.stdout:224: finishing rollback tid 1 to smithi15432074-10 2024-09-17T18:15:56.480 INFO:tasks.rados.rados.0.smithi154.stdout:223: finishing write tid 5 to smithi15432074-5 2024-09-17T18:15:56.480 INFO:tasks.rados.rados.0.smithi154.stdout:223: oid 5 updating version 0 to 19 2024-09-17T18:15:56.480 INFO:tasks.rados.rados.0.smithi154.stdout:223: oid 5 version 19 is already newer than 18 2024-09-17T18:15:56.481 INFO:tasks.rados.rados.0.smithi154.stdout:223: oid 5 version 19 is already newer than 17 2024-09-17T18:15:56.481 INFO:tasks.rados.rados.0.smithi154.stdout:223: oid 5 updating version 19 to 20 2024-09-17T18:15:56.481 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 5 v 20 (ObjNum 99 snap 19 seq_num 99) dirty exists 2024-09-17T18:15:56.481 INFO:tasks.rados.rados.0.smithi154.stdout:223: left oid 5 (ObjNum 99 snap 19 seq_num 99) 2024-09-17T18:15:56.481 INFO:tasks.rados.rados.0.smithi154.stdout:224: finishing rollback tid 2 to smithi15432074-10 2024-09-17T18:15:56.481 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 10 v 186 (ObjNum 80 snap 11 seq_num 80) dirty exists 2024-09-17T18:15:56.497 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:56.498 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:56.512 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T18:15:56.566 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:56.563+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:56.662 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:15:56.662 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:15:56.667 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:56.667+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:56.670 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:56.670 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:56.686 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T18:15:56.775 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:56.774+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:56.850 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:56.850 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:56.865 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T18:15:56.869 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:56.867+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:56.970 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:56.969+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:56.998 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:56.998 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:57.012 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T18:15:57.021 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T18:15:57.021 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-17T18:15:57.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:57.067+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:57.135 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:57.136 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:57.151 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T18:15:57.191 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:57.191+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:57.273 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:15:57.271+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:15:57.312 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:57.312 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:57.326 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T18:15:57.373 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:57.369+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:57.380 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.0 to 1 (10000) 2024-09-17T18:15:57.380 INFO:teuthology.orchestra.run.smithi087.stderr:nodeep-scrub is unset 2024-09-17T18:15:57.384 INFO:tasks.rados.rados.0.smithi154.stdout:223: done (4 left) 2024-09-17T18:15:57.385 INFO:tasks.rados.rados.0.smithi154.stdout:224: done (3 left) 2024-09-17T18:15:57.385 INFO:tasks.rados.rados.0.smithi154.stdout:227: done (2 left) 2024-09-17T18:15:57.385 INFO:tasks.rados.rados.0.smithi154.stdout:228: read oid 39 snap -1 2024-09-17T18:15:57.385 INFO:tasks.rados.rados.0.smithi154.stdout:228: expect (ObjNum 83 snap 14 seq_num 83) 2024-09-17T18:15:57.385 INFO:tasks.rados.rados.0.smithi154.stdout:229: snap_create 2024-09-17T18:15:57.385 INFO:tasks.rados.rados.0.smithi154.stdout:225: finishing write tid 1 to smithi15432074-2 2024-09-17T18:15:57.385 INFO:tasks.rados.rados.0.smithi154.stdout:225: finishing write tid 2 to smithi15432074-2 2024-09-17T18:15:57.385 INFO:tasks.rados.rados.0.smithi154.stdout:225: finishing write tid 3 to smithi15432074-2 2024-09-17T18:15:57.385 INFO:tasks.rados.rados.0.smithi154.stdout:225: finishing write tid 4 to smithi15432074-2 2024-09-17T18:15:57.385 INFO:tasks.rados.rados.0.smithi154.stdout:225: finishing write tid 5 to smithi15432074-2 2024-09-17T18:15:57.385 INFO:tasks.rados.rados.0.smithi154.stdout:225: oid 2 updating version 0 to 190 2024-09-17T18:15:57.386 INFO:tasks.rados.rados.0.smithi154.stdout:225: oid 2 version 190 is already newer than 188 2024-09-17T18:15:57.386 INFO:tasks.rados.rados.0.smithi154.stdout:225: oid 2 updating version 190 to 191 2024-09-17T18:15:57.386 INFO:tasks.rados.rados.0.smithi154.stdout:225: oid 2 version 191 is already newer than 189 2024-09-17T18:15:57.386 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 2 v 191 (ObjNum 100 snap 19 seq_num 100) dirty exists 2024-09-17T18:15:57.386 INFO:tasks.rados.rados.0.smithi154.stdout:225: left oid 2 (ObjNum 100 snap 19 seq_num 100) 2024-09-17T18:15:57.386 INFO:tasks.rados.rados.0.smithi154.stdout:226: expect (ObjNum 7 snap 0 seq_num 7) 2024-09-17T18:15:57.386 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:57.387 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:57.391 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:57.408 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-17T18:15:57.428 INFO:tasks.rados.rados.0.smithi154.stdout:228: expect (ObjNum 83 snap 14 seq_num 83) 2024-09-17T18:15:57.428 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:57.469 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:57.469 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:57.474 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:57.469+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:57.483 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T18:15:57.545 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1580737 2024-09-17T18:15:57.575 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:57.575+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:57.579 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:15:57.602 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:57.602 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:57.616 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T18:15:57.676 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:57.674+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:57.736 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:57.736 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:57.750 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T18:15:57.795 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:57.795+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:57.871 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:57.871 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:57.877 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:57.875+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:57.885 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T18:15:57.978 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:15:57.975+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:15:58.048 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:58.049 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:58.063 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T18:15:58.079 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:15:58.078+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:15:58.179 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:58.179 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:58.180 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:15:58.177+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:15:58.194 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T18:15:58.281 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:15:58.279+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:15:58.305 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.1 to 1 (10000) 2024-09-17T18:15:58.311 INFO:tasks.rados.rados.0.smithi154.stdout:225: done (3 left) 2024-09-17T18:15:58.311 INFO:tasks.rados.rados.0.smithi154.stdout:226: done (2 left) 2024-09-17T18:15:58.311 INFO:tasks.rados.rados.0.smithi154.stdout:228: done (1 left) 2024-09-17T18:15:58.311 INFO:tasks.rados.rados.0.smithi154.stdout:229: done (0 left) 2024-09-17T18:15:58.311 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 50 current snap is 20 2024-09-17T18:15:58.311 INFO:tasks.rados.rados.0.smithi154.stdout:230: seq_num 101 ranges {2015232=540672,2555904=507904,3063808=622592,3686400=32768} 2024-09-17T18:15:58.322 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:58.322 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:58.332 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-17T18:15:58.336 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T18:15:58.353 INFO:tasks.rados.rados.0.smithi154.stdout:230: writing smithi15432074-50 from 2015232 to 2555904 tid 1 2024-09-17T18:15:58.362 INFO:tasks.rados.rados.0.smithi154.stdout:230: writing smithi15432074-50 from 2555904 to 3063808 tid 2 2024-09-17T18:15:58.371 INFO:tasks.rados.rados.0.smithi154.stdout:230: writing smithi15432074-50 from 3063808 to 3686400 tid 3 2024-09-17T18:15:58.371 INFO:tasks.rados.rados.0.smithi154.stdout:230: writing smithi15432074-50 from 3686400 to 3719168 tid 4 2024-09-17T18:15:58.372 INFO:tasks.rados.rados.0.smithi154.stdout:231: snap_remove snap 16 2024-09-17T18:15:58.381 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:58.377+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:58.454 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:58.454 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:58.468 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T18:15:58.482 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:58.478+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:58.583 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:15:58.583+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:15:58.593 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:58.593 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:58.607 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T18:15:58.684 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:58.682+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:58.685 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T18:15:58.739 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:15:58.740 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:15:58.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T18:15:58.785 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:58.783+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:58.835 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:15:58.835 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:15:58.856 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:15:58.857 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:15:58.877 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:15:58.877 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:58.877 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:58.877 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:15:58.877 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:15:58.877 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:58.878 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:15:58.886 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:15:58.882+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:15:58.891 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T18:15:58.898 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:15:58.898 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:15:58.915 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:15:58.916 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:15:58.936 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:15:58.937 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:15:58.954 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:15:58.954 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:15:58.975 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:15:58.975 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:15:58.986 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:15:58.981+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:15:58.993 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:15:58.993 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:15:59.015 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:15:59.015 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:15:59.019 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:59.019 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:15:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:15:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-17T18:15:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 42/31 ECSubWrite(tid=40, reqid=client.4565.0:363, at_version=42'26, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:15:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.767056+0000", 2024-09-17T18:15:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.248978612999998, 2024-09-17T18:15:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022714127000000001, 2024-09-17T18:15:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767056+0000", 2024-09-17T18:15:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767056+0000", 2024-09-17T18:15:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767057+0000", 2024-09-17T18:15:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4600000000000005e-07 2024-09-17T18:15:59.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767098+0000", 2024-09-17T18:15:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1013000000000002e-05 2024-09-17T18:15:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767126+0000", 2024-09-17T18:15:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8399e-05 2024-09-17T18:15:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767150+0000", 2024-09-17T18:15:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.393e-05 2024-09-17T18:15:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767397+0000", 2024-09-17T18:15:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00024644499999999998 2024-09-17T18:15:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767421+0000", 2024-09-17T18:15:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4643000000000001e-05 2024-09-17T18:15:59.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789658+0000", 2024-09-17T18:15:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022236949999999998 2024-09-17T18:15:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789770+0000", 2024-09-17T18:15:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011220100000000001 2024-09-17T18:15:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 42/31 ECSubWrite(tid=15, reqid=osd.3.0:14, at_version=0'0, trim_to=0'0, roll_forward_to=42'11))", 2024-09-17T18:15:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.772587+0000", 2024-09-17T18:15:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.243447474, 2024-09-17T18:15:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.014350889, 2024-09-17T18:15:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772587+0000", 2024-09-17T18:15:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772587+0000", 2024-09-17T18:15:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772590+0000", 2024-09-17T18:15:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.137e-06 2024-09-17T18:15:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772619+0000", 2024-09-17T18:15:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9615999999999999e-05 2024-09-17T18:15:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772662+0000", 2024-09-17T18:15:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3179000000000001e-05 2024-09-17T18:15:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772689+0000", 2024-09-17T18:15:59.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7123000000000001e-05 2024-09-17T18:15:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772889+0000", 2024-09-17T18:15:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019974000000000001 2024-09-17T18:15:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772914+0000", 2024-09-17T18:15:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4791999999999999e-05 2024-09-17T18:15:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.786833+0000", 2024-09-17T18:15:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013919030000000001 2024-09-17T18:15:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.786938+0000", 2024-09-17T18:15:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105272 2024-09-17T18:15:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 42/31 ECSubWrite(tid=41, reqid=osd.7.0:41, at_version=42'28, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:15:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.772597+0000", 2024-09-17T18:15:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.243438007000002, 2024-09-17T18:15:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017244046999999998, 2024-09-17T18:15:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772597+0000", 2024-09-17T18:15:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772597+0000", 2024-09-17T18:15:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772599+0000", 2024-09-17T18:15:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2960000000000001e-06 2024-09-17T18:15:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772652+0000", 2024-09-17T18:15:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2685999999999997e-05 2024-09-17T18:15:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772687+0000", 2024-09-17T18:15:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5026e-05 2024-09-17T18:15:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772711+0000", 2024-09-17T18:15:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3903000000000001e-05 2024-09-17T18:15:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772918+0000", 2024-09-17T18:15:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000207116 2024-09-17T18:15:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772941+0000", 2024-09-17T18:15:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2940000000000001e-05 2024-09-17T18:15:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789784+0000", 2024-09-17T18:15:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016843563999999998 2024-09-17T18:15:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789841+0000", 2024-09-17T18:15:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6515999999999999e-05 2024-09-17T18:15:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 42/31 ECSubWrite(tid=42, reqid=osd.7.0:42, at_version=42'30, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:15:59.034 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.776416+0000", 2024-09-17T18:15:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.239619115, 2024-09-17T18:15:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015784901, 2024-09-17T18:15:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776416+0000", 2024-09-17T18:15:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776416+0000", 2024-09-17T18:15:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776418+0000", 2024-09-17T18:15:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9190000000000002e-06 2024-09-17T18:15:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776502+0000", 2024-09-17T18:15:59.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4308999999999995e-05 2024-09-17T18:15:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776548+0000", 2024-09-17T18:15:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6192000000000001e-05 2024-09-17T18:15:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776739+0000", 2024-09-17T18:15:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019082999999999999 2024-09-17T18:15:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.037 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.780985+0000", 2024-09-17T18:15:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0042460909999999996 2024-09-17T18:15:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.781000+0000", 2024-09-17T18:15:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5213e-05 2024-09-17T18:15:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792098+0000", 2024-09-17T18:15:59.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011097325 2024-09-17T18:15:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792201+0000", 2024-09-17T18:15:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103022 2024-09-17T18:15:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.fs4 43/31 ECSubWrite(tid=182, reqid=osd.13.0:182, at_version=43'14, trim_to=0'0, roll_forward_to=42'12))", 2024-09-17T18:15:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.775836+0000", 2024-09-17T18:15:59.039 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.240198500999998, 2024-09-17T18:15:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0074634699999999998, 2024-09-17T18:15:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.775836+0000", 2024-09-17T18:15:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.775836+0000", 2024-09-17T18:15:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.775837+0000", 2024-09-17T18:15:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7700000000000004e-07 2024-09-17T18:15:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.775895+0000", 2024-09-17T18:15:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8195000000000001e-05 2024-09-17T18:15:59.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.775920+0000", 2024-09-17T18:15:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5282999999999998e-05 2024-09-17T18:15:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.775943+0000", 2024-09-17T18:15:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2836e-05 2024-09-17T18:15:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776110+0000", 2024-09-17T18:15:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016691300000000001 2024-09-17T18:15:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776140+0000", 2024-09-17T18:15:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0307e-05 2024-09-17T18:15:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.783188+0000", 2024-09-17T18:15:59.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0070471079999999998 2024-09-17T18:15:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.783300+0000", 2024-09-17T18:15:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011225100000000001 2024-09-17T18:15:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.3s5 43/31 ECSubWrite(tid=16, reqid=osd.10.0:16, at_version=43'10, trim_to=0'0, roll_forward_to=35'8))", 2024-09-17T18:15:59.044 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.778590+0000", 2024-09-17T18:15:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.237445104999999, 2024-09-17T18:15:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0073565480000000001, 2024-09-17T18:15:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.778590+0000", 2024-09-17T18:15:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.778590+0000", 2024-09-17T18:15:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.778591+0000", 2024-09-17T18:15:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999997e-07 2024-09-17T18:15:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.778736+0000", 2024-09-17T18:15:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014535399999999999 2024-09-17T18:15:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.778780+0000", 2024-09-17T18:15:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4419000000000003e-05 2024-09-17T18:15:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.778812+0000", 2024-09-17T18:15:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1405999999999997e-05 2024-09-17T18:15:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779020+0000", 2024-09-17T18:15:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020835299999999999 2024-09-17T18:15:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779046+0000", 2024-09-17T18:15:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5989000000000001e-05 2024-09-17T18:15:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.785852+0000", 2024-09-17T18:15:59.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0068063830000000001 2024-09-17T18:15:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.785946+0000", 2024-09-17T18:15:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3857999999999995e-05 2024-09-17T18:15:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s3 43/31 ECSubWrite(tid=20, reqid=osd.0.0:20, at_version=43'12, trim_to=0'0, roll_forward_to=35'10))", 2024-09-17T18:15:59.049 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.779224+0000", 2024-09-17T18:15:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.236810958, 2024-09-17T18:15:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0057440870000000002, 2024-09-17T18:15:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779224+0000", 2024-09-17T18:15:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779224+0000", 2024-09-17T18:15:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779225+0000", 2024-09-17T18:15:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1999999999999999e-07 2024-09-17T18:15:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779283+0000", 2024-09-17T18:15:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8282999999999997e-05 2024-09-17T18:15:59.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779311+0000", 2024-09-17T18:15:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8405e-05 2024-09-17T18:15:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779332+0000", 2024-09-17T18:15:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0754000000000002e-05 2024-09-17T18:15:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779502+0000", 2024-09-17T18:15:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000170073 2024-09-17T18:15:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779528+0000", 2024-09-17T18:15:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5463e-05 2024-09-17T18:15:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.784873+0000", 2024-09-17T18:15:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0053451369999999998 2024-09-17T18:15:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.784968+0000", 2024-09-17T18:15:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5352000000000005e-05 2024-09-17T18:15:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 43/31 ECSubWrite(tid=52, reqid=osd.7.0:51, at_version=0'0, trim_to=0'0, roll_forward_to=43'40))", 2024-09-17T18:15:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.828217+0000", 2024-09-17T18:15:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.187818246999999, 2024-09-17T18:15:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0041040319999999996, 2024-09-17T18:15:59.054 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.828217+0000", 2024-09-17T18:15:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.828217+0000", 2024-09-17T18:15:59.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.828226+0000", 2024-09-17T18:15:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9760000000000001e-06 2024-09-17T18:15:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.828273+0000", 2024-09-17T18:15:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7126000000000002e-05 2024-09-17T18:15:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.828306+0000", 2024-09-17T18:15:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3646000000000003e-05 2024-09-17T18:15:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.828329+0000", 2024-09-17T18:15:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2410000000000001e-05 2024-09-17T18:15:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.828495+0000", 2024-09-17T18:15:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016595499999999999 2024-09-17T18:15:59.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.828519+0000", 2024-09-17T18:15:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4457e-05 2024-09-17T18:15:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.832227+0000", 2024-09-17T18:15:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003708018 2024-09-17T18:15:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.832321+0000", 2024-09-17T18:15:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3443999999999995e-05 2024-09-17T18:15:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s3 43/31 ECSubWrite(tid=23, reqid=client.4565.0:368, at_version=43'15, trim_to=0'0, roll_forward_to=43'12))", 2024-09-17T18:15:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.992603+0000", 2024-09-17T18:15:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.023431835, 2024-09-17T18:15:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0039835909999999999, 2024-09-17T18:15:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.059 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.992603+0000", 2024-09-17T18:15:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.992603+0000", 2024-09-17T18:15:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.992605+0000", 2024-09-17T18:15:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.996e-06 2024-09-17T18:15:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.992654+0000", 2024-09-17T18:15:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8943000000000002e-05 2024-09-17T18:15:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.992687+0000", 2024-09-17T18:15:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2648999999999999e-05 2024-09-17T18:15:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.992709+0000", 2024-09-17T18:15:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1976000000000001e-05 2024-09-17T18:15:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.993053+0000", 2024-09-17T18:15:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00034431400000000002 2024-09-17T18:15:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.993077+0000", 2024-09-17T18:15:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4192000000000001e-05 2024-09-17T18:15:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.996492+0000", 2024-09-17T18:15:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003415076 2024-09-17T18:15:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.996587+0000", 2024-09-17T18:15:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4444999999999994e-05 2024-09-17T18:15:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s3 43/31 ECSubWrite(tid=24, reqid=client.4565.0:369, at_version=43'16, trim_to=0'0, roll_forward_to=43'12))", 2024-09-17T18:15:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.993409+0000", 2024-09-17T18:15:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.022625635000001, 2024-09-17T18:15:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056394619999999996, 2024-09-17T18:15:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.993409+0000", 2024-09-17T18:15:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.993409+0000", 2024-09-17T18:15:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.993412+0000", 2024-09-17T18:15:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3439999999999999e-06 2024-09-17T18:15:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.993453+0000", 2024-09-17T18:15:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1001999999999998e-05 2024-09-17T18:15:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.993483+0000", 2024-09-17T18:15:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0406e-05 2024-09-17T18:15:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.993504+0000", 2024-09-17T18:15:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1447e-05 2024-09-17T18:15:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.993760+0000", 2024-09-17T18:15:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000255791 2024-09-17T18:15:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.993783+0000", 2024-09-17T18:15:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2629999999999998e-05 2024-09-17T18:15:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.998956+0000", 2024-09-17T18:15:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.005173558 2024-09-17T18:15:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.999049+0000", 2024-09-17T18:15:59.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2283999999999999e-05 2024-09-17T18:15:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s3 43/31 ECSubWrite(tid=26, reqid=client.4565.0:375, at_version=43'18, trim_to=0'0, roll_forward_to=43'16))", 2024-09-17T18:15:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:39.065757+0000", 2024-09-17T18:15:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 19.950278073, 2024-09-17T18:15:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003843712, 2024-09-17T18:15:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.069 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.065757+0000", 2024-09-17T18:15:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.065757+0000", 2024-09-17T18:15:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.065765+0000", 2024-09-17T18:15:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1130000000000001e-06 2024-09-17T18:15:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.066433+0000", 2024-09-17T18:15:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00066775199999999997 2024-09-17T18:15:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.066464+0000", 2024-09-17T18:15:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1751999999999997e-05 2024-09-17T18:15:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.066480+0000", 2024-09-17T18:15:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5463000000000001e-05 2024-09-17T18:15:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.066637+0000", 2024-09-17T18:15:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015667400000000001 2024-09-17T18:15:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.066668+0000", 2024-09-17T18:15:59.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1489000000000003e-05 2024-09-17T18:15:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.069503+0000", 2024-09-17T18:15:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028348539999999999 2024-09-17T18:15:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.069601+0000", 2024-09-17T18:15:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7615000000000006e-05 2024-09-17T18:15:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.073 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s3 43/31 ECSubWrite(tid=28, reqid=client.4565.0:376, at_version=43'19, trim_to=0'0, roll_forward_to=43'18))", 2024-09-17T18:15:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:39.073054+0000", 2024-09-17T18:15:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 19.942980756000001, 2024-09-17T18:15:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0049026219999999997, 2024-09-17T18:15:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.073054+0000", 2024-09-17T18:15:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.073054+0000", 2024-09-17T18:15:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.073056+0000", 2024-09-17T18:15:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9640000000000002e-06 2024-09-17T18:15:59.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.073371+0000", 2024-09-17T18:15:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00031488700000000002 2024-09-17T18:15:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.073409+0000", 2024-09-17T18:15:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8139000000000002e-05 2024-09-17T18:15:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.073429+0000", 2024-09-17T18:15:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.031e-05 2024-09-17T18:15:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.073543+0000", 2024-09-17T18:15:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000113168 2024-09-17T18:15:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.073557+0000", 2024-09-17T18:15:59.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4525999999999999e-05 2024-09-17T18:15:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.077883+0000", 2024-09-17T18:15:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0043259459999999998 2024-09-17T18:15:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.077957+0000", 2024-09-17T18:15:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3682000000000004e-05 2024-09-17T18:15:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.078 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s3 43/31 ECSubWrite(tid=29, reqid=client.4565.0:377, at_version=43'20, trim_to=0'0, roll_forward_to=43'18))", 2024-09-17T18:15:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:39.075536+0000", 2024-09-17T18:15:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 19.940498729000002, 2024-09-17T18:15:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0051886659999999998, 2024-09-17T18:15:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.075536+0000", 2024-09-17T18:15:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.075536+0000", 2024-09-17T18:15:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.075538+0000", 2024-09-17T18:15:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.973e-06 2024-09-17T18:15:59.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.075594+0000", 2024-09-17T18:15:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6016e-05 2024-09-17T18:15:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.075626+0000", 2024-09-17T18:15:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2058999999999999e-05 2024-09-17T18:15:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.075641+0000", 2024-09-17T18:15:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5163e-05 2024-09-17T18:15:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.075785+0000", 2024-09-17T18:15:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014359400000000001 2024-09-17T18:15:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.075800+0000", 2024-09-17T18:15:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4816e-05 2024-09-17T18:15:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.080631+0000", 2024-09-17T18:15:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0048315800000000002 2024-09-17T18:15:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.080725+0000", 2024-09-17T18:15:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3465e-05 2024-09-17T18:15:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s3 43/31 ECSubWrite(tid=30, reqid=client.4565.0:378, at_version=43'21, trim_to=0'0, roll_forward_to=43'18))", 2024-09-17T18:15:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:39.077799+0000", 2024-09-17T18:15:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 19.938236041, 2024-09-17T18:15:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038134710000000001, 2024-09-17T18:15:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.077799+0000", 2024-09-17T18:15:59.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.077799+0000", 2024-09-17T18:15:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.077801+0000", 2024-09-17T18:15:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.046e-06 2024-09-17T18:15:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.077844+0000", 2024-09-17T18:15:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2923000000000002e-05 2024-09-17T18:15:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.077875+0000", 2024-09-17T18:15:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1009000000000001e-05 2024-09-17T18:15:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.077897+0000", 2024-09-17T18:15:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1742999999999998e-05 2024-09-17T18:15:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.078050+0000", 2024-09-17T18:15:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015380400000000001 2024-09-17T18:15:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.078074+0000", 2024-09-17T18:15:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.366e-05 2024-09-17T18:15:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.081514+0000", 2024-09-17T18:15:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003439845 2024-09-17T18:15:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:39.081612+0000", 2024-09-17T18:15:59.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.8441000000000002e-05 2024-09-17T18:15:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.3s5 53/31 ECSubWrite(tid=18, reqid=client.4565.0:453, at_version=53'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T18:15:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:48.337099+0000", 2024-09-17T18:15:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.678935674, 2024-09-17T18:15:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0058525110000000003, 2024-09-17T18:15:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:48.337099+0000", 2024-09-17T18:15:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:48.337099+0000", 2024-09-17T18:15:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:48.337100+0000", 2024-09-17T18:15:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7299999999999995e-07 2024-09-17T18:15:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:48.337439+0000", 2024-09-17T18:15:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033894799999999999 2024-09-17T18:15:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:48.337472+0000", 2024-09-17T18:15:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3379e-05 2024-09-17T18:15:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.091 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:48.337501+0000", 2024-09-17T18:15:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9184e-05 2024-09-17T18:15:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:48.337688+0000", 2024-09-17T18:15:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018629000000000001 2024-09-17T18:15:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:48.337716+0000", 2024-09-17T18:15:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8195999999999999e-05 2024-09-17T18:15:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:48.342853+0000", 2024-09-17T18:15:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0051366390000000001 2024-09-17T18:15:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:48.342952+0000", 2024-09-17T18:15:59.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9202000000000003e-05 2024-09-17T18:15:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.3s5 54/31 ECSubWrite(tid=24, reqid=osd.10.0:24, at_version=54'17, trim_to=0'0, roll_forward_to=53'15))", 2024-09-17T18:15:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.328294+0000", 2024-09-17T18:15:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6877413400000005, 2024-09-17T18:15:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0064417060000000002, 2024-09-17T18:15:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.094 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328294+0000", 2024-09-17T18:15:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328294+0000", 2024-09-17T18:15:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328294+0000", 2024-09-17T18:15:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8999999999999996e-07 2024-09-17T18:15:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328349+0000", 2024-09-17T18:15:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4812999999999998e-05 2024-09-17T18:15:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.096 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328380+0000", 2024-09-17T18:15:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1343000000000001e-05 2024-09-17T18:15:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328404+0000", 2024-09-17T18:15:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4059000000000001e-05 2024-09-17T18:15:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328553+0000", 2024-09-17T18:15:59.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000148744 2024-09-17T18:15:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328599+0000", 2024-09-17T18:15:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6020000000000003e-05 2024-09-17T18:15:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.334611+0000", 2024-09-17T18:15:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0060116650000000002 2024-09-17T18:15:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.334735+0000", 2024-09-17T18:15:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012437200000000001 2024-09-17T18:15:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpRead(3.9s1 54/31 ECSubRead(tid=76, to_read={3:91028b13:::smithi15432074-34:head=0,118784,0}, subchunks={3:91028b13:::smithi15432074-34:head=[0,1]}, attrs_to_read=))", 2024-09-17T18:15:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.331040+0000", 2024-09-17T18:15:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6849947360000002, 2024-09-17T18:15:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003744594, 2024-09-17T18:15:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.331040+0000", 2024-09-17T18:15:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.331040+0000", 2024-09-17T18:15:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.331041+0000", 2024-09-17T18:15:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5300000000000004e-07 2024-09-17T18:15:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.331055+0000", 2024-09-17T18:15:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4620000000000001e-05 2024-09-17T18:15:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.331091+0000", 2024-09-17T18:15:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5822999999999999e-05 2024-09-17T18:15:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.331121+0000", 2024-09-17T18:15:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9258999999999999e-05 2024-09-17T18:15:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.331371+0000", 2024-09-17T18:15:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00025077999999999998 2024-09-17T18:15:59.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.334785+0000", 2024-09-17T18:15:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034134590000000002 2024-09-17T18:15:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 54/31 ECSubWrite(tid=77, reqid=osd.7.0:77, at_version=54'65, trim_to=0'0, roll_forward_to=53'63))", 2024-09-17T18:15:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.337508+0000", 2024-09-17T18:15:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6785265510000009, 2024-09-17T18:15:59.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0041462210000000003, 2024-09-17T18:15:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.337508+0000", 2024-09-17T18:15:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.337508+0000", 2024-09-17T18:15:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.337511+0000", 2024-09-17T18:15:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1629999999999999e-06 2024-09-17T18:15:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.337571+0000", 2024-09-17T18:15:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0089e-05 2024-09-17T18:15:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.337643+0000", 2024-09-17T18:15:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2259000000000001e-05 2024-09-17T18:15:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.337666+0000", 2024-09-17T18:15:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3082999999999999e-05 2024-09-17T18:15:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.337879+0000", 2024-09-17T18:15:59.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000213477 2024-09-17T18:15:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.337905+0000", 2024-09-17T18:15:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5772999999999999e-05 2024-09-17T18:15:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.341529+0000", 2024-09-17T18:15:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0036239929999999998 2024-09-17T18:15:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.341655+0000", 2024-09-17T18:15:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000125384 2024-09-17T18:15:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 54/31 ECSubWrite(tid=78, reqid=osd.7.0:78, at_version=54'67, trim_to=0'0, roll_forward_to=53'63))", 2024-09-17T18:15:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.342789+0000", 2024-09-17T18:15:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6732458070000007, 2024-09-17T18:15:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037636869999999999, 2024-09-17T18:15:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.108 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.342789+0000", 2024-09-17T18:15:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.342789+0000", 2024-09-17T18:15:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.342791+0000", 2024-09-17T18:15:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8059999999999999e-06 2024-09-17T18:15:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.342836+0000", 2024-09-17T18:15:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5442999999999998e-05 2024-09-17T18:15:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.342860+0000", 2024-09-17T18:15:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4036000000000002e-05 2024-09-17T18:15:59.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.342878+0000", 2024-09-17T18:15:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7183000000000001e-05 2024-09-17T18:15:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.343046+0000", 2024-09-17T18:15:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016821100000000001 2024-09-17T18:15:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.343070+0000", 2024-09-17T18:15:59.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4403e-05 2024-09-17T18:15:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.346493+0000", 2024-09-17T18:15:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034225990000000001 2024-09-17T18:15:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.346553+0000", 2024-09-17T18:15:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0006000000000001e-05 2024-09-17T18:15:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.112 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 54/31 ECSubWrite(tid=79, reqid=osd.7.0:78, at_version=0'0, trim_to=0'0, roll_forward_to=54'67))", 2024-09-17T18:15:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.350597+0000", 2024-09-17T18:15:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 9.6654376979999999, 2024-09-17T18:15:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0039562679999999998, 2024-09-17T18:15:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:15:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.350597+0000", 2024-09-17T18:15:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.350597+0000", 2024-09-17T18:15:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.350599+0000", 2024-09-17T18:15:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.114e-06 2024-09-17T18:15:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.350624+0000", 2024-09-17T18:15:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4530000000000001e-05 2024-09-17T18:15:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.350661+0000", 2024-09-17T18:15:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7472000000000003e-05 2024-09-17T18:15:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.350686+0000", 2024-09-17T18:15:59.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5077000000000001e-05 2024-09-17T18:15:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.350882+0000", 2024-09-17T18:15:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019569300000000001 2024-09-17T18:15:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.350908+0000", 2024-09-17T18:15:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5545999999999999e-05 2024-09-17T18:15:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.354460+0000", 2024-09-17T18:15:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.003552585 2024-09-17T18:15:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.354553+0000", 2024-09-17T18:15:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3251000000000006e-05 2024-09-17T18:15:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.117 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.117 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:59.118 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:15:59.119 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:15:59.119 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:15:59.120 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:15:59.120 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T18:15:59.121 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:15:59.121 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:15:59.121 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:15:59.122 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:15:59.122 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:15:59.118+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:15:59.122 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:15:59.122 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:15:59.142 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:15:59.143 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:15:59.220 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:15:59.217+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:15:59.250 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:59.250 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:59.250 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:15:59.250 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:59.264 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T18:15:59.309 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.2 to 1 (10000) 2024-09-17T18:15:59.314 INFO:tasks.rados.rados.0.smithi154.stdout:231: done (1 left) 2024-09-17T18:15:59.314 INFO:tasks.rados.rados.0.smithi154.stdout:232: delete oid 5 current snap is 20 2024-09-17T18:15:59.314 INFO:tasks.rados.rados.0.smithi154.stdout:230: finishing write tid 1 to smithi15432074-50 2024-09-17T18:15:59.314 INFO:tasks.rados.rados.0.smithi154.stdout:230: finishing write tid 2 to smithi15432074-50 2024-09-17T18:15:59.314 INFO:tasks.rados.rados.0.smithi154.stdout:230: finishing write tid 3 to smithi15432074-50 2024-09-17T18:15:59.314 INFO:tasks.rados.rados.0.smithi154.stdout:230: finishing write tid 4 to smithi15432074-50 2024-09-17T18:15:59.314 INFO:tasks.rados.rados.0.smithi154.stdout:230: finishing write tid 5 to smithi15432074-50 2024-09-17T18:15:59.314 INFO:tasks.rados.rados.0.smithi154.stdout:230: finishing write tid 6 to smithi15432074-50 2024-09-17T18:15:59.314 INFO:tasks.rados.rados.0.smithi154.stdout:230: oid 50 updating version 0 to 18 2024-09-17T18:15:59.314 INFO:tasks.rados.rados.0.smithi154.stdout:230: oid 50 updating version 18 to 21 2024-09-17T18:15:59.314 INFO:tasks.rados.rados.0.smithi154.stdout:230: oid 50 version 21 is already newer than 20 2024-09-17T18:15:59.314 INFO:tasks.rados.rados.0.smithi154.stdout:230: oid 50 version 21 is already newer than 19 2024-09-17T18:15:59.315 INFO:tasks.rados.rados.0.smithi154.stdout:230: oid 50 version 21 is already newer than 17 2024-09-17T18:15:59.315 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 50 v 21 (ObjNum 101 snap 20 seq_num 101) dirty exists 2024-09-17T18:15:59.315 INFO:tasks.rados.rados.0.smithi154.stdout:230: left oid 50 (ObjNum 101 snap 20 seq_num 101) 2024-09-17T18:15:59.322 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:59.318+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:59.335 INFO:tasks.rados.rados.0.smithi154.stdout:230: done (1 left) 2024-09-17T18:15:59.335 INFO:tasks.rados.rados.0.smithi154.stdout:232: done (0 left) 2024-09-17T18:15:59.335 INFO:tasks.rados.rados.0.smithi154.stdout:233: copy_from oid 26 from oid 44 current snap is 20 2024-09-17T18:15:59.335 INFO:tasks.rados.rados.0.smithi154.stdout:234: snap_remove snap 11 2024-09-17T18:15:59.338 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-17T18:15:59.386 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:59.386 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:59.386 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:15:59.387 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:15:59.387 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:59.400 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T18:15:59.410 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T18:15:59.421 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:59.417+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:59.522 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:15:59.517+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:15:59.525 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:59.525 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:15:59.525 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:15:59.525 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-17T18:15:59.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.525 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:59.525 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:13.571510+0000", 2024-09-17T18:15:59.526 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 45.951980110000001, 2024-09-17T18:15:59.526 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.35549906399999998, 2024-09-17T18:15:59.526 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.526 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.526 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.526 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.526 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:59.526 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:59.526 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 1 2024-09-17T18:15:59.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.526 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.526 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571510+0000", 2024-09-17T18:15:59.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571510+0000", 2024-09-17T18:15:59.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.527 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.527 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571513+0000", 2024-09-17T18:15:59.527 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5900000000000002e-06 2024-09-17T18:15:59.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571526+0000", 2024-09-17T18:15:59.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3106e-05 2024-09-17T18:15:59.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571548+0000", 2024-09-17T18:15:59.528 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1832999999999999e-05 2024-09-17T18:15:59.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.528 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.528 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571568+0000", 2024-09-17T18:15:59.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0446e-05 2024-09-17T18:15:59.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571715+0000", 2024-09-17T18:15:59.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000146475 2024-09-17T18:15:59.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.529 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-17T18:15:59.529 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571741+0000", 2024-09-17T18:15:59.529 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6009000000000001e-05 2024-09-17T18:15:59.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.922992+0000", 2024-09-17T18:15:59.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.35125145800000002 2024-09-17T18:15:59.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.923283+0000", 2024-09-17T18:15:59.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00029046999999999998 2024-09-17T18:15:59.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.530 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.530 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:59.530 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.923607+0000", 2024-09-17T18:15:59.530 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00032395200000000002 2024-09-17T18:15:59.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.531 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:59.531 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.924798+0000", 2024-09-17T18:15:59.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011917329999999999 2024-09-17T18:15:59.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.531 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:59.531 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.926847+0000", 2024-09-17T18:15:59.531 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020485009999999999 2024-09-17T18:15:59.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.531 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.531 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.926945+0000", 2024-09-17T18:15:59.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7750000000000004e-05 2024-09-17T18:15:59.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.532 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.532 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.927009+0000", 2024-09-17T18:15:59.532 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4740999999999996e-05 2024-09-17T18:15:59.532 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.532 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.532 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.532 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.532 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:59.532 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073054+0000", 2024-09-17T18:15:59.533 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 45.450436523, 2024-09-17T18:15:59.533 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017781126000000001, 2024-09-17T18:15:59.533 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.533 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.533 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.533 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.533 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:59.533 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:59.533 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 47 2024-09-17T18:15:59.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.533 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.533 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.533 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073054+0000", 2024-09-17T18:15:59.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073054+0000", 2024-09-17T18:15:59.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.534 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.534 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073055+0000", 2024-09-17T18:15:59.534 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4700000000000001e-07 2024-09-17T18:15:59.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.534 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073138+0000", 2024-09-17T18:15:59.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3607000000000001e-05 2024-09-17T18:15:59.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073153+0000", 2024-09-17T18:15:59.535 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4969e-05 2024-09-17T18:15:59.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.535 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.535 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.535 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073161+0000", 2024-09-17T18:15:59.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6000000000000001e-06 2024-09-17T18:15:59.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.084558+0000", 2024-09-17T18:15:59.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011397457999999999 2024-09-17T18:15:59.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.536 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.536 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.084732+0000", 2024-09-17T18:15:59.536 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000173401 2024-09-17T18:15:59.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.536 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:59.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.084940+0000", 2024-09-17T18:15:59.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020803400000000001 2024-09-17T18:15:59.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:59.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090671+0000", 2024-09-17T18:15:59.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0057309450000000003 2024-09-17T18:15:59.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.537 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.537 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:59.537 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090695+0000", 2024-09-17T18:15:59.537 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3932000000000001e-05 2024-09-17T18:15:59.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090771+0000", 2024-09-17T18:15:59.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6014999999999996e-05 2024-09-17T18:15:59.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.538 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.538 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090835+0000", 2024-09-17T18:15:59.538 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4418000000000006e-05 2024-09-17T18:15:59.538 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.538 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.538 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.538 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.539 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:59.539 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073198+0000", 2024-09-17T18:15:59.539 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 45.450292300999998, 2024-09-17T18:15:59.539 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018005944999999999, 2024-09-17T18:15:59.539 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.539 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.539 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.539 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.539 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:59.539 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:59.539 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 48 2024-09-17T18:15:59.539 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.539 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073198+0000", 2024-09-17T18:15:59.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.540 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073198+0000", 2024-09-17T18:15:59.540 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.540 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.540 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.540 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073199+0000", 2024-09-17T18:15:59.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7599999999999996e-07 2024-09-17T18:15:59.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073205+0000", 2024-09-17T18:15:59.541 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2840000000000003e-06 2024-09-17T18:15:59.541 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.541 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.541 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.541 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073221+0000", 2024-09-17T18:15:59.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5498999999999998e-05 2024-09-17T18:15:59.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073246+0000", 2024-09-17T18:15:59.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4793000000000001e-05 2024-09-17T18:15:59.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.542 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.085863+0000", 2024-09-17T18:15:59.542 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012617033 2024-09-17T18:15:59.542 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.542 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.542 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.085983+0000", 2024-09-17T18:15:59.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012071299999999999 2024-09-17T18:15:59.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:59.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.086174+0000", 2024-09-17T18:15:59.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000190457 2024-09-17T18:15:59.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.543 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.543 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:59.543 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090925+0000", 2024-09-17T18:15:59.543 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047513659999999999 2024-09-17T18:15:59.543 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:59.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091032+0000", 2024-09-17T18:15:59.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106933 2024-09-17T18:15:59.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091143+0000", 2024-09-17T18:15:59.544 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111197 2024-09-17T18:15:59.544 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.544 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.544 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.544 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091204+0000", 2024-09-17T18:15:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0794000000000001e-05 2024-09-17T18:15:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073262+0000", 2024-09-17T18:15:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 45.450228813000003, 2024-09-17T18:15:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018090469000000001, 2024-09-17T18:15:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.546 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:59.546 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:59.546 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 49 2024-09-17T18:15:59.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.546 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.546 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.546 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073262+0000", 2024-09-17T18:15:59.546 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.546 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.546 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.546 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.546 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073262+0000", 2024-09-17T18:15:59.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073263+0000", 2024-09-17T18:15:59.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0160000000000001e-06 2024-09-17T18:15:59.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.547 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073269+0000", 2024-09-17T18:15:59.547 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0039999999999996e-06 2024-09-17T18:15:59.547 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.547 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.547 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073283+0000", 2024-09-17T18:15:59.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4559000000000001e-05 2024-09-17T18:15:59.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073291+0000", 2024-09-17T18:15:59.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7200000000000006e-06 2024-09-17T18:15:59.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.548 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.548 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.548 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.087142+0000", 2024-09-17T18:15:59.548 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013850987 2024-09-17T18:15:59.548 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.087298+0000", 2024-09-17T18:15:59.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015572900000000001 2024-09-17T18:15:59.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:59.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.087485+0000", 2024-09-17T18:15:59.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018764399999999999 2024-09-17T18:15:59.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.549 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.549 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:59.549 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091014+0000", 2024-09-17T18:15:59.549 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035285780000000001 2024-09-17T18:15:59.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:59.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091217+0000", 2024-09-17T18:15:59.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020357 2024-09-17T18:15:59.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091302+0000", 2024-09-17T18:15:59.550 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4614e-05 2024-09-17T18:15:59.550 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.550 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.550 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.550 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091352+0000", 2024-09-17T18:15:59.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0047999999999999e-05 2024-09-17T18:15:59.551 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.551 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.551 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.551 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.551 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.551 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:59.551 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073303+0000", 2024-09-17T18:15:59.551 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 45.450187530999997, 2024-09-17T18:15:59.551 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.020201742000000002, 2024-09-17T18:15:59.551 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.551 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.551 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.552 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.552 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:59.552 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:59.552 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 50 2024-09-17T18:15:59.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.552 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073303+0000", 2024-09-17T18:15:59.552 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.552 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.552 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.552 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.552 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073303+0000", 2024-09-17T18:15:59.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073304+0000", 2024-09-17T18:15:59.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1699999999999997e-07 2024-09-17T18:15:59.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.553 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.553 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073388+0000", 2024-09-17T18:15:59.553 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4222999999999996e-05 2024-09-17T18:15:59.553 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.553 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073403+0000", 2024-09-17T18:15:59.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.488e-05 2024-09-17T18:15:59.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073411+0000", 2024-09-17T18:15:59.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0660000000000004e-06 2024-09-17T18:15:59.554 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.554 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.554 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.554 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.089184+0000", 2024-09-17T18:15:59.554 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015773646999999998 2024-09-17T18:15:59.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.555 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.555 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.089309+0000", 2024-09-17T18:15:59.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000124809 2024-09-17T18:15:59.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.555 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:59.555 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.089514+0000", 2024-09-17T18:15:59.555 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000204871 2024-09-17T18:15:59.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.555 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.555 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:59.555 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093318+0000", 2024-09-17T18:15:59.556 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038034050000000002 2024-09-17T18:15:59.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:59.556 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093337+0000", 2024-09-17T18:15:59.556 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9839000000000001e-05 2024-09-17T18:15:59.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.556 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.556 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093412+0000", 2024-09-17T18:15:59.556 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5012000000000006e-05 2024-09-17T18:15:59.556 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.556 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.557 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.557 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093505+0000", 2024-09-17T18:15:59.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2273000000000002e-05 2024-09-17T18:15:59.557 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.557 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.557 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.557 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.557 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:59.557 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:15:59.557 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 45.450064885000003, 2024-09-17T18:15:59.557 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.020790197, 2024-09-17T18:15:59.557 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.558 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.558 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.558 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.558 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:59.558 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:59.558 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 51 2024-09-17T18:15:59.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.558 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.558 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.558 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.558 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:15:59.558 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.558 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:15:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:15:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5000000000000001e-07 2024-09-17T18:15:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073432+0000", 2024-09-17T18:15:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7030000000000003e-06 2024-09-17T18:15:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073445+0000", 2024-09-17T18:15:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.239e-05 2024-09-17T18:15:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073452+0000", 2024-09-17T18:15:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8460000000000008e-06 2024-09-17T18:15:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091415+0000", 2024-09-17T18:15:59.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017962982999999998 2024-09-17T18:15:59.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091545+0000", 2024-09-17T18:15:59.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013008599999999999 2024-09-17T18:15:59.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:59.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091736+0000", 2024-09-17T18:15:59.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019030100000000001 2024-09-17T18:15:59.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:59.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093524+0000", 2024-09-17T18:15:59.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017882060000000001 2024-09-17T18:15:59.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:59.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094070+0000", 2024-09-17T18:15:59.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00054624999999999997 2024-09-17T18:15:59.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.562 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.562 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.562 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094156+0000", 2024-09-17T18:15:59.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5446999999999997e-05 2024-09-17T18:15:59.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.563 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.563 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094216+0000", 2024-09-17T18:15:59.563 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0134999999999999e-05 2024-09-17T18:15:59.563 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.563 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.563 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.563 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.563 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:59.563 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073465+0000", 2024-09-17T18:15:59.563 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 45.450025549000003, 2024-09-17T18:15:59.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021176878, 2024-09-17T18:15:59.564 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.564 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.564 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.564 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.564 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:59.564 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:59.564 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 52 2024-09-17T18:15:59.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.564 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073465+0000", 2024-09-17T18:15:59.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073465+0000", 2024-09-17T18:15:59.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073466+0000", 2024-09-17T18:15:59.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3e-07 2024-09-17T18:15:59.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073472+0000", 2024-09-17T18:15:59.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0519999999999998e-06 2024-09-17T18:15:59.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073483+0000", 2024-09-17T18:15:59.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1586999999999999e-05 2024-09-17T18:15:59.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.566 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073490+0000", 2024-09-17T18:15:59.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8229999999999997e-06 2024-09-17T18:15:59.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.567 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.567 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.092415+0000", 2024-09-17T18:15:59.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018924926000000002 2024-09-17T18:15:59.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.567 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.567 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.092535+0000", 2024-09-17T18:15:59.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012039 2024-09-17T18:15:59.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.567 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:59.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.092739+0000", 2024-09-17T18:15:59.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000203926 2024-09-17T18:15:59.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:59.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094258+0000", 2024-09-17T18:15:59.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015184689999999999 2024-09-17T18:15:59.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:59.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094513+0000", 2024-09-17T18:15:59.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00025523199999999998 2024-09-17T18:15:59.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094590+0000", 2024-09-17T18:15:59.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6743999999999996e-05 2024-09-17T18:15:59.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094642+0000", 2024-09-17T18:15:59.570 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1999000000000001e-05 2024-09-17T18:15:59.570 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.570 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.570 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.570 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:59.570 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180912+0000", 2024-09-17T18:15:59.570 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 45.342578518000003, 2024-09-17T18:15:59.570 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017495620999999999, 2024-09-17T18:15:59.570 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.570 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.570 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.570 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.571 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:59.571 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:59.571 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 73 2024-09-17T18:15:59.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.571 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180912+0000", 2024-09-17T18:15:59.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180912+0000", 2024-09-17T18:15:59.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.572 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.572 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.572 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180913+0000", 2024-09-17T18:15:59.572 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0529999999999999e-06 2024-09-17T18:15:59.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.572 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.572 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.572 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180920+0000", 2024-09-17T18:15:59.572 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8369999999999999e-06 2024-09-17T18:15:59.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.572 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.572 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180929+0000", 2024-09-17T18:15:59.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3659999999999998e-06 2024-09-17T18:15:59.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180936+0000", 2024-09-17T18:15:59.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9659999999999999e-06 2024-09-17T18:15:59.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.191317+0000", 2024-09-17T18:15:59.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010380545 2024-09-17T18:15:59.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.191435+0000", 2024-09-17T18:15:59.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118746 2024-09-17T18:15:59.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:59.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.191616+0000", 2024-09-17T18:15:59.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018002799999999999 2024-09-17T18:15:59.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:59.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.197244+0000", 2024-09-17T18:15:59.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056280940000000002 2024-09-17T18:15:59.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.575 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:59.575 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198243+0000", 2024-09-17T18:15:59.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00099925500000000011 2024-09-17T18:15:59.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.575 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.575 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198336+0000", 2024-09-17T18:15:59.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3447000000000002e-05 2024-09-17T18:15:59.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.575 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198408+0000", 2024-09-17T18:15:59.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1284000000000004e-05 2024-09-17T18:15:59.576 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.576 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.576 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.576 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.576 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.576 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:59.576 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180948+0000", 2024-09-17T18:15:59.576 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 45.342542166000001, 2024-09-17T18:15:59.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017711738000000001, 2024-09-17T18:15:59.576 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.576 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.577 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.577 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.577 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:59.577 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:59.577 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 74 2024-09-17T18:15:59.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.577 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.577 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.577 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180948+0000", 2024-09-17T18:15:59.577 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.578 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.578 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180948+0000", 2024-09-17T18:15:59.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.578 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.578 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.578 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180949+0000", 2024-09-17T18:15:59.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9000000000000005e-07 2024-09-17T18:15:59.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.578 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.578 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.578 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180955+0000", 2024-09-17T18:15:59.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3900000000000001e-06 2024-09-17T18:15:59.578 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180964+0000", 2024-09-17T18:15:59.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0559999999999994e-06 2024-09-17T18:15:59.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180970+0000", 2024-09-17T18:15:59.579 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-17T18:15:59.579 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.192795+0000", 2024-09-17T18:15:59.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011825057999999999 2024-09-17T18:15:59.580 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.580 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.580 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193035+0000", 2024-09-17T18:15:59.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00023942000000000001 2024-09-17T18:15:59.580 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.580 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:59.580 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193232+0000", 2024-09-17T18:15:59.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000197383 2024-09-17T18:15:59.580 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.580 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:59.581 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.197434+0000", 2024-09-17T18:15:59.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0042018029999999996 2024-09-17T18:15:59.581 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.581 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:59.581 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198506+0000", 2024-09-17T18:15:59.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0010720860000000001 2024-09-17T18:15:59.581 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.581 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.581 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198595+0000", 2024-09-17T18:15:59.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8710999999999998e-05 2024-09-17T18:15:59.581 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198660+0000", 2024-09-17T18:15:59.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5251000000000003e-05 2024-09-17T18:15:59.582 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.582 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.582 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.582 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:59.582 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180982+0000", 2024-09-17T18:15:59.582 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 45.342508487000003, 2024-09-17T18:15:59.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0204972, 2024-09-17T18:15:59.582 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.582 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.583 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.583 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.583 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:59.583 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:59.583 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 75 2024-09-17T18:15:59.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.583 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180982+0000", 2024-09-17T18:15:59.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180982+0000", 2024-09-17T18:15:59.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180983+0000", 2024-09-17T18:15:59.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8700000000000005e-07 2024-09-17T18:15:59.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181111+0000", 2024-09-17T18:15:59.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012798200000000001 2024-09-17T18:15:59.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.585 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.585 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.585 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181123+0000", 2024-09-17T18:15:59.585 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2283000000000001e-05 2024-09-17T18:15:59.585 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.585 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.585 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.585 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181133+0000", 2024-09-17T18:15:59.585 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.028e-05 2024-09-17T18:15:59.585 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.585 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.585 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.585 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193832+0000", 2024-09-17T18:15:59.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012698276999999999 2024-09-17T18:15:59.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193952+0000", 2024-09-17T18:15:59.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012077 2024-09-17T18:15:59.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:59.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.194141+0000", 2024-09-17T18:15:59.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018815100000000001 2024-09-17T18:15:59.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:59.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.199915+0000", 2024-09-17T18:15:59.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0057741190000000003 2024-09-17T18:15:59.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:59.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201326+0000", 2024-09-17T18:15:59.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001411463 2024-09-17T18:15:59.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201410+0000", 2024-09-17T18:15:59.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4166999999999996e-05 2024-09-17T18:15:59.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201479+0000", 2024-09-17T18:15:59.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8921e-05 2024-09-17T18:15:59.588 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.588 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.588 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.588 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:59.588 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.181149+0000", 2024-09-17T18:15:59.588 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 45.342341525999998, 2024-09-17T18:15:59.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.02060089, 2024-09-17T18:15:59.589 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.589 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.589 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.589 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.589 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:59.589 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:59.589 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 76 2024-09-17T18:15:59.589 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.589 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.589 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.589 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.589 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181149+0000", 2024-09-17T18:15:59.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.590 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181149+0000", 2024-09-17T18:15:59.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.590 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181150+0000", 2024-09-17T18:15:59.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3399999999999997e-07 2024-09-17T18:15:59.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181157+0000", 2024-09-17T18:15:59.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.379e-06 2024-09-17T18:15:59.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181166+0000", 2024-09-17T18:15:59.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0869999999999996e-06 2024-09-17T18:15:59.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181173+0000", 2024-09-17T18:15:59.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8360000000000003e-06 2024-09-17T18:15:59.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.592 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.592 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195884+0000", 2024-09-17T18:15:59.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.014710877000000001 2024-09-17T18:15:59.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.592 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.592 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.592 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.196029+0000", 2024-09-17T18:15:59.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014536900000000001 2024-09-17T18:15:59.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.592 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.592 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:59.592 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.196221+0000", 2024-09-17T18:15:59.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019122 2024-09-17T18:15:59.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.593 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:59.593 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.199925+0000", 2024-09-17T18:15:59.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037047389999999999 2024-09-17T18:15:59.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.593 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:59.593 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201572+0000", 2024-09-17T18:15:59.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001646652 2024-09-17T18:15:59.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.593 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.593 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201656+0000", 2024-09-17T18:15:59.594 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4107e-05 2024-09-17T18:15:59.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.594 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.594 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201750+0000", 2024-09-17T18:15:59.594 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3690000000000006e-05 2024-09-17T18:15:59.594 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.594 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.594 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.594 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:59.594 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378327+0000", 2024-09-17T18:15:59.594 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 45.145163727000003, 2024-09-17T18:15:59.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018591921000000001, 2024-09-17T18:15:59.595 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.595 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.595 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.595 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.595 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:59.595 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:59.595 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 122 2024-09-17T18:15:59.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.595 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378327+0000", 2024-09-17T18:15:59.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378327+0000", 2024-09-17T18:15:59.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378328+0000", 2024-09-17T18:15:59.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3170000000000001e-06 2024-09-17T18:15:59.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.597 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378338+0000", 2024-09-17T18:15:59.597 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0006e-05 2024-09-17T18:15:59.597 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.597 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.597 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.597 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378358+0000", 2024-09-17T18:15:59.597 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9919e-05 2024-09-17T18:15:59.597 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.597 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.597 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.597 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378371+0000", 2024-09-17T18:15:59.597 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3363999999999999e-05 2024-09-17T18:15:59.597 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.598 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392332+0000", 2024-09-17T18:15:59.598 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013960396999999999 2024-09-17T18:15:59.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.598 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392445+0000", 2024-09-17T18:15:59.598 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011278899999999999 2024-09-17T18:15:59.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:59.598 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392625+0000", 2024-09-17T18:15:59.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000180082 2024-09-17T18:15:59.599 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.599 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:59.599 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396780+0000", 2024-09-17T18:15:59.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0041555639999999996 2024-09-17T18:15:59.599 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.599 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:59.599 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396802+0000", 2024-09-17T18:15:59.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1460000000000001e-05 2024-09-17T18:15:59.599 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.599 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396864+0000", 2024-09-17T18:15:59.600 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2193999999999994e-05 2024-09-17T18:15:59.600 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.600 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.600 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396919+0000", 2024-09-17T18:15:59.600 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4829e-05 2024-09-17T18:15:59.600 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.600 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.600 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.600 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.600 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.600 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:59.601 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378397+0000", 2024-09-17T18:15:59.601 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 45.145093361999997, 2024-09-17T18:15:59.601 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018905537, 2024-09-17T18:15:59.601 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.601 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.601 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.601 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.601 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:59.601 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:59.601 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 123 2024-09-17T18:15:59.601 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.601 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.601 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.601 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.602 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378397+0000", 2024-09-17T18:15:59.602 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.604 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.604 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.604 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.605 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378397+0000", 2024-09-17T18:15:59.605 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.605 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.605 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.605 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.605 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378399+0000", 2024-09-17T18:15:59.605 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4559999999999999e-06 2024-09-17T18:15:59.605 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.605 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.605 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.605 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378595+0000", 2024-09-17T18:15:59.605 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019676399999999999 2024-09-17T18:15:59.605 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378611+0000", 2024-09-17T18:15:59.606 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5268999999999999e-05 2024-09-17T18:15:59.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378622+0000", 2024-09-17T18:15:59.606 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1593999999999999e-05 2024-09-17T18:15:59.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393759+0000", 2024-09-17T18:15:59.607 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015136836000000001 2024-09-17T18:15:59.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.607 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.607 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393966+0000", 2024-09-17T18:15:59.607 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020672 2024-09-17T18:15:59.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.607 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:59.607 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.394159+0000", 2024-09-17T18:15:59.607 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000193594 2024-09-17T18:15:59.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.608 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:59.608 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396935+0000", 2024-09-17T18:15:59.608 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027754889999999999 2024-09-17T18:15:59.608 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.608 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.608 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:59.608 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397041+0000", 2024-09-17T18:15:59.608 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105853 2024-09-17T18:15:59.608 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.608 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.608 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.608 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397193+0000", 2024-09-17T18:15:59.608 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015243200000000001 2024-09-17T18:15:59.609 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.609 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.609 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.609 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397303+0000", 2024-09-17T18:15:59.609 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010953 2024-09-17T18:15:59.609 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.609 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.609 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.609 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.609 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.609 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:15:59.609 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378646+0000", 2024-09-17T18:15:59.609 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 45.144844919999997, 2024-09-17T18:15:59.609 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019220590999999999, 2024-09-17T18:15:59.610 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.610 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.610 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.610 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.610 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:15:59.610 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:15:59.610 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 124 2024-09-17T18:15:59.610 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.610 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.610 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.610 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.610 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378646+0000", 2024-09-17T18:15:59.610 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.611 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.611 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.611 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.611 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378646+0000", 2024-09-17T18:15:59.611 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.611 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.611 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.611 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.611 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378647+0000", 2024-09-17T18:15:59.611 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.17e-06 2024-09-17T18:15:59.611 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.611 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.611 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.611 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378655+0000", 2024-09-17T18:15:59.612 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999997e-06 2024-09-17T18:15:59.612 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.612 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.612 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378669+0000", 2024-09-17T18:15:59.612 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4715000000000001e-05 2024-09-17T18:15:59.612 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.612 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.612 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378677+0000", 2024-09-17T18:15:59.612 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5499999999999997e-06 2024-09-17T18:15:59.612 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.612 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.613 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.395519+0000", 2024-09-17T18:15:59.613 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016842012999999999 2024-09-17T18:15:59.613 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.613 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.613 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.613 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.395741+0000", 2024-09-17T18:15:59.613 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000221776 2024-09-17T18:15:59.613 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.613 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.613 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:15:59.613 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396098+0000", 2024-09-17T18:15:59.613 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00035730199999999999 2024-09-17T18:15:59.613 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.614 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.614 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:15:59.614 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397456+0000", 2024-09-17T18:15:59.614 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001357701 2024-09-17T18:15:59.614 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.614 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.614 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:15:59.614 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397740+0000", 2024-09-17T18:15:59.614 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000284068 2024-09-17T18:15:59.614 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.614 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.614 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.615 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397813+0000", 2024-09-17T18:15:59.615 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2934000000000003e-05 2024-09-17T18:15:59.615 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.615 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.615 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.615 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397866+0000", 2024-09-17T18:15:59.615 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3542000000000003e-05 2024-09-17T18:15:59.615 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.615 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.615 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.615 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.615 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.615 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:510 3.8s0 3:1aecdbc1:::smithi15432074-42:head [append 0~442368] snapc 10=[10,e,d,c,b,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:59.616 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.316884+0000", 2024-09-17T18:15:59.616 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.206606300000001, 2024-09-17T18:15:59.616 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.031567413000000002, 2024-09-17T18:15:59.616 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.616 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.616 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.616 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.616 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:15:59.616 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:59.616 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 510 2024-09-17T18:15:59.616 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.616 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.616 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.617 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.617 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.316884+0000", 2024-09-17T18:15:59.617 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.617 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.617 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.617 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.617 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.316884+0000", 2024-09-17T18:15:59.617 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.617 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.617 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.617 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.617 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.316889+0000", 2024-09-17T18:15:59.618 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4789999999999998e-06 2024-09-17T18:15:59.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.618 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.618 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.318436+0000", 2024-09-17T18:15:59.618 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001547199 2024-09-17T18:15:59.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.618 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.618 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.318465+0000", 2024-09-17T18:15:59.618 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8687000000000002e-05 2024-09-17T18:15:59.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.618 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.619 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.318480+0000", 2024-09-17T18:15:59.619 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5536000000000002e-05 2024-09-17T18:15:59.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.619 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.619 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.619 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.318645+0000", 2024-09-17T18:15:59.619 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016444100000000001 2024-09-17T18:15:59.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.619 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.619 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-17T18:15:59.619 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.318665+0000", 2024-09-17T18:15:59.619 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0403000000000001e-05 2024-09-17T18:15:59.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.620 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.620 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.327594+0000", 2024-09-17T18:15:59.620 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0089287629999999993 2024-09-17T18:15:59.620 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.620 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.620 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.327892+0000", 2024-09-17T18:15:59.620 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000298332 2024-09-17T18:15:59.621 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.621 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.621 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.621 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.331990+0000", 2024-09-17T18:15:59.621 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040984350000000001 2024-09-17T18:15:59.621 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.621 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.621 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.621 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.347593+0000", 2024-09-17T18:15:59.621 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015602582 2024-09-17T18:15:59.621 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.621 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.622 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.622 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.348150+0000", 2024-09-17T18:15:59.622 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00055665399999999996 2024-09-17T18:15:59.622 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.622 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.622 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.622 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.348452+0000", 2024-09-17T18:15:59.622 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000301902 2024-09-17T18:15:59.622 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.622 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.622 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.622 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.623 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.623 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:511 3.8s0 3:1aecdbc1:::smithi15432074-42:head [append 0~540672] snapc 10=[10,e,d,c,b,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:59.623 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.329689+0000", 2024-09-17T18:15:59.623 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.193801394999999, 2024-09-17T18:15:59.623 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.032863626999999999, 2024-09-17T18:15:59.623 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.623 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.623 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.623 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.623 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:15:59.624 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:59.624 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 511 2024-09-17T18:15:59.624 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.624 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.624 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.329689+0000", 2024-09-17T18:15:59.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.624 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.624 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.329689+0000", 2024-09-17T18:15:59.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.625 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.625 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.329693+0000", 2024-09-17T18:15:59.625 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6030000000000001e-06 2024-09-17T18:15:59.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.625 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.625 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.331200+0000", 2024-09-17T18:15:59.625 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015075469999999999 2024-09-17T18:15:59.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.625 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.626 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.331237+0000", 2024-09-17T18:15:59.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6612000000000001e-05 2024-09-17T18:15:59.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.626 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.626 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.626 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.331259+0000", 2024-09-17T18:15:59.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1800000000000001e-05 2024-09-17T18:15:59.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.626 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.626 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.626 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340574+0000", 2024-09-17T18:15:59.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093152440000000003 2024-09-17T18:15:59.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.627 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.627 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340841+0000", 2024-09-17T18:15:59.627 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00026700200000000002 2024-09-17T18:15:59.627 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.627 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.627 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.344881+0000", 2024-09-17T18:15:59.627 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040397640000000004 2024-09-17T18:15:59.627 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.627 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.357502+0000", 2024-09-17T18:15:59.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012621557 2024-09-17T18:15:59.628 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.362378+0000", 2024-09-17T18:15:59.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0048762179999999999 2024-09-17T18:15:59.628 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.362553+0000", 2024-09-17T18:15:59.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017427999999999999 2024-09-17T18:15:59.629 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.629 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.629 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.629 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.629 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.629 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:512 3.8s0 3:1aecdbc1:::smithi15432074-42:head [append 0~622592] snapc 10=[10,e,d,c,b,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:59.629 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.339227+0000", 2024-09-17T18:15:59.629 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.184263905, 2024-09-17T18:15:59.629 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.02825772, 2024-09-17T18:15:59.629 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.629 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.629 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.629 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.630 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:15:59.630 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:59.630 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 512 2024-09-17T18:15:59.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.630 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.630 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.339227+0000", 2024-09-17T18:15:59.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.630 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.339227+0000", 2024-09-17T18:15:59.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.339230+0000", 2024-09-17T18:15:59.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0570000000000001e-06 2024-09-17T18:15:59.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340637+0000", 2024-09-17T18:15:59.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014072710000000001 2024-09-17T18:15:59.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340673+0000", 2024-09-17T18:15:59.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5769999999999998e-05 2024-09-17T18:15:59.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340695+0000", 2024-09-17T18:15:59.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1953000000000001e-05 2024-09-17T18:15:59.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.349122+0000", 2024-09-17T18:15:59.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0084269040000000007 2024-09-17T18:15:59.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.633 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.349350+0000", 2024-09-17T18:15:59.633 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000228166 2024-09-17T18:15:59.633 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.633 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.633 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.633 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.352772+0000", 2024-09-17T18:15:59.633 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034218120000000002 2024-09-17T18:15:59.633 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.633 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.633 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.633 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.357645+0000", 2024-09-17T18:15:59.633 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.004873128 2024-09-17T18:15:59.633 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.367325+0000", 2024-09-17T18:15:59.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0096804219999999993 2024-09-17T18:15:59.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.367484+0000", 2024-09-17T18:15:59.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015923700000000001 2024-09-17T18:15:59.634 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.634 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.634 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.635 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:513 3.8s0 3:1aecdbc1:::smithi15432074-42:head [setxattr _header (57) in=7b] snapc 10=[10,e,d,c,b,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:59.635 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.340735+0000", 2024-09-17T18:15:59.635 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.182755708, 2024-09-17T18:15:59.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.029807212999999999, 2024-09-17T18:15:59.635 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.635 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.635 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:15:59.635 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.635 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:15:59.635 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:59.635 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 513 2024-09-17T18:15:59.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.636 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.636 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340735+0000", 2024-09-17T18:15:59.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.636 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340735+0000", 2024-09-17T18:15:59.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340737+0000", 2024-09-17T18:15:59.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.95e-06 2024-09-17T18:15:59.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.637 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340745+0000", 2024-09-17T18:15:59.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6859999999999995e-06 2024-09-17T18:15:59.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.637 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340767+0000", 2024-09-17T18:15:59.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1480000000000001e-05 2024-09-17T18:15:59.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340782+0000", 2024-09-17T18:15:59.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5366000000000002e-05 2024-09-17T18:15:59.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.354803+0000", 2024-09-17T18:15:59.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.014020359 2024-09-17T18:15:59.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.355093+0000", 2024-09-17T18:15:59.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00029036200000000001 2024-09-17T18:15:59.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:15:59.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.356350+0000", 2024-09-17T18:15:59.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012570610000000001 2024-09-17T18:15:59.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:15:59.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.358546+0000", 2024-09-17T18:15:59.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021961010000000002 2024-09-17T18:15:59.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:15:59.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.370364+0000", 2024-09-17T18:15:59.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011817539 2024-09-17T18:15:59.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.640 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.370542+0000", 2024-09-17T18:15:59.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000178309 2024-09-17T18:15:59.640 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.640 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.640 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.640 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:514 3.8s0 3:1aecdbc1:::smithi15432074-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:59.640 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.340816+0000", 2024-09-17T18:15:59.641 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.182674836, 2024-09-17T18:15:59.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.032647508999999998, 2024-09-17T18:15:59.641 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.641 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.641 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-17T18:15:59.641 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:15:59.641 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:15:59.641 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:15:59.641 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 514 2024-09-17T18:15:59.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.641 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.641 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340816+0000", 2024-09-17T18:15:59.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340816+0000", 2024-09-17T18:15:59.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340817+0000", 2024-09-17T18:15:59.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.48e-06 2024-09-17T18:15:59.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340824+0000", 2024-09-17T18:15:59.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8229999999999997e-06 2024-09-17T18:15:59.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340842+0000", 2024-09-17T18:15:59.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8505999999999999e-05 2024-09-17T18:15:59.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340856+0000", 2024-09-17T18:15:59.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3747000000000001e-05 2024-09-17T18:15:59.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.358066+0000", 2024-09-17T18:15:59.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017210195000000001 2024-09-17T18:15:59.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for rw locks", 2024-09-17T18:15:59.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.358287+0000", 2024-09-17T18:15:59.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022095700000000001 2024-09-17T18:15:59.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.371255+0000", 2024-09-17T18:15:59.645 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012967953000000001 2024-09-17T18:15:59.645 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.645 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.645 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.645 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.371412+0000", 2024-09-17T18:15:59.645 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015673999999999999 2024-09-17T18:15:59.645 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.645 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.645 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.645 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.373463+0000", 2024-09-17T18:15:59.645 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020511079999999998 2024-09-17T18:15:59.645 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.645 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.646 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.646 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(osd.4.23:4 3.8s0 3:1fdb63ef:::smithi15432074-49:head [assert-version v28,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:15:59.646 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.344516+0000", 2024-09-17T18:15:59.646 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.178974117999999, 2024-09-17T18:15:59.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.028065837999999999, 2024-09-17T18:15:59.646 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:15:59.646 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:15:59.646 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-17T18:15:59.646 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:15:59.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:15:59.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.344516+0000", 2024-09-17T18:15:59.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:15:59.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.344516+0000", 2024-09-17T18:15:59.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:15:59.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:15:59.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.344519+0000", 2024-09-17T18:15:59.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8669999999999998e-06 2024-09-17T18:15:59.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:15:59.648 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.344533+0000", 2024-09-17T18:15:59.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3366e-05 2024-09-17T18:15:59.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:15:59.648 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.344560+0000", 2024-09-17T18:15:59.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7282999999999999e-05 2024-09-17T18:15:59.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:15:59.648 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.344579+0000", 2024-09-17T18:15:59.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8827000000000001e-05 2024-09-17T18:15:59.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.649 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.649 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.358395+0000", 2024-09-17T18:15:59.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013815792 2024-09-17T18:15:59.649 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.649 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.649 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for rw locks", 2024-09-17T18:15:59.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.358533+0000", 2024-09-17T18:15:59.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013825799999999999 2024-09-17T18:15:59.649 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.649 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.649 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:15:59.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.361197+0000", 2024-09-17T18:15:59.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026645409999999999 2024-09-17T18:15:59.650 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.650 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:15:59.650 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.361395+0000", 2024-09-17T18:15:59.650 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019756799999999999 2024-09-17T18:15:59.650 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:15:59.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:15:59.650 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:15:59.650 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.372582+0000", 2024-09-17T18:15:59.650 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011187336000000001 2024-09-17T18:15:59.650 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.650 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.650 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.651 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:15:59.651 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:15:59.651 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:59.652 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T18:15:59.653 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:15:59.651+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:15:59.754 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:59.750+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:59.780 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:59.780 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:59.780 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:15:59.781 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:59.794 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T18:15:59.854 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:15:59.854+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:15:59.910 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:15:59.911 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:15:59.911 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:15:59.911 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:15:59.911 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:15:59.925 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T18:15:59.956 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:15:59.955+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:00.050 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:00.050 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:16:00.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:16:00.051 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-17T18:16:00.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.051 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s2 42/31 ECSubWrite(tid=40, reqid=client.4565.0:363, at_version=42'26, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:16:00.051 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.767133+0000", 2024-09-17T18:16:00.051 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.280673718999999, 2024-09-17T18:16:00.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021588646, 2024-09-17T18:16:00.051 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.051 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.051 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.051 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767133+0000", 2024-09-17T18:16:00.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767133+0000", 2024-09-17T18:16:00.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767133+0000", 2024-09-17T18:16:00.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4000000000000002e-07 2024-09-17T18:16:00.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767171+0000", 2024-09-17T18:16:00.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7116000000000002e-05 2024-09-17T18:16:00.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767198+0000", 2024-09-17T18:16:00.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.756e-05 2024-09-17T18:16:00.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767223+0000", 2024-09-17T18:16:00.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4723e-05 2024-09-17T18:16:00.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.054 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767425+0000", 2024-09-17T18:16:00.054 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020206299999999999 2024-09-17T18:16:00.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.054 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767451+0000", 2024-09-17T18:16:00.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5769e-05 2024-09-17T18:16:00.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788636+0000", 2024-09-17T18:16:00.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021185626999999999 2024-09-17T18:16:00.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.055 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.055 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788722+0000", 2024-09-17T18:16:00.055 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5347999999999997e-05 2024-09-17T18:16:00.055 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.056 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.056 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.056 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.056 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=86, reqid=client.4565.0:343, at_version=42'21, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:00.056 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.769752+0000", 2024-09-17T18:16:00.056 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.278054743999999, 2024-09-17T18:16:00.056 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022302678999999999, 2024-09-17T18:16:00.056 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.056 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.056 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.056 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769752+0000", 2024-09-17T18:16:00.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769752+0000", 2024-09-17T18:16:00.057 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.057 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.057 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.057 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769753+0000", 2024-09-17T18:16:00.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3e-07 2024-09-17T18:16:00.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769810+0000", 2024-09-17T18:16:00.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7501999999999999e-05 2024-09-17T18:16:00.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.058 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.058 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769843+0000", 2024-09-17T18:16:00.058 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2299999999999999e-05 2024-09-17T18:16:00.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.058 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769866+0000", 2024-09-17T18:16:00.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3448999999999999e-05 2024-09-17T18:16:00.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.770089+0000", 2024-09-17T18:16:00.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022273200000000001 2024-09-17T18:16:00.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.059 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.059 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.059 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.770113+0000", 2024-09-17T18:16:00.059 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4170000000000001e-05 2024-09-17T18:16:00.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.791961+0000", 2024-09-17T18:16:00.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021847829999999999 2024-09-17T18:16:00.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.060 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.060 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792055+0000", 2024-09-17T18:16:00.060 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3966000000000001e-05 2024-09-17T18:16:00.060 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.060 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.061 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.061 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 42/31 ECSubWrite(tid=87, reqid=client.4565.0:358, at_version=42'26, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:00.061 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.772061+0000", 2024-09-17T18:16:00.061 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.275745407999999, 2024-09-17T18:16:00.061 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.020486306999999999, 2024-09-17T18:16:00.061 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.061 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.061 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.061 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.061 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.061 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772061+0000", 2024-09-17T18:16:00.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772061+0000", 2024-09-17T18:16:00.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.062 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.062 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.062 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772063+0000", 2024-09-17T18:16:00.062 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0870000000000001e-06 2024-09-17T18:16:00.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772121+0000", 2024-09-17T18:16:00.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7156e-05 2024-09-17T18:16:00.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772165+0000", 2024-09-17T18:16:00.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4885000000000001e-05 2024-09-17T18:16:00.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.063 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.063 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.063 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772198+0000", 2024-09-17T18:16:00.063 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2634e-05 2024-09-17T18:16:00.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772630+0000", 2024-09-17T18:16:00.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00043200500000000001 2024-09-17T18:16:00.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.064 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772656+0000", 2024-09-17T18:16:00.064 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5942e-05 2024-09-17T18:16:00.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.064 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.064 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792367+0000", 2024-09-17T18:16:00.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019711310999999999 2024-09-17T18:16:00.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.065 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.065 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792548+0000", 2024-09-17T18:16:00.065 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000180287 2024-09-17T18:16:00.065 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.065 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.065 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.065 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.065 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.066 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=88, reqid=client.4565.0:344, at_version=42'22, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:00.066 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.772258+0000", 2024-09-17T18:16:00.066 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.275549053999999, 2024-09-17T18:16:00.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022345961000000001, 2024-09-17T18:16:00.066 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.066 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.066 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.066 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.066 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.066 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.066 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772258+0000", 2024-09-17T18:16:00.066 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772258+0000", 2024-09-17T18:16:00.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772259+0000", 2024-09-17T18:16:00.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.28e-06 2024-09-17T18:16:00.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.067 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.067 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.067 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772311+0000", 2024-09-17T18:16:00.067 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2061999999999997e-05 2024-09-17T18:16:00.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772339+0000", 2024-09-17T18:16:00.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7613000000000001e-05 2024-09-17T18:16:00.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.068 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.068 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772359+0000", 2024-09-17T18:16:00.068 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0313e-05 2024-09-17T18:16:00.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.068 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782669+0000", 2024-09-17T18:16:00.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010310293 2024-09-17T18:16:00.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782707+0000", 2024-09-17T18:16:00.069 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8213000000000002e-05 2024-09-17T18:16:00.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.069 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.069 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.069 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794497+0000", 2024-09-17T18:16:00.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011789366000000001 2024-09-17T18:16:00.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.070 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.070 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794604+0000", 2024-09-17T18:16:00.070 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106821 2024-09-17T18:16:00.070 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.070 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.070 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.070 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.070 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s2 42/31 ECSubWrite(tid=41, reqid=osd.7.0:41, at_version=42'28, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:16:00.070 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.773158+0000", 2024-09-17T18:16:00.071 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.274649120999999, 2024-09-17T18:16:00.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016727855999999999, 2024-09-17T18:16:00.071 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.071 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.071 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.071 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.071 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.071 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.071 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773158+0000", 2024-09-17T18:16:00.071 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773158+0000", 2024-09-17T18:16:00.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.072 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.072 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773160+0000", 2024-09-17T18:16:00.072 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0829999999999998e-06 2024-09-17T18:16:00.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773236+0000", 2024-09-17T18:16:00.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6372000000000007e-05 2024-09-17T18:16:00.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773278+0000", 2024-09-17T18:16:00.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1841999999999997e-05 2024-09-17T18:16:00.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.073 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.073 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.073 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773299+0000", 2024-09-17T18:16:00.073 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.088e-05 2024-09-17T18:16:00.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773551+0000", 2024-09-17T18:16:00.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00025183200000000001 2024-09-17T18:16:00.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.074 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773574+0000", 2024-09-17T18:16:00.074 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3810000000000001e-05 2024-09-17T18:16:00.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.074 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.074 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789798+0000", 2024-09-17T18:16:00.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016223909000000002 2024-09-17T18:16:00.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.075 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.075 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789885+0000", 2024-09-17T18:16:00.075 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7127999999999997e-05 2024-09-17T18:16:00.075 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.075 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.075 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.075 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.075 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s2 42/31 ECSubWrite(tid=42, reqid=osd.7.0:42, at_version=42'30, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:16:00.076 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.773805+0000", 2024-09-17T18:16:00.076 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.274001353999999, 2024-09-17T18:16:00.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.020956761000000001, 2024-09-17T18:16:00.076 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.076 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.076 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.076 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.076 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.076 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.076 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773805+0000", 2024-09-17T18:16:00.076 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773805+0000", 2024-09-17T18:16:00.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.077 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773807+0000", 2024-09-17T18:16:00.077 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9400000000000001e-06 2024-09-17T18:16:00.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.077 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.077 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773855+0000", 2024-09-17T18:16:00.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7753000000000002e-05 2024-09-17T18:16:00.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773891+0000", 2024-09-17T18:16:00.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5493000000000001e-05 2024-09-17T18:16:00.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.078 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.078 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.078 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773912+0000", 2024-09-17T18:16:00.078 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1818999999999999e-05 2024-09-17T18:16:00.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783091+0000", 2024-09-17T18:16:00.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0091785649999999996 2024-09-17T18:16:00.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.079 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783111+0000", 2024-09-17T18:16:00.079 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0523e-05 2024-09-17T18:16:00.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.079 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.079 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794669+0000", 2024-09-17T18:16:00.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011557263999999999 2024-09-17T18:16:00.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.080 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.080 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794762+0000", 2024-09-17T18:16:00.080 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3404000000000002e-05 2024-09-17T18:16:00.080 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.080 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.080 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.080 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.080 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=89, reqid=client.4565.0:345, at_version=42'23, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:00.081 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775036+0000", 2024-09-17T18:16:00.081 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.272770377000001, 2024-09-17T18:16:00.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019634636, 2024-09-17T18:16:00.081 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.081 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.081 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.081 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.081 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.081 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.081 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775036+0000", 2024-09-17T18:16:00.081 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775036+0000", 2024-09-17T18:16:00.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.082 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775038+0000", 2024-09-17T18:16:00.082 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0930000000000001e-06 2024-09-17T18:16:00.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.082 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.082 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775084+0000", 2024-09-17T18:16:00.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5612999999999998e-05 2024-09-17T18:16:00.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775122+0000", 2024-09-17T18:16:00.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7945999999999999e-05 2024-09-17T18:16:00.083 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.083 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.083 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.083 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775147+0000", 2024-09-17T18:16:00.083 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5296e-05 2024-09-17T18:16:00.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785552+0000", 2024-09-17T18:16:00.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010404722 2024-09-17T18:16:00.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.084 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785575+0000", 2024-09-17T18:16:00.084 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.313e-05 2024-09-17T18:16:00.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.084 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.084 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794613+0000", 2024-09-17T18:16:00.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0090377110000000004 2024-09-17T18:16:00.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.085 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.085 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794671+0000", 2024-09-17T18:16:00.085 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8125000000000003e-05 2024-09-17T18:16:00.085 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.085 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.085 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.085 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.086 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 42/31 ECSubWrite(tid=90, reqid=client.4565.0:359, at_version=42'27, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:00.086 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775192+0000", 2024-09-17T18:16:00.086 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.272614507, 2024-09-17T18:16:00.086 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017422031000000001, 2024-09-17T18:16:00.086 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.086 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.087 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.087 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775192+0000", 2024-09-17T18:16:00.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.087 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775192+0000", 2024-09-17T18:16:00.087 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.087 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.087 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775193+0000", 2024-09-17T18:16:00.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4399999999999998e-07 2024-09-17T18:16:00.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775243+0000", 2024-09-17T18:16:00.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9595999999999997e-05 2024-09-17T18:16:00.088 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.088 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.088 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.088 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775297+0000", 2024-09-17T18:16:00.088 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3715000000000003e-05 2024-09-17T18:16:00.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775319+0000", 2024-09-17T18:16:00.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2742999999999999e-05 2024-09-17T18:16:00.089 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.089 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.089 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.089 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783071+0000", 2024-09-17T18:16:00.089 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0077514890000000003 2024-09-17T18:16:00.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783095+0000", 2024-09-17T18:16:00.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3981999999999998e-05 2024-09-17T18:16:00.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792559+0000", 2024-09-17T18:16:00.090 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0094641399999999994 2024-09-17T18:16:00.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.090 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.090 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.090 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792614+0000", 2024-09-17T18:16:00.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5421999999999999e-05 2024-09-17T18:16:00.091 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.091 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.091 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.091 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.091 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=91, reqid=client.4565.0:352, at_version=42'25, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:00.091 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775354+0000", 2024-09-17T18:16:00.091 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.272452319999999, 2024-09-17T18:16:00.091 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019376402000000001, 2024-09-17T18:16:00.091 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.091 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.092 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.092 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775354+0000", 2024-09-17T18:16:00.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.092 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.092 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775354+0000", 2024-09-17T18:16:00.092 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775355+0000", 2024-09-17T18:16:00.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8700000000000004e-07 2024-09-17T18:16:00.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775411+0000", 2024-09-17T18:16:00.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5599000000000001e-05 2024-09-17T18:16:00.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.093 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.093 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.093 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775435+0000", 2024-09-17T18:16:00.093 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4156999999999999e-05 2024-09-17T18:16:00.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775454+0000", 2024-09-17T18:16:00.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8546000000000002e-05 2024-09-17T18:16:00.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.094 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787101+0000", 2024-09-17T18:16:00.094 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011647309 2024-09-17T18:16:00.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.094 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.094 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787134+0000", 2024-09-17T18:16:00.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2922000000000001e-05 2024-09-17T18:16:00.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794677+0000", 2024-09-17T18:16:00.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0075426629999999998 2024-09-17T18:16:00.095 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.095 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.095 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.095 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794731+0000", 2024-09-17T18:16:00.095 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4318999999999999e-05 2024-09-17T18:16:00.095 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.096 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.096 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.096 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.096 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 42/31 ECSubWrite(tid=92, reqid=client.4565.0:360, at_version=42'28, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:00.096 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775482+0000", 2024-09-17T18:16:00.096 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.272324725000001, 2024-09-17T18:16:00.096 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019181841000000002, 2024-09-17T18:16:00.096 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.096 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.096 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.096 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775482+0000", 2024-09-17T18:16:00.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775482+0000", 2024-09-17T18:16:00.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.097 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.097 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.097 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775483+0000", 2024-09-17T18:16:00.097 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-17T18:16:00.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775514+0000", 2024-09-17T18:16:00.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1429e-05 2024-09-17T18:16:00.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.098 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775536+0000", 2024-09-17T18:16:00.098 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1773e-05 2024-09-17T18:16:00.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.098 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.098 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775551+0000", 2024-09-17T18:16:00.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.448e-05 2024-09-17T18:16:00.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785199+0000", 2024-09-17T18:16:00.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0096482760000000008 2024-09-17T18:16:00.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.099 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.099 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785221+0000", 2024-09-17T18:16:00.099 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2217000000000001e-05 2024-09-17T18:16:00.099 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.099 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794561+0000", 2024-09-17T18:16:00.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093396580000000007 2024-09-17T18:16:00.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.100 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.100 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794664+0000", 2024-09-17T18:16:00.100 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103168 2024-09-17T18:16:00.100 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.100 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.100 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.100 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.101 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=94, reqid=client.4565.0:353, at_version=42'26, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:00.101 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.778391+0000", 2024-09-17T18:16:00.101 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.269416099000001, 2024-09-17T18:16:00.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019505588000000001, 2024-09-17T18:16:00.101 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.101 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.101 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.101 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.101 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.101 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778391+0000", 2024-09-17T18:16:00.101 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.101 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.101 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.102 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.102 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778391+0000", 2024-09-17T18:16:00.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.102 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.102 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778393+0000", 2024-09-17T18:16:00.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9130000000000001e-06 2024-09-17T18:16:00.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.102 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.102 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.102 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778432+0000", 2024-09-17T18:16:00.102 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9515999999999999e-05 2024-09-17T18:16:00.102 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778475+0000", 2024-09-17T18:16:00.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2898999999999997e-05 2024-09-17T18:16:00.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778517+0000", 2024-09-17T18:16:00.103 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2376000000000002e-05 2024-09-17T18:16:00.103 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.103 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.103 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.103 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788635+0000", 2024-09-17T18:16:00.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010117321 2024-09-17T18:16:00.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788661+0000", 2024-09-17T18:16:00.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6101999999999998e-05 2024-09-17T18:16:00.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.104 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.797809+0000", 2024-09-17T18:16:00.104 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0091479130000000006 2024-09-17T18:16:00.104 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.104 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.104 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.105 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.797896+0000", 2024-09-17T18:16:00.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7547999999999996e-05 2024-09-17T18:16:00.105 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.105 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.105 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.105 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.105 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.105 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 42/31 ECSubWrite(tid=93, reqid=osd.4.0:93, at_version=42'30, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:00.105 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.778582+0000", 2024-09-17T18:16:00.105 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.269224825999999, 2024-09-17T18:16:00.105 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016196189999999999, 2024-09-17T18:16:00.105 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.105 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.106 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.106 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778582+0000", 2024-09-17T18:16:00.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.106 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.106 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778582+0000", 2024-09-17T18:16:00.106 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.106 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.106 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778583+0000", 2024-09-17T18:16:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.15e-06 2024-09-17T18:16:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778638+0000", 2024-09-17T18:16:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4752e-05 2024-09-17T18:16:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778664+0000", 2024-09-17T18:16:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5902999999999999e-05 2024-09-17T18:16:00.107 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.108 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778683+0000", 2024-09-17T18:16:00.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9406e-05 2024-09-17T18:16:00.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.108 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.108 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785698+0000", 2024-09-17T18:16:00.108 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0070144589999999998 2024-09-17T18:16:00.108 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.108 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.108 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785719+0000", 2024-09-17T18:16:00.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1746000000000002e-05 2024-09-17T18:16:00.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794719+0000", 2024-09-17T18:16:00.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0089993550000000005 2024-09-17T18:16:00.109 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.109 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.109 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794778+0000", 2024-09-17T18:16:00.109 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9419000000000001e-05 2024-09-17T18:16:00.109 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.109 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.110 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.110 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=95, reqid=client.4565.0:354, at_version=42'27, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:00.110 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779563+0000", 2024-09-17T18:16:00.110 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.268243464000001, 2024-09-17T18:16:00.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018430695, 2024-09-17T18:16:00.110 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.110 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.110 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.110 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.110 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.110 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779563+0000", 2024-09-17T18:16:00.110 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779563+0000", 2024-09-17T18:16:00.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779565+0000", 2024-09-17T18:16:00.111 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9099999999999999e-06 2024-09-17T18:16:00.111 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.111 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.111 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.111 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779611+0000", 2024-09-17T18:16:00.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5595e-05 2024-09-17T18:16:00.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779644+0000", 2024-09-17T18:16:00.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3113e-05 2024-09-17T18:16:00.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.112 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.112 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779667+0000", 2024-09-17T18:16:00.112 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3033000000000001e-05 2024-09-17T18:16:00.112 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.112 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.790793+0000", 2024-09-17T18:16:00.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011125894000000001 2024-09-17T18:16:00.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.790816+0000", 2024-09-17T18:16:00.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3037e-05 2024-09-17T18:16:00.113 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.113 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.113 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.113 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.797906+0000", 2024-09-17T18:16:00.113 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0070905680000000002 2024-09-17T18:16:00.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.114 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.114 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.797994+0000", 2024-09-17T18:16:00.114 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7545000000000003e-05 2024-09-17T18:16:00.114 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.114 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.114 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.114 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.114 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.114 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 42/31 ECSubWrite(tid=96, reqid=osd.4.0:96, at_version=42'32, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:00.114 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779930+0000", 2024-09-17T18:16:00.114 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.267876440999999, 2024-09-17T18:16:00.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018156274999999999, 2024-09-17T18:16:00.115 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.115 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.115 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.115 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779930+0000", 2024-09-17T18:16:00.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.115 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.115 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.115 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.115 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779930+0000", 2024-09-17T18:16:00.115 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779932+0000", 2024-09-17T18:16:00.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3999999999999999e-06 2024-09-17T18:16:00.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.116 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779978+0000", 2024-09-17T18:16:00.116 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6221999999999999e-05 2024-09-17T18:16:00.116 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.116 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.116 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.780043+0000", 2024-09-17T18:16:00.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5436000000000002e-05 2024-09-17T18:16:00.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.117 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.780066+0000", 2024-09-17T18:16:00.117 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2955e-05 2024-09-17T18:16:00.117 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.117 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.117 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.117 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788704+0000", 2024-09-17T18:16:00.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0086378989999999992 2024-09-17T18:16:00.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.118 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.118 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788729+0000", 2024-09-17T18:16:00.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4598999999999999e-05 2024-09-17T18:16:00.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.118 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.118 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.118 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.798004+0000", 2024-09-17T18:16:00.118 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0092750939999999994 2024-09-17T18:16:00.118 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.119 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.119 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.798087+0000", 2024-09-17T18:16:00.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2670000000000006e-05 2024-09-17T18:16:00.119 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.119 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.119 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.119 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.119 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.119 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=97, reqid=osd.4.0:97, at_version=42'29, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:00.119 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.782323+0000", 2024-09-17T18:16:00.119 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.265483823, 2024-09-17T18:16:00.119 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015712542999999999, 2024-09-17T18:16:00.119 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.120 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.120 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.120 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.120 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.120 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782323+0000", 2024-09-17T18:16:00.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.120 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.120 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782323+0000", 2024-09-17T18:16:00.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.120 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782325+0000", 2024-09-17T18:16:00.121 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.08e-06 2024-09-17T18:16:00.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782379+0000", 2024-09-17T18:16:00.121 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4221999999999997e-05 2024-09-17T18:16:00.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782407+0000", 2024-09-17T18:16:00.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7438999999999999e-05 2024-09-17T18:16:00.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782428+0000", 2024-09-17T18:16:00.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1094000000000002e-05 2024-09-17T18:16:00.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.791219+0000", 2024-09-17T18:16:00.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0087913149999999992 2024-09-17T18:16:00.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.791236+0000", 2024-09-17T18:16:00.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6512999999999999e-05 2024-09-17T18:16:00.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.798002+0000", 2024-09-17T18:16:00.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0067663009999999997 2024-09-17T18:16:00.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.798035+0000", 2024-09-17T18:16:00.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3578999999999998e-05 2024-09-17T18:16:00.124 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.124 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.124 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.124 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.124 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.2s5 42/31 ECSubWrite(tid=19, reqid=osd.14.0:19, at_version=42'14, trim_to=0'0, roll_forward_to=39'12))", 2024-09-17T18:16:00.124 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.782552+0000", 2024-09-17T18:16:00.124 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.265254927000001, 2024-09-17T18:16:00.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.01227898, 2024-09-17T18:16:00.124 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.124 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.124 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.125 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782552+0000", 2024-09-17T18:16:00.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782552+0000", 2024-09-17T18:16:00.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782552+0000", 2024-09-17T18:16:00.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1600000000000001e-07 2024-09-17T18:16:00.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782608+0000", 2024-09-17T18:16:00.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5099000000000002e-05 2024-09-17T18:16:00.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782637+0000", 2024-09-17T18:16:00.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9036000000000001e-05 2024-09-17T18:16:00.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782659+0000", 2024-09-17T18:16:00.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2687000000000001e-05 2024-09-17T18:16:00.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783249+0000", 2024-09-17T18:16:00.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00059022199999999995 2024-09-17T18:16:00.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783289+0000", 2024-09-17T18:16:00.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9298999999999998e-05 2024-09-17T18:16:00.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794737+0000", 2024-09-17T18:16:00.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011447739 2024-09-17T18:16:00.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794831+0000", 2024-09-17T18:16:00.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4282000000000003e-05 2024-09-17T18:16:00.128 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.128 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.128 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.129 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.2s5 42/31 ECSubWrite(tid=20, reqid=osd.14.0:20, at_version=42'16, trim_to=0'0, roll_forward_to=39'12))", 2024-09-17T18:16:00.129 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.785831+0000", 2024-09-17T18:16:00.129 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.261975681999999, 2024-09-17T18:16:00.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012398578, 2024-09-17T18:16:00.129 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.129 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.129 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.129 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.129 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785831+0000", 2024-09-17T18:16:00.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785831+0000", 2024-09-17T18:16:00.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785833+0000", 2024-09-17T18:16:00.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9700000000000002e-06 2024-09-17T18:16:00.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785886+0000", 2024-09-17T18:16:00.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3124999999999997e-05 2024-09-17T18:16:00.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.131 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.131 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785916+0000", 2024-09-17T18:16:00.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9643999999999999e-05 2024-09-17T18:16:00.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.131 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.131 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785939+0000", 2024-09-17T18:16:00.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3014999999999999e-05 2024-09-17T18:16:00.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.132 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.132 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788473+0000", 2024-09-17T18:16:00.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0025345900000000002 2024-09-17T18:16:00.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.132 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.132 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788497+0000", 2024-09-17T18:16:00.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3416000000000001e-05 2024-09-17T18:16:00.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.132 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.132 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.798028+0000", 2024-09-17T18:16:00.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0095311579999999996 2024-09-17T18:16:00.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.798230+0000", 2024-09-17T18:16:00.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020165999999999999 2024-09-17T18:16:00.133 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.133 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.133 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.133 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 43/31 ECSubWrite(tid=103, reqid=osd.4.0:103, at_version=43'31, trim_to=0'0, roll_forward_to=42'29))", 2024-09-17T18:16:00.133 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.768607+0000", 2024-09-17T18:16:00.133 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.279199576, 2024-09-17T18:16:00.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093966889999999997, 2024-09-17T18:16:00.134 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.134 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.134 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.134 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768607+0000", 2024-09-17T18:16:00.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768607+0000", 2024-09-17T18:16:00.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768608+0000", 2024-09-17T18:16:00.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7000000000000005e-07 2024-09-17T18:16:00.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768665+0000", 2024-09-17T18:16:00.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7556000000000003e-05 2024-09-17T18:16:00.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768690+0000", 2024-09-17T18:16:00.136 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4532000000000002e-05 2024-09-17T18:16:00.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.136 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.136 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768715+0000", 2024-09-17T18:16:00.136 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5510000000000001e-05 2024-09-17T18:16:00.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.136 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.136 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768916+0000", 2024-09-17T18:16:00.136 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020097600000000001 2024-09-17T18:16:00.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.768945+0000", 2024-09-17T18:16:00.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8636000000000002e-05 2024-09-17T18:16:00.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.777893+0000", 2024-09-17T18:16:00.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0089485239999999994 2024-09-17T18:16:00.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.778004+0000", 2024-09-17T18:16:00.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011038499999999999 2024-09-17T18:16:00.137 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.138 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.138 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.138 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 43/31 ECSubWrite(tid=110, reqid=osd.4.0:110, at_version=43'42, trim_to=0'0, roll_forward_to=43'38))", 2024-09-17T18:16:00.138 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.787989+0000", 2024-09-17T18:16:00.138 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.259817711, 2024-09-17T18:16:00.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0099759700000000007, 2024-09-17T18:16:00.138 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.138 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.138 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.138 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.139 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.787989+0000", 2024-09-17T18:16:00.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.139 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.787989+0000", 2024-09-17T18:16:00.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.139 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.787991+0000", 2024-09-17T18:16:00.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6530000000000001e-06 2024-09-17T18:16:00.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.140 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.140 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788053+0000", 2024-09-17T18:16:00.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2742000000000003e-05 2024-09-17T18:16:00.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.140 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.140 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788084+0000", 2024-09-17T18:16:00.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0555999999999997e-05 2024-09-17T18:16:00.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.140 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.141 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788106+0000", 2024-09-17T18:16:00.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2086000000000002e-05 2024-09-17T18:16:00.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.141 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788506+0000", 2024-09-17T18:16:00.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00039958600000000001 2024-09-17T18:16:00.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.141 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788531+0000", 2024-09-17T18:16:00.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5099000000000001e-05 2024-09-17T18:16:00.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.142 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.142 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.797857+0000", 2024-09-17T18:16:00.142 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093266470000000004 2024-09-17T18:16:00.142 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.142 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.142 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.797965+0000", 2024-09-17T18:16:00.142 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000107601 2024-09-17T18:16:00.142 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.142 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.142 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.142 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.143 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.2s5 43/31 ECSubWrite(tid=23, reqid=osd.14.0:23, at_version=43'20, trim_to=0'0, roll_forward_to=42'16))", 2024-09-17T18:16:00.143 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.788439+0000", 2024-09-17T18:16:00.143 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.259368139999999, 2024-09-17T18:16:00.143 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0096054739999999993, 2024-09-17T18:16:00.143 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.143 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.143 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.143 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.143 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.143 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.143 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788439+0000", 2024-09-17T18:16:00.143 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788439+0000", 2024-09-17T18:16:00.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788441+0000", 2024-09-17T18:16:00.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.12e-06 2024-09-17T18:16:00.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788494+0000", 2024-09-17T18:16:00.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3365999999999997e-05 2024-09-17T18:16:00.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788524+0000", 2024-09-17T18:16:00.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0005000000000002e-05 2024-09-17T18:16:00.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788564+0000", 2024-09-17T18:16:00.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0213000000000003e-05 2024-09-17T18:16:00.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.146 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788844+0000", 2024-09-17T18:16:00.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027924100000000001 2024-09-17T18:16:00.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.146 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.146 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788868+0000", 2024-09-17T18:16:00.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4626000000000001e-05 2024-09-17T18:16:00.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.146 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.146 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.797947+0000", 2024-09-17T18:16:00.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0090793120000000008 2024-09-17T18:16:00.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.147 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.147 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.798044+0000", 2024-09-17T18:16:00.147 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6590999999999997e-05 2024-09-17T18:16:00.147 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.147 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.147 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.147 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.147 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.147 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:00.149 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T18:16:00.149 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:00.145+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:00.249 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:00.245+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:00.282 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:00.282 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:16:00.282 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:16:00.283 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:00.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T18:16:00.312 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.3 to 1 (10000) 2024-09-17T18:16:00.312 INFO:teuthology.orchestra.run.smithi087.stderr:noscrub is set 2024-09-17T18:16:00.318 INFO:tasks.rados.rados.0.smithi154.stdout:234: done (1 left) 2024-09-17T18:16:00.318 INFO:tasks.rados.rados.0.smithi154.stdout:235: snap_create 2024-09-17T18:16:00.319 INFO:tasks.rados.rados.0.smithi154.stdout:233: finishing copy_from to smithi15432074-26 2024-09-17T18:16:00.319 INFO:tasks.rados.rados.0.smithi154.stdout:233: got expected ENOENT (src dne) 2024-09-17T18:16:00.319 INFO:tasks.rados.rados.0.smithi154.stdout:233: finishing copy_from racing read to smithi15432074-26 2024-09-17T18:16:00.347 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-17T18:16:00.350 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:00.347+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:00.427 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:00.427 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:16:00.427 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:16:00.427 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:16:00.427 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:00.441 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T18:16:00.483 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:00.483+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:00.552 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:00.550+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:00.617 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:00.617 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:16:00.618 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:16:00.618 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-17T18:16:00.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.618 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:259 3.2s0 3:412841d6:::smithi15432074-31:head [copy-from ver 6] snapc 5=[5,4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:16:00.618 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:33.723621+0000", 2024-09-17T18:16:00.618 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.890535162999999, 2024-09-17T18:16:00.618 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.023930903999999999, 2024-09-17T18:16:00.618 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.618 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.619 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:00.619 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:00.619 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:00.619 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:00.619 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 259 2024-09-17T18:16:00.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.620 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.620 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.620 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723621+0000", 2024-09-17T18:16:00.620 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.620 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.620 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.620 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723621+0000", 2024-09-17T18:16:00.620 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.620 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.621 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.621 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723624+0000", 2024-09-17T18:16:00.621 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7329999999999999e-06 2024-09-17T18:16:00.621 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.621 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.621 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.624 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723650+0000", 2024-09-17T18:16:00.625 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.635e-05 2024-09-17T18:16:00.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.625 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.625 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723679+0000", 2024-09-17T18:16:00.625 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9471999999999998e-05 2024-09-17T18:16:00.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.626 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.626 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723697+0000", 2024-09-17T18:16:00.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7499999999999998e-05 2024-09-17T18:16:00.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.626 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.626 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.626 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723856+0000", 2024-09-17T18:16:00.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015885699999999999 2024-09-17T18:16:00.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.626 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.626 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-17T18:16:00.627 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723876+0000", 2024-09-17T18:16:00.627 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0672000000000001e-05 2024-09-17T18:16:00.627 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.627 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.627 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725096+0000", 2024-09-17T18:16:00.627 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001219749 2024-09-17T18:16:00.627 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.627 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:00.627 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725238+0000", 2024-09-17T18:16:00.627 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014202299999999999 2024-09-17T18:16:00.627 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.742960+0000", 2024-09-17T18:16:00.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017721959999999998 2024-09-17T18:16:00.628 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.746486+0000", 2024-09-17T18:16:00.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035262169999999999 2024-09-17T18:16:00.628 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:00.629 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.747419+0000", 2024-09-17T18:16:00.629 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00093307999999999998 2024-09-17T18:16:00.629 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.629 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.629 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.629 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.747552+0000", 2024-09-17T18:16:00.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013229100000000001 2024-09-17T18:16:00.630 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.630 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.630 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.630 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:260 3.2s0 3:412841d6:::smithi15432074-31:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:16:00.630 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:33.723741+0000", 2024-09-17T18:16:00.630 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.890415141999998, 2024-09-17T18:16:00.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022041903000000002, 2024-09-17T18:16:00.630 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.630 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.631 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-17T18:16:00.631 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:00.631 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:00.631 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:00.631 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 260 2024-09-17T18:16:00.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.631 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.631 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723741+0000", 2024-09-17T18:16:00.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723741+0000", 2024-09-17T18:16:00.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723742+0000", 2024-09-17T18:16:00.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0130000000000001e-06 2024-09-17T18:16:00.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.633 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723747+0000", 2024-09-17T18:16:00.633 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1499999999999998e-06 2024-09-17T18:16:00.633 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.633 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.633 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.633 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723773+0000", 2024-09-17T18:16:00.633 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6389000000000001e-05 2024-09-17T18:16:00.633 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.633 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.633 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.633 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723788+0000", 2024-09-17T18:16:00.633 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4843e-05 2024-09-17T18:16:00.633 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.633 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.724014+0000", 2024-09-17T18:16:00.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000225539 2024-09-17T18:16:00.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:00.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.724024+0000", 2024-09-17T18:16:00.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0246e-05 2024-09-17T18:16:00.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725543+0000", 2024-09-17T18:16:00.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001519149 2024-09-17T18:16:00.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for blocked object", 2024-09-17T18:16:00.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725732+0000", 2024-09-17T18:16:00.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018853300000000001 2024-09-17T18:16:00.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.745290+0000", 2024-09-17T18:16:00.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019558507999999999 2024-09-17T18:16:00.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:00.636 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.745513+0000", 2024-09-17T18:16:00.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022266500000000001 2024-09-17T18:16:00.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.636 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.636 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.745783+0000", 2024-09-17T18:16:00.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00026986799999999999 2024-09-17T18:16:00.637 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.637 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.637 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.637 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:284 3.2s0 3:45e539c6:::smithi15432074-16:head [append 0~0] snapc 6=[6,5,4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T18:16:00.637 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:34.763530+0000", 2024-09-17T18:16:00.637 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.850625963999999, 2024-09-17T18:16:00.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010130172, 2024-09-17T18:16:00.637 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.637 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.637 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:00.637 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:00.638 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:00.638 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:00.638 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 284 2024-09-17T18:16:00.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.638 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763530+0000", 2024-09-17T18:16:00.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763530+0000", 2024-09-17T18:16:00.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763532+0000", 2024-09-17T18:16:00.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.441e-06 2024-09-17T18:16:00.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.640 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763542+0000", 2024-09-17T18:16:00.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1740000000000006e-06 2024-09-17T18:16:00.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763567+0000", 2024-09-17T18:16:00.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5664999999999999e-05 2024-09-17T18:16:00.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.641 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763579+0000", 2024-09-17T18:16:00.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1620000000000001e-05 2024-09-17T18:16:00.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.641 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763686+0000", 2024-09-17T18:16:00.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000107191 2024-09-17T18:16:00.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:00.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763820+0000", 2024-09-17T18:16:00.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013402600000000001 2024-09-17T18:16:00.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.642 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.642 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.764795+0000", 2024-09-17T18:16:00.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00097536200000000002 2024-09-17T18:16:00.642 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.769093+0000", 2024-09-17T18:16:00.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0042973430000000003 2024-09-17T18:16:00.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:00.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.773559+0000", 2024-09-17T18:16:00.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0044660000000000004 2024-09-17T18:16:00.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.773660+0000", 2024-09-17T18:16:00.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010135 2024-09-17T18:16:00.644 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.645 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.645 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.645 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.645 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.645 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:285 3.2s0 3:45e539c6:::smithi15432074-16:head [rollback 6] snapc 6=[6,5,4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T18:16:00.645 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:34.763617+0000", 2024-09-17T18:16:00.645 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.850538837999999, 2024-09-17T18:16:00.645 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0122197, 2024-09-17T18:16:00.645 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.645 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.645 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:00.646 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:00.646 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:00.646 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:00.646 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 285 2024-09-17T18:16:00.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.646 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763617+0000", 2024-09-17T18:16:00.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763617+0000", 2024-09-17T18:16:00.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763618+0000", 2024-09-17T18:16:00.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5799999999999998e-07 2024-09-17T18:16:00.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763622+0000", 2024-09-17T18:16:00.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0949999999999998e-06 2024-09-17T18:16:00.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.648 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763636+0000", 2024-09-17T18:16:00.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4297000000000001e-05 2024-09-17T18:16:00.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.648 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763644+0000", 2024-09-17T18:16:00.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7039999999999994e-06 2024-09-17T18:16:00.649 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.649 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.649 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.765578+0000", 2024-09-17T18:16:00.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001933733 2024-09-17T18:16:00.649 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.649 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.649 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:00.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.765683+0000", 2024-09-17T18:16:00.650 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105232 2024-09-17T18:16:00.650 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.650 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.650 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.766235+0000", 2024-09-17T18:16:00.650 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00055237199999999998 2024-09-17T18:16:00.650 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.650 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.651 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.769096+0000", 2024-09-17T18:16:00.651 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028609410000000001 2024-09-17T18:16:00.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.651 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:00.651 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.775767+0000", 2024-09-17T18:16:00.651 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0066707240000000003 2024-09-17T18:16:00.652 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.652 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.652 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.775837+0000", 2024-09-17T18:16:00.653 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9844000000000004e-05 2024-09-17T18:16:00.653 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.653 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.653 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.653 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.653 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:286 3.2s0 3:45e539c6:::smithi15432074-16:head [append 0~0] snapc 6=[6,5,4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T18:16:00.653 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:34.764140+0000", 2024-09-17T18:16:00.653 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 25.850015902999999, 2024-09-17T18:16:00.653 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011898921, 2024-09-17T18:16:00.653 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.653 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.653 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:00.654 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:00.654 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:00.654 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:00.654 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 286 2024-09-17T18:16:00.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.654 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.654 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.654 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.764140+0000", 2024-09-17T18:16:00.654 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.655 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.655 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.764140+0000", 2024-09-17T18:16:00.655 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.655 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.655 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.655 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.655 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.764141+0000", 2024-09-17T18:16:00.655 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.153e-06 2024-09-17T18:16:00.655 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.655 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.655 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.655 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.764159+0000", 2024-09-17T18:16:00.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7893999999999998e-05 2024-09-17T18:16:00.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.656 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.656 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.764178+0000", 2024-09-17T18:16:00.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9293999999999999e-05 2024-09-17T18:16:00.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.656 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.656 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.764190+0000", 2024-09-17T18:16:00.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1571e-05 2024-09-17T18:16:00.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.766852+0000", 2024-09-17T18:16:00.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026625189999999999 2024-09-17T18:16:00.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.657 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:00.657 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.767092+0000", 2024-09-17T18:16:00.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000239588 2024-09-17T18:16:00.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.768435+0000", 2024-09-17T18:16:00.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0013428120000000001 2024-09-17T18:16:00.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.769945+0000", 2024-09-17T18:16:00.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015097820000000001 2024-09-17T18:16:00.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.660 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:00.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.775972+0000", 2024-09-17T18:16:00.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0060274079999999997 2024-09-17T18:16:00.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.776039+0000", 2024-09-17T18:16:00.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.69e-05 2024-09-17T18:16:00.661 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.661 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.661 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.662 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 42/31 ECSubWrite(tid=87, reqid=client.4565.0:358, at_version=42'26, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:00.662 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.771744+0000", 2024-09-17T18:16:00.662 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.842411998999999, 2024-09-17T18:16:00.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015670561, 2024-09-17T18:16:00.662 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.663 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.663 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.663 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.663 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.663 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771744+0000", 2024-09-17T18:16:00.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771744+0000", 2024-09-17T18:16:00.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771746+0000", 2024-09-17T18:16:00.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.81e-06 2024-09-17T18:16:00.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771798+0000", 2024-09-17T18:16:00.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2142999999999999e-05 2024-09-17T18:16:00.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771824+0000", 2024-09-17T18:16:00.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6052999999999999e-05 2024-09-17T18:16:00.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771853+0000", 2024-09-17T18:16:00.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8716000000000001e-05 2024-09-17T18:16:00.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.667 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773108+0000", 2024-09-17T18:16:00.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012554829999999999 2024-09-17T18:16:00.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773139+0000", 2024-09-17T18:16:00.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1003000000000001e-05 2024-09-17T18:16:00.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.786900+0000", 2024-09-17T18:16:00.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013761175 2024-09-17T18:16:00.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787415+0000", 2024-09-17T18:16:00.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00051417800000000001 2024-09-17T18:16:00.669 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.669 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.669 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.670 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 42/31 ECSubWrite(tid=88, reqid=client.4565.0:344, at_version=42'22, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:00.670 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.771934+0000", 2024-09-17T18:16:00.670 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.842222145000001, 2024-09-17T18:16:00.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011170889999999999, 2024-09-17T18:16:00.670 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.670 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.671 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.671 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.671 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.671 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.671 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771934+0000", 2024-09-17T18:16:00.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.671 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.671 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.671 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.671 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771934+0000", 2024-09-17T18:16:00.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.672 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771935+0000", 2024-09-17T18:16:00.672 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.167e-06 2024-09-17T18:16:00.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.672 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.672 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.672 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771989+0000", 2024-09-17T18:16:00.672 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3582000000000003e-05 2024-09-17T18:16:00.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772014+0000", 2024-09-17T18:16:00.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5531999999999999e-05 2024-09-17T18:16:00.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.673 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772038+0000", 2024-09-17T18:16:00.673 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3730000000000001e-05 2024-09-17T18:16:00.673 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.673 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.673 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773242+0000", 2024-09-17T18:16:00.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012045739999999999 2024-09-17T18:16:00.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773266+0000", 2024-09-17T18:16:00.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3969999999999999e-05 2024-09-17T18:16:00.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.674 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.674 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.674 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783041+0000", 2024-09-17T18:16:00.674 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0097749729999999993 2024-09-17T18:16:00.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.675 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.675 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783105+0000", 2024-09-17T18:16:00.675 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3361999999999994e-05 2024-09-17T18:16:00.675 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.675 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.675 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.675 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.675 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.675 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 42/31 ECSubWrite(tid=89, reqid=client.4565.0:345, at_version=42'23, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:00.675 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.773988+0000", 2024-09-17T18:16:00.676 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.840167836999999, 2024-09-17T18:16:00.676 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013188996, 2024-09-17T18:16:00.676 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.676 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.676 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.676 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.676 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.676 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.676 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773988+0000", 2024-09-17T18:16:00.677 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.677 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.677 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.677 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.677 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773988+0000", 2024-09-17T18:16:00.677 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.677 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.677 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.677 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.677 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773990+0000", 2024-09-17T18:16:00.677 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8360000000000001e-06 2024-09-17T18:16:00.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774050+0000", 2024-09-17T18:16:00.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9735999999999999e-05 2024-09-17T18:16:00.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.678 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.678 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774085+0000", 2024-09-17T18:16:00.678 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5031999999999999e-05 2024-09-17T18:16:00.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.678 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.679 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774108+0000", 2024-09-17T18:16:00.679 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3067000000000001e-05 2024-09-17T18:16:00.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.679 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.680 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775952+0000", 2024-09-17T18:16:00.680 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018443450000000001 2024-09-17T18:16:00.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.680 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.680 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775975+0000", 2024-09-17T18:16:00.681 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2793e-05 2024-09-17T18:16:00.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.681 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.681 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.681 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.786570+0000", 2024-09-17T18:16:00.682 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010595099 2024-09-17T18:16:00.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.682 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.682 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.682 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787177+0000", 2024-09-17T18:16:00.683 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00060708799999999999 2024-09-17T18:16:00.683 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.683 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.683 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.684 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 42/31 ECSubWrite(tid=90, reqid=client.4565.0:359, at_version=42'27, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:00.684 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.774176+0000", 2024-09-17T18:16:00.684 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.839979831000001, 2024-09-17T18:16:00.684 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013323531, 2024-09-17T18:16:00.684 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.685 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.685 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.685 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.685 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774176+0000", 2024-09-17T18:16:00.686 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.686 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.686 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.686 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774176+0000", 2024-09-17T18:16:00.687 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.687 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.687 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.687 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774177+0000", 2024-09-17T18:16:00.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2270000000000001e-06 2024-09-17T18:16:00.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.688 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.688 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.688 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774218+0000", 2024-09-17T18:16:00.688 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0448999999999998e-05 2024-09-17T18:16:00.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.689 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.689 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.689 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774241+0000", 2024-09-17T18:16:00.689 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3646e-05 2024-09-17T18:16:00.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.690 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.690 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.690 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774265+0000", 2024-09-17T18:16:00.690 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4012999999999999e-05 2024-09-17T18:16:00.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.691 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.691 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.691 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.777483+0000", 2024-09-17T18:16:00.691 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00321712 2024-09-17T18:16:00.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.692 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.692 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.692 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.777498+0000", 2024-09-17T18:16:00.692 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5566e-05 2024-09-17T18:16:00.692 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.693 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.693 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.693 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787425+0000", 2024-09-17T18:16:00.693 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0099264049999999993 2024-09-17T18:16:00.693 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.694 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.694 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787500+0000", 2024-09-17T18:16:00.694 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5104999999999993e-05 2024-09-17T18:16:00.694 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.694 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.695 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.695 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.695 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.695 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 42/31 ECSubWrite(tid=92, reqid=client.4565.0:360, at_version=42'28, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:00.695 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775679+0000", 2024-09-17T18:16:00.696 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.838477389000001, 2024-09-17T18:16:00.696 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011913399999999999, 2024-09-17T18:16:00.696 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.696 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.696 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.697 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.697 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.697 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.697 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775679+0000", 2024-09-17T18:16:00.697 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.698 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.698 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.698 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775679+0000", 2024-09-17T18:16:00.698 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.699 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.699 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.699 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775680+0000", 2024-09-17T18:16:00.699 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9e-06 2024-09-17T18:16:00.699 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.700 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.700 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.700 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775741+0000", 2024-09-17T18:16:00.700 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0992000000000002e-05 2024-09-17T18:16:00.700 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.701 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.701 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.701 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775774+0000", 2024-09-17T18:16:00.701 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2595999999999998e-05 2024-09-17T18:16:00.701 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.702 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.702 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.702 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775796+0000", 2024-09-17T18:16:00.702 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1469999999999999e-05 2024-09-17T18:16:00.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.703 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.703 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778960+0000", 2024-09-17T18:16:00.703 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0031640510000000002 2024-09-17T18:16:00.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.703 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.704 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.704 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778981+0000", 2024-09-17T18:16:00.704 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1036e-05 2024-09-17T18:16:00.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.704 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.705 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.705 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787509+0000", 2024-09-17T18:16:00.705 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0085285199999999995 2024-09-17T18:16:00.705 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.705 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.706 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.706 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787592+0000", 2024-09-17T18:16:00.706 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2835000000000002e-05 2024-09-17T18:16:00.706 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.706 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.706 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.707 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 42/31 ECSubWrite(tid=91, reqid=client.4565.0:352, at_version=42'25, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:00.707 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775835+0000", 2024-09-17T18:16:00.707 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.838320909, 2024-09-17T18:16:00.707 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013769896, 2024-09-17T18:16:00.708 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.708 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.708 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.708 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.708 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775835+0000", 2024-09-17T18:16:00.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.709 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775835+0000", 2024-09-17T18:16:00.709 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.709 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775836+0000", 2024-09-17T18:16:00.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.04e-06 2024-09-17T18:16:00.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775890+0000", 2024-09-17T18:16:00.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4225999999999999e-05 2024-09-17T18:16:00.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.710 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.710 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775914+0000", 2024-09-17T18:16:00.710 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3646e-05 2024-09-17T18:16:00.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775932+0000", 2024-09-17T18:16:00.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8043e-05 2024-09-17T18:16:00.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776905+0000", 2024-09-17T18:16:00.711 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00097315499999999996 2024-09-17T18:16:00.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.711 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.711 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776926+0000", 2024-09-17T18:16:00.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1322999999999999e-05 2024-09-17T18:16:00.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789505+0000", 2024-09-17T18:16:00.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012578768000000001 2024-09-17T18:16:00.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.712 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.712 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789605+0000", 2024-09-17T18:16:00.712 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9695e-05 2024-09-17T18:16:00.712 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.713 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.713 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.713 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.cs6 42/31 ECSubWrite(tid=38, reqid=osd.5.0:38, at_version=42'19, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T18:16:00.713 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.776311+0000", 2024-09-17T18:16:00.713 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.837844787999998, 2024-09-17T18:16:00.713 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012039032, 2024-09-17T18:16:00.713 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.714 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.714 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.714 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776311+0000", 2024-09-17T18:16:00.714 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.714 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.714 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776311+0000", 2024-09-17T18:16:00.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776312+0000", 2024-09-17T18:16:00.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0399999999999996e-07 2024-09-17T18:16:00.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.715 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.715 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776369+0000", 2024-09-17T18:16:00.715 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7395000000000002e-05 2024-09-17T18:16:00.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776398+0000", 2024-09-17T18:16:00.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8736999999999999e-05 2024-09-17T18:16:00.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.716 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.716 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776437+0000", 2024-09-17T18:16:00.716 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9261999999999998e-05 2024-09-17T18:16:00.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776999+0000", 2024-09-17T18:16:00.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0005622 2024-09-17T18:16:00.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.717 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.717 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.777021+0000", 2024-09-17T18:16:00.717 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1875999999999999e-05 2024-09-17T18:16:00.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788258+0000", 2024-09-17T18:16:00.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.01123652 2024-09-17T18:16:00.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.718 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.718 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788350+0000", 2024-09-17T18:16:00.718 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2437999999999998e-05 2024-09-17T18:16:00.718 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.719 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.719 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.719 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 42/31 ECSubWrite(tid=94, reqid=client.4565.0:353, at_version=42'26, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:00.719 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779073+0000", 2024-09-17T18:16:00.719 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.835082476, 2024-09-17T18:16:00.719 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013251409, 2024-09-17T18:16:00.719 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.719 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.719 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.719 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779073+0000", 2024-09-17T18:16:00.720 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.720 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.720 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779073+0000", 2024-09-17T18:16:00.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779075+0000", 2024-09-17T18:16:00.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.734e-06 2024-09-17T18:16:00.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.721 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.721 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779118+0000", 2024-09-17T18:16:00.721 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2719000000000002e-05 2024-09-17T18:16:00.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779145+0000", 2024-09-17T18:16:00.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6740000000000001e-05 2024-09-17T18:16:00.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.722 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.722 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779166+0000", 2024-09-17T18:16:00.722 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1029000000000001e-05 2024-09-17T18:16:00.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783908+0000", 2024-09-17T18:16:00.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047425669999999996 2024-09-17T18:16:00.723 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.723 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.723 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.723 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783931+0000", 2024-09-17T18:16:00.723 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2484e-05 2024-09-17T18:16:00.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792232+0000", 2024-09-17T18:16:00.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0083012639999999992 2024-09-17T18:16:00.724 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.724 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.724 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.724 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792325+0000", 2024-09-17T18:16:00.724 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2872000000000001e-05 2024-09-17T18:16:00.724 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.724 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.724 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.725 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 42/31 ECSubWrite(tid=93, reqid=osd.4.0:93, at_version=42'30, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:00.725 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779203+0000", 2024-09-17T18:16:00.725 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.834952968, 2024-09-17T18:16:00.725 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0099596730000000005, 2024-09-17T18:16:00.725 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.725 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.725 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.725 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.725 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779203+0000", 2024-09-17T18:16:00.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.726 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.726 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.726 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.726 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779203+0000", 2024-09-17T18:16:00.726 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779204+0000", 2024-09-17T18:16:00.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0529999999999999e-06 2024-09-17T18:16:00.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.727 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779285+0000", 2024-09-17T18:16:00.727 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1372000000000006e-05 2024-09-17T18:16:00.727 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.727 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.727 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779312+0000", 2024-09-17T18:16:00.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6143e-05 2024-09-17T18:16:00.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779330+0000", 2024-09-17T18:16:00.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8369e-05 2024-09-17T18:16:00.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.728 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.728 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.728 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779487+0000", 2024-09-17T18:16:00.728 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000156787 2024-09-17T18:16:00.728 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779507+0000", 2024-09-17T18:16:00.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0259999999999999e-05 2024-09-17T18:16:00.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.729 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789100+0000", 2024-09-17T18:16:00.729 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0095926870000000008 2024-09-17T18:16:00.729 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.729 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.729 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.730 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789163+0000", 2024-09-17T18:16:00.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3002000000000004e-05 2024-09-17T18:16:00.730 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.730 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.730 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.730 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.730 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.730 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 42/31 ECSubWrite(tid=95, reqid=client.4565.0:354, at_version=42'27, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:00.730 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779371+0000", 2024-09-17T18:16:00.730 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.834784578000001, 2024-09-17T18:16:00.730 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013017299, 2024-09-17T18:16:00.730 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.730 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.731 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.731 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779371+0000", 2024-09-17T18:16:00.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.731 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.731 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.731 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779371+0000", 2024-09-17T18:16:00.731 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.731 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779372+0000", 2024-09-17T18:16:00.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.017e-06 2024-09-17T18:16:00.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.732 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.732 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.732 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779414+0000", 2024-09-17T18:16:00.732 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1862e-05 2024-09-17T18:16:00.732 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779436+0000", 2024-09-17T18:16:00.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1946e-05 2024-09-17T18:16:00.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779452+0000", 2024-09-17T18:16:00.733 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6263999999999999e-05 2024-09-17T18:16:00.733 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.733 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.733 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.733 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785966+0000", 2024-09-17T18:16:00.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0065139439999999998 2024-09-17T18:16:00.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785990+0000", 2024-09-17T18:16:00.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3598999999999999e-05 2024-09-17T18:16:00.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.734 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.734 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792332+0000", 2024-09-17T18:16:00.734 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0063415720000000002 2024-09-17T18:16:00.734 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.734 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.735 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.735 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792389+0000", 2024-09-17T18:16:00.735 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7095000000000001e-05 2024-09-17T18:16:00.735 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.735 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.735 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.735 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.735 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.735 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 42/31 ECSubWrite(tid=96, reqid=osd.4.0:96, at_version=42'32, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:00.735 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779902+0000", 2024-09-17T18:16:00.735 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 22.834254068, 2024-09-17T18:16:00.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011419632000000001, 2024-09-17T18:16:00.736 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.736 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.736 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.736 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.736 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.736 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779902+0000", 2024-09-17T18:16:00.736 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.736 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.736 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.737 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779902+0000", 2024-09-17T18:16:00.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.737 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779903+0000", 2024-09-17T18:16:00.737 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1930000000000001e-06 2024-09-17T18:16:00.737 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.737 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.737 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779942+0000", 2024-09-17T18:16:00.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9276999999999997e-05 2024-09-17T18:16:00.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.738 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779971+0000", 2024-09-17T18:16:00.738 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8319000000000001e-05 2024-09-17T18:16:00.738 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.738 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.738 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779989+0000", 2024-09-17T18:16:00.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8519999999999999e-05 2024-09-17T18:16:00.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.739 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785112+0000", 2024-09-17T18:16:00.739 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0051225869999999996 2024-09-17T18:16:00.739 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.739 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.739 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785135+0000", 2024-09-17T18:16:00.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3289e-05 2024-09-17T18:16:00.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.791216+0000", 2024-09-17T18:16:00.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.006080523 2024-09-17T18:16:00.740 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.740 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.740 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.740 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.791322+0000", 2024-09-17T18:16:00.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105924 2024-09-17T18:16:00.741 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.741 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.741 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.741 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 43/31 ECSubWrite(tid=105, reqid=osd.4.0:105, at_version=43'38, trim_to=0'0, roll_forward_to=42'34))", 2024-09-17T18:16:00.741 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.770201+0000", 2024-09-17T18:16:00.741 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.843954847999999, 2024-09-17T18:16:00.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013112386, 2024-09-17T18:16:00.741 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.742 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.742 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.742 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770201+0000", 2024-09-17T18:16:00.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770201+0000", 2024-09-17T18:16:00.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770203+0000", 2024-09-17T18:16:00.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3969999999999999e-06 2024-09-17T18:16:00.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770256+0000", 2024-09-17T18:16:00.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3615000000000001e-05 2024-09-17T18:16:00.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770288+0000", 2024-09-17T18:16:00.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.218e-05 2024-09-17T18:16:00.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770310+0000", 2024-09-17T18:16:00.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1386000000000002e-05 2024-09-17T18:16:00.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.771914+0000", 2024-09-17T18:16:00.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001604556 2024-09-17T18:16:00.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.771940+0000", 2024-09-17T18:16:00.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5514999999999999e-05 2024-09-17T18:16:00.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.783201+0000", 2024-09-17T18:16:00.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011260983 2024-09-17T18:16:00.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.783313+0000", 2024-09-17T18:16:00.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000112754 2024-09-17T18:16:00.746 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.747 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.747 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.747 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.fs3 43/31 ECSubWrite(tid=182, reqid=osd.13.0:182, at_version=43'14, trim_to=0'0, roll_forward_to=42'12))", 2024-09-17T18:16:00.747 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.776175+0000", 2024-09-17T18:16:00.747 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.837980715, 2024-09-17T18:16:00.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010822146, 2024-09-17T18:16:00.747 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.747 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.747 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.747 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776175+0000", 2024-09-17T18:16:00.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776175+0000", 2024-09-17T18:16:00.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776176+0000", 2024-09-17T18:16:00.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4000000000000002e-07 2024-09-17T18:16:00.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776230+0000", 2024-09-17T18:16:00.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4106e-05 2024-09-17T18:16:00.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776261+0000", 2024-09-17T18:16:00.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0945000000000003e-05 2024-09-17T18:16:00.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776284+0000", 2024-09-17T18:16:00.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3617000000000001e-05 2024-09-17T18:16:00.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.750 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776446+0000", 2024-09-17T18:16:00.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000161383 2024-09-17T18:16:00.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776470+0000", 2024-09-17T18:16:00.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4309999999999999e-05 2024-09-17T18:16:00.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.786910+0000", 2024-09-17T18:16:00.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010439834 2024-09-17T18:16:00.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.786997+0000", 2024-09-17T18:16:00.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7410999999999994e-05 2024-09-17T18:16:00.752 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.752 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.752 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.752 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s1 43/31 ECSubWrite(tid=20, reqid=osd.0.0:20, at_version=43'12, trim_to=0'0, roll_forward_to=35'10))", 2024-09-17T18:16:00.752 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.779487+0000", 2024-09-17T18:16:00.753 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.834669107, 2024-09-17T18:16:00.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0098483689999999992, 2024-09-17T18:16:00.753 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.753 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.753 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.753 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779487+0000", 2024-09-17T18:16:00.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779487+0000", 2024-09-17T18:16:00.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779488+0000", 2024-09-17T18:16:00.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0999999999999997e-07 2024-09-17T18:16:00.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779545+0000", 2024-09-17T18:16:00.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7076e-05 2024-09-17T18:16:00.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779575+0000", 2024-09-17T18:16:00.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0096000000000001e-05 2024-09-17T18:16:00.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779598+0000", 2024-09-17T18:16:00.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3453000000000001e-05 2024-09-17T18:16:00.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.756 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.756 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779781+0000", 2024-09-17T18:16:00.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018308899999999999 2024-09-17T18:16:00.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.756 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.756 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779805+0000", 2024-09-17T18:16:00.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4026e-05 2024-09-17T18:16:00.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.789249+0000", 2024-09-17T18:16:00.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0094439009999999993 2024-09-17T18:16:00.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.789335+0000", 2024-09-17T18:16:00.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5817999999999997e-05 2024-09-17T18:16:00.757 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.757 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.758 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.758 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 43/31 ECSubWrite(tid=110, reqid=osd.4.0:110, at_version=43'42, trim_to=0'0, roll_forward_to=43'38))", 2024-09-17T18:16:00.758 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.788583+0000", 2024-09-17T18:16:00.758 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.825572653000002, 2024-09-17T18:16:00.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0095213190000000003, 2024-09-17T18:16:00.758 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:00.758 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:00.759 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:00.759 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:00.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:00.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788583+0000", 2024-09-17T18:16:00.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:00.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788583+0000", 2024-09-17T18:16:00.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:00.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:00.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788593+0000", 2024-09-17T18:16:00.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2730000000000008e-06 2024-09-17T18:16:00.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:00.761 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788644+0000", 2024-09-17T18:16:00.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1439e-05 2024-09-17T18:16:00.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:00.761 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788675+0000", 2024-09-17T18:16:00.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0942000000000003e-05 2024-09-17T18:16:00.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:00.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.788696+0000", 2024-09-17T18:16:00.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1387e-05 2024-09-17T18:16:00.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:00.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.790358+0000", 2024-09-17T18:16:00.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001661764 2024-09-17T18:16:00.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:00.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.790382+0000", 2024-09-17T18:16:00.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4266000000000001e-05 2024-09-17T18:16:00.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:00.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.797988+0000", 2024-09-17T18:16:00.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0076055369999999999 2024-09-17T18:16:00.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:00.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:00.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:00.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.798105+0000", 2024-09-17T18:16:00.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000116711 2024-09-17T18:16:00.764 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.764 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.764 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.764 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:00.764 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:00.764 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:00.766 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T18:16:00.766 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:00.762+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:00.867 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:00.866+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:00.893 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:00.893 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:00.893 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T18:16:00.894 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:00.907 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T18:16:00.968 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:00.966+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:01.032 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:01.033 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:01.033 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T18:16:01.033 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T18:16:01.033 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:01.046 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T18:16:01.069 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:01.066+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:01.161 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T18:16:01.168 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:01.168 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T18:16:01.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T18:16:01.168 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T18:16:01.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.169 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s6 42/31 ECSubWrite(tid=40, reqid=client.4565.0:363, at_version=42'26, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:16:01.169 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:37.766681+0000", 2024-09-17T18:16:01.169 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.398982904, 2024-09-17T18:16:01.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084439879999999995, 2024-09-17T18:16:01.169 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.169 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.169 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.169 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766681+0000", 2024-09-17T18:16:01.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766681+0000", 2024-09-17T18:16:01.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766682+0000", 2024-09-17T18:16:01.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.06e-07 2024-09-17T18:16:01.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766724+0000", 2024-09-17T18:16:01.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1882999999999999e-05 2024-09-17T18:16:01.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766749+0000", 2024-09-17T18:16:01.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5157e-05 2024-09-17T18:16:01.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766756+0000", 2024-09-17T18:16:01.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3610000000000003e-06 2024-09-17T18:16:01.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766820+0000", 2024-09-17T18:16:01.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4313999999999994e-05 2024-09-17T18:16:01.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766834+0000", 2024-09-17T18:16:01.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3346999999999999e-05 2024-09-17T18:16:01.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.775060+0000", 2024-09-17T18:16:01.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082263920000000008 2024-09-17T18:16:01.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.775125+0000", 2024-09-17T18:16:01.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4827999999999997e-05 2024-09-17T18:16:01.173 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.173 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.173 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.173 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.fs1 43/31 ECSubWrite(tid=182, reqid=osd.13.0:182, at_version=43'14, trim_to=0'0, roll_forward_to=42'12))", 2024-09-17T18:16:01.173 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.775559+0000", 2024-09-17T18:16:01.173 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.390104415, 2024-09-17T18:16:01.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0080031730000000006, 2024-09-17T18:16:01.174 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.174 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.174 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.174 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775559+0000", 2024-09-17T18:16:01.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775559+0000", 2024-09-17T18:16:01.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775560+0000", 2024-09-17T18:16:01.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0999999999999998e-07 2024-09-17T18:16:01.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775634+0000", 2024-09-17T18:16:01.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4357999999999995e-05 2024-09-17T18:16:01.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775672+0000", 2024-09-17T18:16:01.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7595999999999997e-05 2024-09-17T18:16:01.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775696+0000", 2024-09-17T18:16:01.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3652999999999999e-05 2024-09-17T18:16:01.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775930+0000", 2024-09-17T18:16:01.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023461099999999999 2024-09-17T18:16:01.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.775959+0000", 2024-09-17T18:16:01.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9229000000000001e-05 2024-09-17T18:16:01.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.783468+0000", 2024-09-17T18:16:01.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075087779999999998 2024-09-17T18:16:01.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.783563+0000", 2024-09-17T18:16:01.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4338000000000004e-05 2024-09-17T18:16:01.178 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.178 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.178 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.178 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 43/31 ECSubWrite(tid=135, reqid=osd.6.0:135, at_version=43'19, trim_to=0'0, roll_forward_to=42'17))", 2024-09-17T18:16:01.179 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.777285+0000", 2024-09-17T18:16:01.179 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.388378995, 2024-09-17T18:16:01.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090781219999999992, 2024-09-17T18:16:01.179 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.179 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.179 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.179 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777285+0000", 2024-09-17T18:16:01.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777285+0000", 2024-09-17T18:16:01.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777285+0000", 2024-09-17T18:16:01.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4000000000000002e-07 2024-09-17T18:16:01.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777344+0000", 2024-09-17T18:16:01.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8978999999999999e-05 2024-09-17T18:16:01.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777376+0000", 2024-09-17T18:16:01.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1532999999999998e-05 2024-09-17T18:16:01.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777398+0000", 2024-09-17T18:16:01.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2541999999999999e-05 2024-09-17T18:16:01.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777568+0000", 2024-09-17T18:16:01.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016965900000000001 2024-09-17T18:16:01.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777594+0000", 2024-09-17T18:16:01.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5732999999999999e-05 2024-09-17T18:16:01.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786283+0000", 2024-09-17T18:16:01.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086891280000000008 2024-09-17T18:16:01.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786363+0000", 2024-09-17T18:16:01.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0007999999999997e-05 2024-09-17T18:16:01.183 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.183 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.184 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 43/31 ECSubWrite(tid=136, reqid=osd.6.0:136, at_version=43'21, trim_to=0'0, roll_forward_to=42'17))", 2024-09-17T18:16:01.185 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.779871+0000", 2024-09-17T18:16:01.185 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.385792366, 2024-09-17T18:16:01.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010748845999999999, 2024-09-17T18:16:01.185 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.185 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.185 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.185 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779871+0000", 2024-09-17T18:16:01.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779871+0000", 2024-09-17T18:16:01.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779873+0000", 2024-09-17T18:16:01.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9860000000000001e-06 2024-09-17T18:16:01.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779952+0000", 2024-09-17T18:16:01.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8191999999999999e-05 2024-09-17T18:16:01.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779981+0000", 2024-09-17T18:16:01.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9675e-05 2024-09-17T18:16:01.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.780002+0000", 2024-09-17T18:16:01.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0713999999999999e-05 2024-09-17T18:16:01.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.780164+0000", 2024-09-17T18:16:01.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000161559 2024-09-17T18:16:01.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.780189+0000", 2024-09-17T18:16:01.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5539000000000001e-05 2024-09-17T18:16:01.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790548+0000", 2024-09-17T18:16:01.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010358590000000001 2024-09-17T18:16:01.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790620+0000", 2024-09-17T18:16:01.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2590999999999997e-05 2024-09-17T18:16:01.189 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.189 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.189 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.190 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.2s1 43/31 ECSubWrite(tid=22, reqid=osd.14.0:22, at_version=43'18, trim_to=0'0, roll_forward_to=42'16))", 2024-09-17T18:16:01.190 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.785984+0000", 2024-09-17T18:16:01.190 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.379679472999999, 2024-09-17T18:16:01.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010839348, 2024-09-17T18:16:01.190 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.190 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.190 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.190 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785984+0000", 2024-09-17T18:16:01.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785984+0000", 2024-09-17T18:16:01.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785985+0000", 2024-09-17T18:16:01.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-07 2024-09-17T18:16:01.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786040+0000", 2024-09-17T18:16:01.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4694999999999997e-05 2024-09-17T18:16:01.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786073+0000", 2024-09-17T18:16:01.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3328999999999999e-05 2024-09-17T18:16:01.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786096+0000", 2024-09-17T18:16:01.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2643e-05 2024-09-17T18:16:01.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786277+0000", 2024-09-17T18:16:01.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000181669 2024-09-17T18:16:01.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786303+0000", 2024-09-17T18:16:01.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6149e-05 2024-09-17T18:16:01.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796720+0000", 2024-09-17T18:16:01.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010416752 2024-09-17T18:16:01.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796824+0000", 2024-09-17T18:16:01.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103491 2024-09-17T18:16:01.194 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.195 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.195 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.195 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.2s1 43/31 ECSubWrite(tid=23, reqid=osd.14.0:23, at_version=43'20, trim_to=0'0, roll_forward_to=42'16))", 2024-09-17T18:16:01.195 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.788662+0000", 2024-09-17T18:16:01.196 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.377001564, 2024-09-17T18:16:01.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096349590000000002, 2024-09-17T18:16:01.196 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.196 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.196 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.196 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788662+0000", 2024-09-17T18:16:01.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788662+0000", 2024-09-17T18:16:01.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788664+0000", 2024-09-17T18:16:01.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9240000000000001e-06 2024-09-17T18:16:01.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788715+0000", 2024-09-17T18:16:01.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1028e-05 2024-09-17T18:16:01.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788749+0000", 2024-09-17T18:16:01.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3358999999999997e-05 2024-09-17T18:16:01.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788771+0000", 2024-09-17T18:16:01.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1943999999999999e-05 2024-09-17T18:16:01.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790286+0000", 2024-09-17T18:16:01.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015151819999999999 2024-09-17T18:16:01.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790299+0000", 2024-09-17T18:16:01.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3302000000000001e-05 2024-09-17T18:16:01.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.798203+0000", 2024-09-17T18:16:01.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079036650000000007 2024-09-17T18:16:01.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.798297+0000", 2024-09-17T18:16:01.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4555000000000005e-05 2024-09-17T18:16:01.203 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.203 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.204 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.204 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.fs1 43/31 ECSubWrite(tid=186, reqid=osd.13.0:182, at_version=0'0, trim_to=0'0, roll_forward_to=43'14))", 2024-09-17T18:16:01.204 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.789109+0000", 2024-09-17T18:16:01.204 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.376554888000001, 2024-09-17T18:16:01.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0077309220000000003, 2024-09-17T18:16:01.204 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.204 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.204 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.204 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789109+0000", 2024-09-17T18:16:01.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789109+0000", 2024-09-17T18:16:01.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789111+0000", 2024-09-17T18:16:01.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.57e-06 2024-09-17T18:16:01.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789133+0000", 2024-09-17T18:16:01.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2552999999999999e-05 2024-09-17T18:16:01.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789159+0000", 2024-09-17T18:16:01.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6156000000000002e-05 2024-09-17T18:16:01.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789178+0000", 2024-09-17T18:16:01.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8692e-05 2024-09-17T18:16:01.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789376+0000", 2024-09-17T18:16:01.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019766200000000001 2024-09-17T18:16:01.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789399+0000", 2024-09-17T18:16:01.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3430000000000001e-05 2024-09-17T18:16:01.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796725+0000", 2024-09-17T18:16:01.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007325776 2024-09-17T18:16:01.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796840+0000", 2024-09-17T18:16:01.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115083 2024-09-17T18:16:01.208 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.208 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.208 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.209 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs3 43/31 ECSubWrite(tid=44, reqid=osd.5.0:44, at_version=43'23, trim_to=0'0, roll_forward_to=42'21))", 2024-09-17T18:16:01.209 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.790263+0000", 2024-09-17T18:16:01.209 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.375400860999999, 2024-09-17T18:16:01.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088116389999999996, 2024-09-17T18:16:01.209 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.209 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.209 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.209 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790263+0000", 2024-09-17T18:16:01.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790263+0000", 2024-09-17T18:16:01.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790264+0000", 2024-09-17T18:16:01.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0399999999999996e-07 2024-09-17T18:16:01.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790322+0000", 2024-09-17T18:16:01.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8798999999999997e-05 2024-09-17T18:16:01.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790356+0000", 2024-09-17T18:16:01.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3172e-05 2024-09-17T18:16:01.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790379+0000", 2024-09-17T18:16:01.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3059000000000001e-05 2024-09-17T18:16:01.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790531+0000", 2024-09-17T18:16:01.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015204300000000001 2024-09-17T18:16:01.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790554+0000", 2024-09-17T18:16:01.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3445999999999999e-05 2024-09-17T18:16:01.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.799018+0000", 2024-09-17T18:16:01.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008464325 2024-09-17T18:16:01.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.799075+0000", 2024-09-17T18:16:01.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6190999999999998e-05 2024-09-17T18:16:01.215 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.215 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.215 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.215 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs3 43/31 ECSubWrite(tid=45, reqid=osd.5.0:45, at_version=43'25, trim_to=0'0, roll_forward_to=42'21))", 2024-09-17T18:16:01.215 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.790430+0000", 2024-09-17T18:16:01.215 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.375234018, 2024-09-17T18:16:01.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011985595999999999, 2024-09-17T18:16:01.215 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.215 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.215 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.215 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790430+0000", 2024-09-17T18:16:01.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790430+0000", 2024-09-17T18:16:01.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790431+0000", 2024-09-17T18:16:01.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0999999999999997e-07 2024-09-17T18:16:01.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790473+0000", 2024-09-17T18:16:01.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2178999999999997e-05 2024-09-17T18:16:01.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790494+0000", 2024-09-17T18:16:01.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1526e-05 2024-09-17T18:16:01.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790514+0000", 2024-09-17T18:16:01.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9222999999999999e-05 2024-09-17T18:16:01.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794972+0000", 2024-09-17T18:16:01.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044584150000000003 2024-09-17T18:16:01.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794996+0000", 2024-09-17T18:16:01.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4192000000000001e-05 2024-09-17T18:16:01.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.802330+0000", 2024-09-17T18:16:01.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073335029999999999 2024-09-17T18:16:01.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.802415+0000", 2024-09-17T18:16:01.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5648000000000004e-05 2024-09-17T18:16:01.219 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.219 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.219 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.220 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s6 43/31 ECSubWrite(tid=48, reqid=osd.7.0:48, at_version=43'36, trim_to=0'0, roll_forward_to=42'32))", 2024-09-17T18:16:01.220 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.791326+0000", 2024-09-17T18:16:01.220 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.3743379, 2024-09-17T18:16:01.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099638959999999999, 2024-09-17T18:16:01.220 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.220 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.220 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.220 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791326+0000", 2024-09-17T18:16:01.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791326+0000", 2024-09-17T18:16:01.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791327+0000", 2024-09-17T18:16:01.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0899999999999999e-06 2024-09-17T18:16:01.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791369+0000", 2024-09-17T18:16:01.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2462000000000001e-05 2024-09-17T18:16:01.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791394+0000", 2024-09-17T18:16:01.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4246000000000001e-05 2024-09-17T18:16:01.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791412+0000", 2024-09-17T18:16:01.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8556e-05 2024-09-17T18:16:01.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.795134+0000", 2024-09-17T18:16:01.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037219000000000002 2024-09-17T18:16:01.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.795157+0000", 2024-09-17T18:16:01.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3156e-05 2024-09-17T18:16:01.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.801210+0000", 2024-09-17T18:16:01.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060524250000000002 2024-09-17T18:16:01.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.801290+0000", 2024-09-17T18:16:01.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0061000000000005e-05 2024-09-17T18:16:01.224 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.224 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.224 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.225 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 53/31 ECSubWrite(tid=140, reqid=client.4565.0:458, at_version=53'25, trim_to=0'0, roll_forward_to=52'23))", 2024-09-17T18:16:01.225 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:48.377510+0000", 2024-09-17T18:16:01.225 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.788153647, 2024-09-17T18:16:01.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010092136, 2024-09-17T18:16:01.225 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.225 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.225 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.225 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.377510+0000", 2024-09-17T18:16:01.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.377510+0000", 2024-09-17T18:16:01.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.377511+0000", 2024-09-17T18:16:01.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9000000000000002e-07 2024-09-17T18:16:01.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.378388+0000", 2024-09-17T18:16:01.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00087706399999999999 2024-09-17T18:16:01.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.378430+0000", 2024-09-17T18:16:01.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2321999999999999e-05 2024-09-17T18:16:01.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.378456+0000", 2024-09-17T18:16:01.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6069999999999999e-05 2024-09-17T18:16:01.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.378704+0000", 2024-09-17T18:16:01.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000247944 2024-09-17T18:16:01.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.378730+0000", 2024-09-17T18:16:01.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5588999999999998e-05 2024-09-17T18:16:01.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.387499+0000", 2024-09-17T18:16:01.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087697460000000001 2024-09-17T18:16:01.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.387602+0000", 2024-09-17T18:16:01.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010301099999999999 2024-09-17T18:16:01.229 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.229 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.229 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.229 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 53/31 ECSubWrite(tid=141, reqid=client.4565.0:459, at_version=53'26, trim_to=0'0, roll_forward_to=52'23))", 2024-09-17T18:16:01.230 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:48.383804+0000", 2024-09-17T18:16:01.230 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.781859419, 2024-09-17T18:16:01.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098318940000000007, 2024-09-17T18:16:01.230 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.230 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.230 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.230 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.383804+0000", 2024-09-17T18:16:01.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.383804+0000", 2024-09-17T18:16:01.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.383807+0000", 2024-09-17T18:16:01.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2139999999999999e-06 2024-09-17T18:16:01.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.384257+0000", 2024-09-17T18:16:01.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00044987800000000002 2024-09-17T18:16:01.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.384292+0000", 2024-09-17T18:16:01.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5225999999999998e-05 2024-09-17T18:16:01.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.384316+0000", 2024-09-17T18:16:01.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4116000000000001e-05 2024-09-17T18:16:01.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.384541+0000", 2024-09-17T18:16:01.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000224811 2024-09-17T18:16:01.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.384565+0000", 2024-09-17T18:16:01.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4732999999999999e-05 2024-09-17T18:16:01.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.393535+0000", 2024-09-17T18:16:01.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0089697749999999993 2024-09-17T18:16:01.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.393636+0000", 2024-09-17T18:16:01.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101141 2024-09-17T18:16:01.234 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.234 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.234 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.234 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.2s1 53/31 ECSubWrite(tid=29, reqid=client.4565.0:466, at_version=53'26, trim_to=0'0, roll_forward_to=52'24))", 2024-09-17T18:16:01.234 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:48.386195+0000", 2024-09-17T18:16:01.234 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.779468996, 2024-09-17T18:16:01.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007616383, 2024-09-17T18:16:01.235 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.235 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.235 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.235 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.386195+0000", 2024-09-17T18:16:01.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.386195+0000", 2024-09-17T18:16:01.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.386196+0000", 2024-09-17T18:16:01.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.395e-06 2024-09-17T18:16:01.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.386259+0000", 2024-09-17T18:16:01.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2787999999999996e-05 2024-09-17T18:16:01.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.386279+0000", 2024-09-17T18:16:01.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0250000000000001e-05 2024-09-17T18:16:01.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.386292+0000", 2024-09-17T18:16:01.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2928000000000001e-05 2024-09-17T18:16:01.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.386524+0000", 2024-09-17T18:16:01.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023201799999999999 2024-09-17T18:16:01.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.386549+0000", 2024-09-17T18:16:01.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5119000000000001e-05 2024-09-17T18:16:01.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.393710+0000", 2024-09-17T18:16:01.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0071602009999999997 2024-09-17T18:16:01.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.393811+0000", 2024-09-17T18:16:01.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101684 2024-09-17T18:16:01.239 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.239 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.239 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.239 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.as4 54/31 ECSubWrite(tid=276, reqid=client.4565.0:502, at_version=54'71, trim_to=0'0, roll_forward_to=52'68))", 2024-09-17T18:16:01.239 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.317044+0000", 2024-09-17T18:16:01.239 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.848619963999999, 2024-09-17T18:16:01.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091146730000000002, 2024-09-17T18:16:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.317044+0000", 2024-09-17T18:16:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.317044+0000", 2024-09-17T18:16:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.317044+0000", 2024-09-17T18:16:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.51e-07 2024-09-17T18:16:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.317189+0000", 2024-09-17T18:16:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014444800000000001 2024-09-17T18:16:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.317210+0000", 2024-09-17T18:16:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1107999999999998e-05 2024-09-17T18:16:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.317228+0000", 2024-09-17T18:16:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8368000000000001e-05 2024-09-17T18:16:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.318360+0000", 2024-09-17T18:16:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011315780000000001 2024-09-17T18:16:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.318382+0000", 2024-09-17T18:16:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2189999999999999e-05 2024-09-17T18:16:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.326053+0000", 2024-09-17T18:16:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076711890000000001 2024-09-17T18:16:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.326159+0000", 2024-09-17T18:16:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010534100000000001 2024-09-17T18:16:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs3 54/31 ECSubWrite(tid=83, reqid=osd.5.0:83, at_version=54'52, trim_to=0'0, roll_forward_to=53'48))", 2024-09-17T18:16:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.319696+0000", 2024-09-17T18:16:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.845967752, 2024-09-17T18:16:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086387070000000007, 2024-09-17T18:16:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319696+0000", 2024-09-17T18:16:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319696+0000", 2024-09-17T18:16:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319698+0000", 2024-09-17T18:16:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9599999999999999e-06 2024-09-17T18:16:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319751+0000", 2024-09-17T18:16:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2884999999999999e-05 2024-09-17T18:16:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319781+0000", 2024-09-17T18:16:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0383e-05 2024-09-17T18:16:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319809+0000", 2024-09-17T18:16:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7809000000000001e-05 2024-09-17T18:16:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.320756+0000", 2024-09-17T18:16:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00094677300000000004 2024-09-17T18:16:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.320781+0000", 2024-09-17T18:16:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5533000000000001e-05 2024-09-17T18:16:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328243+0000", 2024-09-17T18:16:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0074618319999999998 2024-09-17T18:16:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328335+0000", 2024-09-17T18:16:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1532000000000004e-05 2024-09-17T18:16:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 54/31 ECSubWrite(tid=147, reqid=osd.6.0:147, at_version=54'31, trim_to=0'0, roll_forward_to=53'28))", 2024-09-17T18:16:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.338852+0000", 2024-09-17T18:16:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.826811375, 2024-09-17T18:16:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090757890000000008, 2024-09-17T18:16:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.338852+0000", 2024-09-17T18:16:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.338852+0000", 2024-09-17T18:16:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.338854+0000", 2024-09-17T18:16:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6670000000000001e-06 2024-09-17T18:16:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.338908+0000", 2024-09-17T18:16:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3418000000000003e-05 2024-09-17T18:16:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.338934+0000", 2024-09-17T18:16:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6322999999999999e-05 2024-09-17T18:16:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339028+0000", 2024-09-17T18:16:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4374000000000001e-05 2024-09-17T18:16:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339201+0000", 2024-09-17T18:16:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017309199999999999 2024-09-17T18:16:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339227+0000", 2024-09-17T18:16:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5712999999999999e-05 2024-09-17T18:16:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.347835+0000", 2024-09-17T18:16:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086075890000000006 2024-09-17T18:16:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.347928+0000", 2024-09-17T18:16:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3613e-05 2024-09-17T18:16:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.as4 54/31 ECSubWrite(tid=283, reqid=osd.13.0:282, at_version=0'0, trim_to=0'0, roll_forward_to=54'77))", 2024-09-17T18:16:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.340508+0000", 2024-09-17T18:16:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.825155647000001, 2024-09-17T18:16:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086523469999999995, 2024-09-17T18:16:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.340508+0000", 2024-09-17T18:16:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.340508+0000", 2024-09-17T18:16:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.340511+0000", 2024-09-17T18:16:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5100000000000001e-06 2024-09-17T18:16:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.340538+0000", 2024-09-17T18:16:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7515999999999999e-05 2024-09-17T18:16:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.340572+0000", 2024-09-17T18:16:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3890000000000002e-05 2024-09-17T18:16:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.340595+0000", 2024-09-17T18:16:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2779e-05 2024-09-17T18:16:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.340921+0000", 2024-09-17T18:16:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000325738 2024-09-17T18:16:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.340945+0000", 2024-09-17T18:16:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4573e-05 2024-09-17T18:16:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.349065+0000", 2024-09-17T18:16:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0081196370000000007 2024-09-17T18:16:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.349161+0000", 2024-09-17T18:16:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5704000000000004e-05 2024-09-17T18:16:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s6 54/31 ECSubWrite(tid=78, reqid=osd.7.0:78, at_version=54'67, trim_to=0'0, roll_forward_to=53'63))", 2024-09-17T18:16:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.340951+0000", 2024-09-17T18:16:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.824712397999999, 2024-09-17T18:16:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083276919999999994, 2024-09-17T18:16:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.340951+0000", 2024-09-17T18:16:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.340951+0000", 2024-09-17T18:16:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.340953+0000", 2024-09-17T18:16:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0030000000000001e-06 2024-09-17T18:16:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341034+0000", 2024-09-17T18:16:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0068000000000007e-05 2024-09-17T18:16:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341070+0000", 2024-09-17T18:16:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6962999999999998e-05 2024-09-17T18:16:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341093+0000", 2024-09-17T18:16:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2646e-05 2024-09-17T18:16:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341338+0000", 2024-09-17T18:16:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024458699999999999 2024-09-17T18:16:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341409+0000", 2024-09-17T18:16:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1421999999999995e-05 2024-09-17T18:16:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.349181+0000", 2024-09-17T18:16:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0077716649999999996 2024-09-17T18:16:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.349279+0000", 2024-09-17T18:16:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8338000000000006e-05 2024-09-17T18:16:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.fs1 64/31 ECSubWrite(tid=399, reqid=client.4565.0:591, at_version=64'22, trim_to=0'0, roll_forward_to=61'20))", 2024-09-17T18:16:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:59.318306+0000", 2024-09-17T18:16:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.8473575950000001, 2024-09-17T18:16:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0077954110000000004, 2024-09-17T18:16:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:59.318306+0000", 2024-09-17T18:16:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:59.318306+0000", 2024-09-17T18:16:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:59.318308+0000", 2024-09-17T18:16:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.243e-06 2024-09-17T18:16:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:59.318366+0000", 2024-09-17T18:16:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7138000000000001e-05 2024-09-17T18:16:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:59.318411+0000", 2024-09-17T18:16:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5071999999999998e-05 2024-09-17T18:16:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:59.318435+0000", 2024-09-17T18:16:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3833e-05 2024-09-17T18:16:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:59.318615+0000", 2024-09-17T18:16:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018053899999999999 2024-09-17T18:16:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:59.318640+0000", 2024-09-17T18:16:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.455e-05 2024-09-17T18:16:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:59.325994+0000", 2024-09-17T18:16:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073540130000000004 2024-09-17T18:16:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:59.326102+0000", 2024-09-17T18:16:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010802300000000001 2024-09-17T18:16:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s6 65/31 ECSubWrite(tid=108, reqid=osd.7.0:108, at_version=65'99, trim_to=0'0, roll_forward_to=65'97))", 2024-09-17T18:16:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:00.341854+0000", 2024-09-17T18:16:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.82380961399999997, 2024-09-17T18:16:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007627577, 2024-09-17T18:16:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.341854+0000", 2024-09-17T18:16:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.341854+0000", 2024-09-17T18:16:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.341856+0000", 2024-09-17T18:16:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.297e-06 2024-09-17T18:16:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.341902+0000", 2024-09-17T18:16:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6152000000000001e-05 2024-09-17T18:16:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.341932+0000", 2024-09-17T18:16:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0023e-05 2024-09-17T18:16:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.342014+0000", 2024-09-17T18:16:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1947999999999995e-05 2024-09-17T18:16:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.342315+0000", 2024-09-17T18:16:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030116499999999999 2024-09-17T18:16:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.342340+0000", 2024-09-17T18:16:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5123e-05 2024-09-17T18:16:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.349443+0000", 2024-09-17T18:16:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0071029659999999996 2024-09-17T18:16:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.349482+0000", 2024-09-17T18:16:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8902999999999997e-05 2024-09-17T18:16:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:01.274 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:01.275 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T18:16:01.276 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:16:01.274+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:16:01.313 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.4 to 1 (10000) 2024-09-17T18:16:01.316 INFO:tasks.rados.rados.0.smithi154.stdout:233: done (1 left) 2024-09-17T18:16:01.317 INFO:tasks.rados.rados.0.smithi154.stdout:235: done (0 left) 2024-09-17T18:16:01.317 INFO:tasks.rados.rados.0.smithi154.stdout:236: read oid 18 snap -1 2024-09-17T18:16:01.317 INFO:tasks.rados.rados.0.smithi154.stdout:236: expect (ObjNum 5 snap 0 seq_num 5) 2024-09-17T18:16:01.317 INFO:tasks.rados.rados.0.smithi154.stdout:237: read oid 44 snap 14 2024-09-17T18:16:01.317 INFO:tasks.rados.rados.0.smithi154.stdout:237: expect (ObjNum 67 snap 5 seq_num 67) 2024-09-17T18:16:01.317 INFO:tasks.rados.rados.0.smithi154.stdout:238: read oid 50 snap 20 2024-09-17T18:16:01.317 INFO:tasks.rados.rados.0.smithi154.stdout:238: expect (ObjNum 101 snap 20 seq_num 101) 2024-09-17T18:16:01.317 INFO:tasks.rados.rados.0.smithi154.stdout:239: read oid 35 snap -1 2024-09-17T18:16:01.317 INFO:tasks.rados.rados.0.smithi154.stdout:239: expect (ObjNum 28 snap 0 seq_num 28) 2024-09-17T18:16:01.317 INFO:tasks.rados.rados.0.smithi154.stdout:240: read oid 15 snap -1 2024-09-17T18:16:01.317 INFO:tasks.rados.rados.0.smithi154.stdout:240: expect (ObjNum 92 snap 15 seq_num 92) 2024-09-17T18:16:01.317 INFO:tasks.rados.rados.0.smithi154.stdout:241: delete oid 26 current snap is 21 2024-09-17T18:16:01.318 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:16:01.318 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:16:01.320 INFO:tasks.rados.rados.0.smithi154.stdout:239: expect (ObjNum 28 snap 0 seq_num 28) 2024-09-17T18:16:01.322 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 267997 2024-09-17T18:16:01.329 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 458549 2024-09-17T18:16:01.331 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 202541 2024-09-17T18:16:01.335 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-17T18:16:01.337 INFO:tasks.rados.rados.0.smithi154.stdout:238: expect (ObjNum 101 snap 20 seq_num 101) 2024-09-17T18:16:01.341 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 639218 2024-09-17T18:16:01.346 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:16:01.346 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:16:01.367 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:16:01.367 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:16:01.375 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:16:01.375+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:16:01.387 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:16:01.387 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:16:01.405 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:16:01.405 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:16:01.406 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 2050151 2024-09-17T18:16:01.411 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:01.411 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:01.411 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T18:16:01.412 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:01.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T18:16:01.426 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:16:01.426 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:16:01.437 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 2070882 2024-09-17T18:16:01.446 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:16:01.446 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:16:01.451 INFO:tasks.rados.rados.0.smithi154.stdout:236: expect (ObjNum 5 snap 0 seq_num 5) 2024-09-17T18:16:01.451 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 59658 2024-09-17T18:16:01.452 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 45201 2024-09-17T18:16:01.453 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 64621 2024-09-17T18:16:01.453 INFO:tasks.rados.rados.0.smithi154.stdout:237: expect (ObjNum 67 snap 5 seq_num 67) 2024-09-17T18:16:01.453 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:01.467 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:16:01.467 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:16:01.469 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:01.476 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:01.473+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:01.483 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:16:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:16:01.484 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:01.499 INFO:tasks.rados.rados.0.smithi154.stdout:240: expect (ObjNum 92 snap 15 seq_num 92) 2024-09-17T18:16:01.503 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:16:01.504 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:16:01.504 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 836844 2024-09-17T18:16:01.511 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:01.524 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:16:01.525 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:16:01.525 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:01.542 INFO:tasks.rados.rados.0.smithi154.stdout:236: done (5 left) 2024-09-17T18:16:01.543 INFO:tasks.rados.rados.0.smithi154.stdout:237: done (4 left) 2024-09-17T18:16:01.543 INFO:tasks.rados.rados.0.smithi154.stdout:238: done (3 left) 2024-09-17T18:16:01.543 INFO:tasks.rados.rados.0.smithi154.stdout:239: done (2 left) 2024-09-17T18:16:01.543 INFO:tasks.rados.rados.0.smithi154.stdout:240: done (1 left) 2024-09-17T18:16:01.543 INFO:tasks.rados.rados.0.smithi154.stdout:241: done (0 left) 2024-09-17T18:16:01.543 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 3 current snap is 21 2024-09-17T18:16:01.543 INFO:tasks.rados.rados.0.smithi154.stdout:242: seq_num 104 ranges {0=589824,589824=540672,1130496=622592} 2024-09-17T18:16:01.544 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:16:01.544 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:16:01.552 INFO:tasks.rados.rados.0.smithi154.stdout:242: writing smithi15432074-3 from 0 to 589824 tid 1 2024-09-17T18:16:01.562 INFO:tasks.rados.rados.0.smithi154.stdout:242: writing smithi15432074-3 from 589824 to 1130496 tid 2 2024-09-17T18:16:01.562 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:01.562 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:01.565 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:16:01.565 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:16:01.574 INFO:tasks.rados.rados.0.smithi154.stdout:242: writing smithi15432074-3 from 1130496 to 1753088 tid 3 2024-09-17T18:16:01.574 INFO:tasks.rados.rados.0.smithi154.stdout:243: delete oid 42 current snap is 21 2024-09-17T18:16:01.574 INFO:tasks.rados.rados.0.smithi154.stdout:242: finishing write tid 1 to smithi15432074-3 2024-09-17T18:16:01.574 INFO:tasks.rados.rados.0.smithi154.stdout:242: finishing write tid 2 to smithi15432074-3 2024-09-17T18:16:01.577 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:16:01.574+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:16:01.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T18:16:01.581 INFO:tasks.rados.rados.0.smithi154.stdout:243: done (1 left) 2024-09-17T18:16:01.581 INFO:tasks.rados.rados.0.smithi154.stdout:244: delete oid 22 current snap is 21 2024-09-17T18:16:01.581 INFO:tasks.rados.rados.0.smithi154.stdout:242: finishing write tid 3 to smithi15432074-3 2024-09-17T18:16:01.583 INFO:tasks.rados.rados.0.smithi154.stdout:242: finishing write tid 4 to smithi15432074-3 2024-09-17T18:16:01.585 INFO:tasks.rados.rados.0.smithi154.stdout:242: finishing write tid 5 to smithi15432074-3 2024-09-17T18:16:01.585 INFO:tasks.rados.rados.0.smithi154.stdout:242: oid 3 updating version 0 to 11 2024-09-17T18:16:01.585 INFO:tasks.rados.rados.0.smithi154.stdout:242: oid 3 version 11 is already newer than 8 2024-09-17T18:16:01.585 INFO:tasks.rados.rados.0.smithi154.stdout:242: oid 3 version 11 is already newer than 9 2024-09-17T18:16:01.585 INFO:tasks.rados.rados.0.smithi154.stdout:242: oid 3 version 11 is already newer than 10 2024-09-17T18:16:01.586 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 3 v 11 (ObjNum 104 snap 21 seq_num 104) dirty exists 2024-09-17T18:16:01.586 INFO:tasks.rados.rados.0.smithi154.stdout:242: left oid 3 (ObjNum 104 snap 21 seq_num 104) 2024-09-17T18:16:01.588 INFO:tasks.rados.rados.0.smithi154.stdout:242: done (1 left) 2024-09-17T18:16:01.588 INFO:tasks.rados.rados.0.smithi154.stdout:244: done (0 left) 2024-09-17T18:16:01.588 INFO:tasks.rados.rados.0.smithi154.stdout:245: rollback oid 47 current snap is 21 2024-09-17T18:16:01.588 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 47 to 6 2024-09-17T18:16:01.588 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 25 current snap is 21 2024-09-17T18:16:01.588 INFO:tasks.rados.rados.0.smithi154.stdout:246: seq_num 107 ranges {0=638976,638976=458752,1097728=704512} 2024-09-17T18:16:01.589 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:16:01.589 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:16:01.592 INFO:tasks.rados.rados.0.smithi154.stdout:246: writing smithi15432074-25 from 0 to 638976 tid 1 2024-09-17T18:16:01.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:16:01.590+0000 7f78c27fc640 0 -- 172.21.15.87:0/2763920810 >> [v2:172.21.15.146:6808/950976813,v1:172.21.15.146:6809/950976813] conn(0x7f78c421f690 msgr2=0x7f78c4221a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T18:16:01.595 INFO:tasks.rados.rados.0.smithi154.stdout:246: writing smithi15432074-25 from 638976 to 1097728 tid 2 2024-09-17T18:16:01.600 INFO:tasks.rados.rados.0.smithi154.stdout:246: writing smithi15432074-25 from 1097728 to 1802240 tid 3 2024-09-17T18:16:01.600 INFO:tasks.rados.rados.0.smithi154.stdout:247: snap_create 2024-09-17T18:16:01.600 INFO:tasks.rados.rados.0.smithi154.stdout:245: finishing rollback tid 0 to smithi15432074-47 2024-09-17T18:16:01.600 INFO:tasks.rados.rados.0.smithi154.stdout:245: finishing rollback tid 1 to smithi15432074-47 2024-09-17T18:16:01.600 INFO:tasks.rados.rados.0.smithi154.stdout:245: finishing rollback tid 2 to smithi15432074-47 2024-09-17T18:16:01.601 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 47 v 48 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-17T18:16:01.601 INFO:tasks.rados.rados.0.smithi154.stdout:246: finishing write tid 1 to smithi15432074-25 2024-09-17T18:16:01.604 INFO:tasks.rados.rados.0.smithi154.stdout:246: finishing write tid 2 to smithi15432074-25 2024-09-17T18:16:01.605 INFO:tasks.rados.rados.0.smithi154.stdout:246: finishing write tid 3 to smithi15432074-25 2024-09-17T18:16:01.606 INFO:tasks.rados.rados.0.smithi154.stdout:246: finishing write tid 4 to smithi15432074-25 2024-09-17T18:16:01.609 INFO:tasks.rados.rados.0.smithi154.stdout:246: finishing write tid 5 to smithi15432074-25 2024-09-17T18:16:01.609 INFO:tasks.rados.rados.0.smithi154.stdout:246: oid 25 updating version 0 to 102 2024-09-17T18:16:01.609 INFO:tasks.rados.rados.0.smithi154.stdout:246: oid 25 version 102 is already newer than 100 2024-09-17T18:16:01.609 INFO:tasks.rados.rados.0.smithi154.stdout:246: oid 25 version 102 is already newer than 101 2024-09-17T18:16:01.609 INFO:tasks.rados.rados.0.smithi154.stdout:246: oid 25 updating version 102 to 103 2024-09-17T18:16:01.609 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 25 v 103 (ObjNum 107 snap 21 seq_num 107) dirty exists 2024-09-17T18:16:01.609 INFO:tasks.rados.rados.0.smithi154.stdout:246: left oid 25 (ObjNum 107 snap 21 seq_num 107) 2024-09-17T18:16:01.612 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:16:01.613 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:16:01.629 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:16:01.629 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:16:01.678 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:01.673+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:01.705 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:01.705 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:01.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T18:16:01.780 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:01.778+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:01.881 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:01.877+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:01.886 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:01.886 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:01.901 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T18:16:01.987 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:01.985+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:02.068 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:02.068 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:02.082 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T18:16:02.083 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:16:02.078+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:16:02.182 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:02.178+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:02.239 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:02.239 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:02.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T18:16:02.283 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:02.282+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:02.348 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T18:16:02.377 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:02.377 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:02.385 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:02.382+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:02.390 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T18:16:02.399 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.5 to 1 (10000) 2024-09-17T18:16:02.403 INFO:tasks.rados.rados.0.smithi154.stdout:245: done (2 left) 2024-09-17T18:16:02.403 INFO:tasks.rados.rados.0.smithi154.stdout:246: done (1 left) 2024-09-17T18:16:02.403 INFO:tasks.rados.rados.0.smithi154.stdout:247: done (0 left) 2024-09-17T18:16:02.403 INFO:tasks.rados.rados.0.smithi154.stdout:248: snap_create 2024-09-17T18:16:02.422 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-17T18:16:02.485 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:02.482+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:02.510 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:02.510 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:02.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T18:16:02.586 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:02.582+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:02.688 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:02.685+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:02.695 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:02.695 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:02.709 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T18:16:02.788 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:02.786+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:02.829 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:02.830 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:02.843 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T18:16:02.891 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:02.890+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:02.990 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:02.985+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:03.012 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:03.012 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:03.026 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T18:16:03.090 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:03.086+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:03.141 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:03.141 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:03.155 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T18:16:03.199 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:03.198+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:03.293 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:03.290+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:03.308 INFO:teuthology.orchestra.run.smithi087.stderr:nodeep-scrub is set 2024-09-17T18:16:03.308 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.6 to 1 (10000) 2024-09-17T18:16:03.313 INFO:tasks.rados.rados.0.smithi154.stdout:248: done (0 left) 2024-09-17T18:16:03.313 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 8 current snap is 23 2024-09-17T18:16:03.314 INFO:tasks.rados.rados.0.smithi154.stdout:249: seq_num 108 ranges {131072=655360,786432=606208,1392640=475136,1867776=81920} 2024-09-17T18:16:03.318 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:03.319 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:03.326 INFO:tasks.rados.rados.0.smithi154.stdout:249: writing smithi15432074-8 from 131072 to 786432 tid 1 2024-09-17T18:16:03.334 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-17T18:16:03.336 INFO:tasks.rados.rados.0.smithi154.stdout:249: writing smithi15432074-8 from 786432 to 1392640 tid 2 2024-09-17T18:16:03.337 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T18:16:03.346 INFO:tasks.rados.rados.0.smithi154.stdout:249: writing smithi15432074-8 from 1392640 to 1867776 tid 3 2024-09-17T18:16:03.348 INFO:tasks.rados.rados.0.smithi154.stdout:249: writing smithi15432074-8 from 1867776 to 1949696 tid 4 2024-09-17T18:16:03.348 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 13 current snap is 23 2024-09-17T18:16:03.348 INFO:tasks.rados.rados.0.smithi154.stdout:250: seq_num 109 ranges {1376256=671744,2048000=753664,2801664=409600} 2024-09-17T18:16:03.378 INFO:tasks.rados.rados.0.smithi154.stdout:250: writing smithi15432074-13 from 1376256 to 2048000 tid 1 2024-09-17T18:16:03.386 INFO:tasks.rados.rados.0.smithi154.stdout:250: writing smithi15432074-13 from 2048000 to 2801664 tid 2 2024-09-17T18:16:03.391 INFO:tasks.rados.rados.0.smithi154.stdout:250: writing smithi15432074-13 from 2801664 to 3211264 tid 3 2024-09-17T18:16:03.391 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 23 current snap is 23 2024-09-17T18:16:03.391 INFO:tasks.rados.rados.0.smithi154.stdout:249: finishing write tid 1 to smithi15432074-8 2024-09-17T18:16:03.391 INFO:tasks.rados.rados.0.smithi154.stdout:249: finishing write tid 2 to smithi15432074-8 2024-09-17T18:16:03.391 INFO:tasks.rados.rados.0.smithi154.stdout:249: finishing write tid 3 to smithi15432074-8 2024-09-17T18:16:03.391 INFO:tasks.rados.rados.0.smithi154.stdout:251: seq_num 110 ranges {1916928=688128,2605056=507904,3112960=655360} 2024-09-17T18:16:03.418 INFO:tasks.rados.rados.0.smithi154.stdout:251: writing smithi15432074-23 from 1916928 to 2605056 tid 1 2024-09-17T18:16:03.423 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:03.422+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:03.423 INFO:tasks.rados.rados.0.smithi154.stdout:251: writing smithi15432074-23 from 2605056 to 3112960 tid 2 2024-09-17T18:16:03.430 INFO:tasks.rados.rados.0.smithi154.stdout:251: writing smithi15432074-23 from 3112960 to 3768320 tid 3 2024-09-17T18:16:03.431 INFO:tasks.rados.rados.0.smithi154.stdout:249: finishing write tid 4 to smithi15432074-8 2024-09-17T18:16:03.431 INFO:tasks.rados.rados.0.smithi154.stdout:249: finishing write tid 5 to smithi15432074-8 2024-09-17T18:16:03.431 INFO:tasks.rados.rados.0.smithi154.stdout:249: finishing write tid 6 to smithi15432074-8 2024-09-17T18:16:03.431 INFO:tasks.rados.rados.0.smithi154.stdout:249: oid 8 updating version 0 to 226 2024-09-17T18:16:03.431 INFO:tasks.rados.rados.0.smithi154.stdout:249: oid 8 updating version 226 to 227 2024-09-17T18:16:03.431 INFO:tasks.rados.rados.0.smithi154.stdout:249: oid 8 updating version 227 to 229 2024-09-17T18:16:03.431 INFO:tasks.rados.rados.0.smithi154.stdout:249: oid 8 version 229 is already newer than 225 2024-09-17T18:16:03.431 INFO:tasks.rados.rados.0.smithi154.stdout:249: oid 8 version 229 is already newer than 228 2024-09-17T18:16:03.431 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 8 v 229 (ObjNum 108 snap 23 seq_num 108) dirty exists 2024-09-17T18:16:03.431 INFO:tasks.rados.rados.0.smithi154.stdout:249: left oid 8 (ObjNum 108 snap 23 seq_num 108) 2024-09-17T18:16:03.431 INFO:tasks.rados.rados.0.smithi154.stdout:250: finishing write tid 1 to smithi15432074-13 2024-09-17T18:16:03.431 INFO:tasks.rados.rados.0.smithi154.stdout:250: finishing write tid 2 to smithi15432074-13 2024-09-17T18:16:03.432 INFO:tasks.rados.rados.0.smithi154.stdout:252: read oid 28 snap 19 2024-09-17T18:16:03.432 INFO:tasks.rados.rados.0.smithi154.stdout:252: expect (ObjNum 89 snap 15 seq_num 89) 2024-09-17T18:16:03.432 INFO:tasks.rados.rados.0.smithi154.stdout:249: done (3 left) 2024-09-17T18:16:03.432 INFO:tasks.rados.rados.0.smithi154.stdout:253: read oid 8 snap -1 2024-09-17T18:16:03.432 INFO:tasks.rados.rados.0.smithi154.stdout:253: expect (ObjNum 108 snap 23 seq_num 108) 2024-09-17T18:16:03.432 INFO:tasks.rados.rados.0.smithi154.stdout:254: snap_create 2024-09-17T18:16:03.432 INFO:tasks.rados.rados.0.smithi154.stdout:250: finishing write tid 3 to smithi15432074-13 2024-09-17T18:16:03.432 INFO:tasks.rados.rados.0.smithi154.stdout:250: finishing write tid 4 to smithi15432074-13 2024-09-17T18:16:03.433 INFO:tasks.rados.rados.0.smithi154.stdout:250: finishing write tid 5 to smithi15432074-13 2024-09-17T18:16:03.433 INFO:tasks.rados.rados.0.smithi154.stdout:250: oid 13 updating version 0 to 25 2024-09-17T18:16:03.433 INFO:tasks.rados.rados.0.smithi154.stdout:250: oid 13 version 25 is already newer than 24 2024-09-17T18:16:03.434 INFO:tasks.rados.rados.0.smithi154.stdout:250: oid 13 updating version 25 to 27 2024-09-17T18:16:03.434 INFO:tasks.rados.rados.0.smithi154.stdout:250: oid 13 version 27 is already newer than 26 2024-09-17T18:16:03.434 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 13 v 27 (ObjNum 109 snap 23 seq_num 109) dirty exists 2024-09-17T18:16:03.434 INFO:tasks.rados.rados.0.smithi154.stdout:250: left oid 13 (ObjNum 109 snap 23 seq_num 109) 2024-09-17T18:16:03.435 INFO:tasks.rados.rados.0.smithi154.stdout:251: finishing write tid 1 to smithi15432074-23 2024-09-17T18:16:03.446 INFO:tasks.rados.rados.0.smithi154.stdout:251: finishing write tid 2 to smithi15432074-23 2024-09-17T18:16:03.447 INFO:tasks.rados.rados.0.smithi154.stdout:251: finishing write tid 3 to smithi15432074-23 2024-09-17T18:16:03.448 INFO:tasks.rados.rados.0.smithi154.stdout:251: finishing write tid 4 to smithi15432074-23 2024-09-17T18:16:03.449 INFO:tasks.rados.rados.0.smithi154.stdout:253: expect (ObjNum 108 snap 23 seq_num 108) 2024-09-17T18:16:03.451 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 144056 2024-09-17T18:16:03.495 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:03.494+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:03.495 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:03.498 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:03.498 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:03.512 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T18:16:03.541 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1717968 2024-09-17T18:16:03.544 INFO:tasks.rados.rados.0.smithi154.stdout:251: finishing write tid 5 to smithi15432074-23 2024-09-17T18:16:03.544 INFO:tasks.rados.rados.0.smithi154.stdout:251: oid 23 updating version 0 to 34 2024-09-17T18:16:03.544 INFO:tasks.rados.rados.0.smithi154.stdout:251: oid 23 updating version 34 to 35 2024-09-17T18:16:03.544 INFO:tasks.rados.rados.0.smithi154.stdout:251: oid 23 version 35 is already newer than 33 2024-09-17T18:16:03.544 INFO:tasks.rados.rados.0.smithi154.stdout:251: oid 23 updating version 35 to 36 2024-09-17T18:16:03.544 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 23 v 36 (ObjNum 110 snap 23 seq_num 110) dirty exists 2024-09-17T18:16:03.544 INFO:tasks.rados.rados.0.smithi154.stdout:251: left oid 23 (ObjNum 110 snap 23 seq_num 110) 2024-09-17T18:16:03.544 INFO:tasks.rados.rados.0.smithi154.stdout:252: expect (ObjNum 89 snap 15 seq_num 89) 2024-09-17T18:16:03.545 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:03.581 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:03.607 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:03.606+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:03.616 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:03.646 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T18:16:03.671 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:03.671 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:03.685 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T18:16:03.727 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:03.726+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:03.783 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:16:03.784 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:16:03.798 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:03.794+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:03.820 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:16:03.820 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:16:03.841 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:16:03.842 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:16:03.851 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:03.851 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:03.862 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:16:03.863 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:16:03.864 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T18:16:03.879 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:16:03.879 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:16:03.899 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:03.898+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:03.900 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:16:03.900 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:16:03.919 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:16:03.919 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:16:03.939 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:16:03.939 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:16:03.956 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:16:03.956 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:16:03.976 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:16:03.977 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:16:03.989 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:03.989 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:16:03.989 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-17T18:16:03.989 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-17T18:16:03.989 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:03.997 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:16:03.997 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:16:03.999 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:03.998+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:04.003 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T18:16:04.019 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:16:04.020 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:16:04.037 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:16:04.037 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:16:04.057 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:16:04.058 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:16:04.079 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:16:04.079 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:16:04.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:16:04.078+0000 7f4831db6640 0 -- 172.21.15.87:0/3650723911 >> [v2:172.21.15.154:6824/3670919160,v1:172.21.15.154:6825/3670919160] conn(0x7f482c225050 msgr2=0x7f482c227440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T18:16:04.101 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:04.098+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:04.146 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:04.146 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-17T18:16:04.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-17T18:16:04.147 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-17T18:16:04.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.147 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs1 37/31 ECSubWrite(tid=31, reqid=client.4565.0:242, at_version=37'16, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:16:04.147 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.706489+0000", 2024-09-17T18:16:04.147 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.437224870000001, 2024-09-17T18:16:04.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060626710000000004, 2024-09-17T18:16:04.147 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.147 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.147 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.147 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706489+0000", 2024-09-17T18:16:04.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706489+0000", 2024-09-17T18:16:04.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706491+0000", 2024-09-17T18:16:04.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.689e-06 2024-09-17T18:16:04.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706535+0000", 2024-09-17T18:16:04.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3600999999999998e-05 2024-09-17T18:16:04.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706565+0000", 2024-09-17T18:16:04.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0281999999999999e-05 2024-09-17T18:16:04.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706582+0000", 2024-09-17T18:16:04.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6711e-05 2024-09-17T18:16:04.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706778+0000", 2024-09-17T18:16:04.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00019613899999999999 2024-09-17T18:16:04.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706801+0000", 2024-09-17T18:16:04.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3703999999999999e-05 2024-09-17T18:16:04.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.712460+0000", 2024-09-17T18:16:04.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056587479999999999 2024-09-17T18:16:04.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.712552+0000", 2024-09-17T18:16:04.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1797000000000002e-05 2024-09-17T18:16:04.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.152 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.152 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs1 37/31 ECSubWrite(tid=32, reqid=client.4565.0:243, at_version=37'17, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:16:04.152 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.707477+0000", 2024-09-17T18:16:04.152 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.436236870999998, 2024-09-17T18:16:04.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005556732, 2024-09-17T18:16:04.153 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.153 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.153 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.153 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707477+0000", 2024-09-17T18:16:04.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707477+0000", 2024-09-17T18:16:04.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707479+0000", 2024-09-17T18:16:04.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.717e-06 2024-09-17T18:16:04.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707515+0000", 2024-09-17T18:16:04.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6501999999999997e-05 2024-09-17T18:16:04.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707541+0000", 2024-09-17T18:16:04.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5113000000000002e-05 2024-09-17T18:16:04.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707562+0000", 2024-09-17T18:16:04.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1585000000000001e-05 2024-09-17T18:16:04.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707638+0000", 2024-09-17T18:16:04.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5597000000000001e-05 2024-09-17T18:16:04.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707653+0000", 2024-09-17T18:16:04.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4783000000000001e-05 2024-09-17T18:16:04.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.712999+0000", 2024-09-17T18:16:04.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053467159999999996 2024-09-17T18:16:04.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.713034+0000", 2024-09-17T18:16:04.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4718999999999997e-05 2024-09-17T18:16:04.157 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.158 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.158 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.158 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.9s5 42/31 ECSubWrite(tid=42, reqid=osd.7.0:42, at_version=42'30, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:16:04.158 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.776164+0000", 2024-09-17T18:16:04.158 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.367550002000002, 2024-09-17T18:16:04.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416520000000001, 2024-09-17T18:16:04.158 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.158 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.159 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.159 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776164+0000", 2024-09-17T18:16:04.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776164+0000", 2024-09-17T18:16:04.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776165+0000", 2024-09-17T18:16:04.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.398e-06 2024-09-17T18:16:04.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776203+0000", 2024-09-17T18:16:04.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7314999999999998e-05 2024-09-17T18:16:04.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776223+0000", 2024-09-17T18:16:04.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9721e-05 2024-09-17T18:16:04.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776237+0000", 2024-09-17T18:16:04.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4110999999999999e-05 2024-09-17T18:16:04.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776405+0000", 2024-09-17T18:16:04.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016826300000000001 2024-09-17T18:16:04.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776420+0000", 2024-09-17T18:16:04.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4918e-05 2024-09-17T18:16:04.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780959+0000", 2024-09-17T18:16:04.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045393229999999996 2024-09-17T18:16:04.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781006+0000", 2024-09-17T18:16:04.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6603000000000001e-05 2024-09-17T18:16:04.163 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.163 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.163 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.163 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 42/31 ECSubWrite(tid=160, reqid=osd.13.0:160, at_version=42'69, trim_to=0'0, roll_forward_to=40'63))", 2024-09-17T18:16:04.163 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.792028+0000", 2024-09-17T18:16:04.163 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.351685796000002, 2024-09-17T18:16:04.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058500109999999996, 2024-09-17T18:16:04.164 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.164 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.164 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.164 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792028+0000", 2024-09-17T18:16:04.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792028+0000", 2024-09-17T18:16:04.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792029+0000", 2024-09-17T18:16:04.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8999999999999997e-07 2024-09-17T18:16:04.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792053+0000", 2024-09-17T18:16:04.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4172000000000002e-05 2024-09-17T18:16:04.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792062+0000", 2024-09-17T18:16:04.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2e-06 2024-09-17T18:16:04.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792071+0000", 2024-09-17T18:16:04.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6880000000000005e-06 2024-09-17T18:16:04.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792774+0000", 2024-09-17T18:16:04.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00070302699999999995 2024-09-17T18:16:04.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792790+0000", 2024-09-17T18:16:04.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6093e-05 2024-09-17T18:16:04.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797821+0000", 2024-09-17T18:16:04.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0050305710000000002 2024-09-17T18:16:04.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797878+0000", 2024-09-17T18:16:04.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7769999999999997e-05 2024-09-17T18:16:04.169 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.169 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.169 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.169 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.9s5 42/31 ECSubWrite(tid=43, reqid=osd.7.0:42, at_version=0'0, trim_to=0'0, roll_forward_to=42'30))", 2024-09-17T18:16:04.169 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.795617+0000", 2024-09-17T18:16:04.169 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.348097439, 2024-09-17T18:16:04.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054555130000000004, 2024-09-17T18:16:04.169 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.170 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.170 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.170 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795617+0000", 2024-09-17T18:16:04.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795617+0000", 2024-09-17T18:16:04.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795617+0000", 2024-09-17T18:16:04.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3799999999999996e-07 2024-09-17T18:16:04.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795628+0000", 2024-09-17T18:16:04.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0868e-05 2024-09-17T18:16:04.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795640+0000", 2024-09-17T18:16:04.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1327e-05 2024-09-17T18:16:04.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795646+0000", 2024-09-17T18:16:04.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9089999999999997e-06 2024-09-17T18:16:04.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795702+0000", 2024-09-17T18:16:04.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6654999999999999e-05 2024-09-17T18:16:04.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795710+0000", 2024-09-17T18:16:04.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.43e-06 2024-09-17T18:16:04.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801022+0000", 2024-09-17T18:16:04.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005311975 2024-09-17T18:16:04.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801072+0000", 2024-09-17T18:16:04.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0611e-05 2024-09-17T18:16:04.174 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.174 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.174 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.174 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.9s5 42/31 ECSubWrite(tid=45, reqid=osd.7.0:45, at_version=42'32, trim_to=0'0, roll_forward_to=42'30))", 2024-09-17T18:16:04.174 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.797426+0000", 2024-09-17T18:16:04.174 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.346287898, 2024-09-17T18:16:04.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063823029999999998, 2024-09-17T18:16:04.174 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.174 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.175 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.175 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797426+0000", 2024-09-17T18:16:04.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797426+0000", 2024-09-17T18:16:04.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797427+0000", 2024-09-17T18:16:04.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2099999999999997e-07 2024-09-17T18:16:04.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797440+0000", 2024-09-17T18:16:04.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3254e-05 2024-09-17T18:16:04.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797448+0000", 2024-09-17T18:16:04.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4239999999999993e-06 2024-09-17T18:16:04.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797453+0000", 2024-09-17T18:16:04.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4440000000000001e-06 2024-09-17T18:16:04.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797511+0000", 2024-09-17T18:16:04.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8357999999999999e-05 2024-09-17T18:16:04.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797522+0000", 2024-09-17T18:16:04.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.08e-05 2024-09-17T18:16:04.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.803773+0000", 2024-09-17T18:16:04.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062510480000000004 2024-09-17T18:16:04.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.803809+0000", 2024-09-17T18:16:04.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5454000000000003e-05 2024-09-17T18:16:04.179 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.179 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.179 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.179 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 42/31 ECSubWrite(tid=163, reqid=osd.13.0:163, at_version=42'73, trim_to=0'0, roll_forward_to=42'69))", 2024-09-17T18:16:04.179 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.809504+0000", 2024-09-17T18:16:04.179 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.334210173999999, 2024-09-17T18:16:04.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058964129999999997, 2024-09-17T18:16:04.180 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.180 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.180 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.180 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809504+0000", 2024-09-17T18:16:04.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809504+0000", 2024-09-17T18:16:04.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809505+0000", 2024-09-17T18:16:04.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.114e-06 2024-09-17T18:16:04.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809538+0000", 2024-09-17T18:16:04.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3356999999999999e-05 2024-09-17T18:16:04.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809562+0000", 2024-09-17T18:16:04.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3407000000000001e-05 2024-09-17T18:16:04.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809579+0000", 2024-09-17T18:16:04.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7048e-05 2024-09-17T18:16:04.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809633+0000", 2024-09-17T18:16:04.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4338000000000001e-05 2024-09-17T18:16:04.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809638+0000", 2024-09-17T18:16:04.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8899999999999998e-06 2024-09-17T18:16:04.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.815347+0000", 2024-09-17T18:16:04.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057087709999999996 2024-09-17T18:16:04.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.815400+0000", 2024-09-17T18:16:04.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3488e-05 2024-09-17T18:16:04.185 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.185 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.185 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.185 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 42/31 ECSubWrite(tid=172, reqid=osd.13.0:172, at_version=42'77, trim_to=0'0, roll_forward_to=42'73))", 2024-09-17T18:16:04.185 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.820063+0000", 2024-09-17T18:16:04.185 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.323651038000001, 2024-09-17T18:16:04.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047871040000000004, 2024-09-17T18:16:04.185 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.185 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.186 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.186 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820063+0000", 2024-09-17T18:16:04.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820063+0000", 2024-09-17T18:16:04.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820064+0000", 2024-09-17T18:16:04.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5999999999999991e-07 2024-09-17T18:16:04.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820092+0000", 2024-09-17T18:16:04.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7557000000000001e-05 2024-09-17T18:16:04.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820107+0000", 2024-09-17T18:16:04.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5206e-05 2024-09-17T18:16:04.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820116+0000", 2024-09-17T18:16:04.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3130000000000004e-06 2024-09-17T18:16:04.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820210+0000", 2024-09-17T18:16:04.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4116999999999994e-05 2024-09-17T18:16:04.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.820228+0000", 2024-09-17T18:16:04.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7825e-05 2024-09-17T18:16:04.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.824807+0000", 2024-09-17T18:16:04.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045786050000000003 2024-09-17T18:16:04.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.824850+0000", 2024-09-17T18:16:04.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3520999999999999e-05 2024-09-17T18:16:04.192 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.192 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.193 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.193 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.5s1 54/31 ECSubWrite(tid=81, reqid=osd.5.0:81, at_version=54'21, trim_to=0'0, roll_forward_to=53'19))", 2024-09-17T18:16:04.193 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310843+0000", 2024-09-17T18:16:04.193 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.832870913000001, 2024-09-17T18:16:04.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013234032, 2024-09-17T18:16:04.193 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.193 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.194 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.194 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310843+0000", 2024-09-17T18:16:04.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310843+0000", 2024-09-17T18:16:04.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310844+0000", 2024-09-17T18:16:04.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8299999999999996e-07 2024-09-17T18:16:04.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310928+0000", 2024-09-17T18:16:04.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4201000000000002e-05 2024-09-17T18:16:04.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310977+0000", 2024-09-17T18:16:04.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9376000000000003e-05 2024-09-17T18:16:04.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.311003+0000", 2024-09-17T18:16:04.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5123e-05 2024-09-17T18:16:04.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.313724+0000", 2024-09-17T18:16:04.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002721462 2024-09-17T18:16:04.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.313759+0000", 2024-09-17T18:16:04.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4935999999999999e-05 2024-09-17T18:16:04.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.323837+0000", 2024-09-17T18:16:04.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010078129 2024-09-17T18:16:04.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.324077+0000", 2024-09-17T18:16:04.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000240122 2024-09-17T18:16:04.199 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.199 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.199 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.199 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 54/31 ECSubWrite(tid=277, reqid=osd.13.0:277, at_version=54'134, trim_to=0'0, roll_forward_to=53'132))", 2024-09-17T18:16:04.199 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.319173+0000", 2024-09-17T18:16:04.199 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.824540984, 2024-09-17T18:16:04.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060233880000000002, 2024-09-17T18:16:04.199 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.200 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.200 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.200 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319173+0000", 2024-09-17T18:16:04.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319173+0000", 2024-09-17T18:16:04.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319174+0000", 2024-09-17T18:16:04.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5300000000000003e-07 2024-09-17T18:16:04.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319245+0000", 2024-09-17T18:16:04.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0905e-05 2024-09-17T18:16:04.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319281+0000", 2024-09-17T18:16:04.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6211999999999998e-05 2024-09-17T18:16:04.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319355+0000", 2024-09-17T18:16:04.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4004999999999994e-05 2024-09-17T18:16:04.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.321073+0000", 2024-09-17T18:16:04.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001718383 2024-09-17T18:16:04.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.321100+0000", 2024-09-17T18:16:04.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7123000000000001e-05 2024-09-17T18:16:04.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.325137+0000", 2024-09-17T18:16:04.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040366890000000004 2024-09-17T18:16:04.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.325197+0000", 2024-09-17T18:16:04.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9317999999999997e-05 2024-09-17T18:16:04.204 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.204 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.204 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.205 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs1 54/31 ECSubWrite(tid=82, reqid=osd.5.0:82, at_version=54'50, trim_to=0'0, roll_forward_to=53'48))", 2024-09-17T18:16:04.205 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.320067+0000", 2024-09-17T18:16:04.205 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.823647084999999, 2024-09-17T18:16:04.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047460669999999996, 2024-09-17T18:16:04.205 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.205 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.205 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.205 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320067+0000", 2024-09-17T18:16:04.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320067+0000", 2024-09-17T18:16:04.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320069+0000", 2024-09-17T18:16:04.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2730000000000001e-06 2024-09-17T18:16:04.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320140+0000", 2024-09-17T18:16:04.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1057999999999996e-05 2024-09-17T18:16:04.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320178+0000", 2024-09-17T18:16:04.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7316e-05 2024-09-17T18:16:04.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320200+0000", 2024-09-17T18:16:04.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2599000000000002e-05 2024-09-17T18:16:04.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320551+0000", 2024-09-17T18:16:04.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000351085 2024-09-17T18:16:04.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320577+0000", 2024-09-17T18:16:04.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5236999999999999e-05 2024-09-17T18:16:04.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.324712+0000", 2024-09-17T18:16:04.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004135288 2024-09-17T18:16:04.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.324813+0000", 2024-09-17T18:16:04.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000101211 2024-09-17T18:16:04.210 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.210 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.210 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.211 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs1 54/31 ECSubWrite(tid=83, reqid=osd.5.0:83, at_version=54'52, trim_to=0'0, roll_forward_to=53'48))", 2024-09-17T18:16:04.211 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.320258+0000", 2024-09-17T18:16:04.211 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.823455673, 2024-09-17T18:16:04.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005694681, 2024-09-17T18:16:04.211 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.211 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.211 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.211 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320258+0000", 2024-09-17T18:16:04.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320258+0000", 2024-09-17T18:16:04.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320260+0000", 2024-09-17T18:16:04.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1260000000000001e-06 2024-09-17T18:16:04.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320311+0000", 2024-09-17T18:16:04.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1808999999999998e-05 2024-09-17T18:16:04.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320342+0000", 2024-09-17T18:16:04.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0176e-05 2024-09-17T18:16:04.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320360+0000", 2024-09-17T18:16:04.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8899999999999999e-05 2024-09-17T18:16:04.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.322647+0000", 2024-09-17T18:16:04.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002286986 2024-09-17T18:16:04.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.322674+0000", 2024-09-17T18:16:04.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6758999999999999e-05 2024-09-17T18:16:04.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.325866+0000", 2024-09-17T18:16:04.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031921810000000001 2024-09-17T18:16:04.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.325953+0000", 2024-09-17T18:16:04.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6743999999999995e-05 2024-09-17T18:16:04.216 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.217 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.217 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.217 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.9s5 54/31 ECSubWrite(tid=78, reqid=osd.7.0:78, at_version=54'67, trim_to=0'0, roll_forward_to=53'63))", 2024-09-17T18:16:04.217 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.341575+0000", 2024-09-17T18:16:04.217 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.802138678, 2024-09-17T18:16:04.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049319150000000003, 2024-09-17T18:16:04.217 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.218 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.218 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.218 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341575+0000", 2024-09-17T18:16:04.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341575+0000", 2024-09-17T18:16:04.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341578+0000", 2024-09-17T18:16:04.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1569999999999998e-06 2024-09-17T18:16:04.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341638+0000", 2024-09-17T18:16:04.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0696000000000003e-05 2024-09-17T18:16:04.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341674+0000", 2024-09-17T18:16:04.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5505e-05 2024-09-17T18:16:04.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341726+0000", 2024-09-17T18:16:04.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2646999999999999e-05 2024-09-17T18:16:04.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341910+0000", 2024-09-17T18:16:04.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00018374 2024-09-17T18:16:04.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.341938+0000", 2024-09-17T18:16:04.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7538999999999998e-05 2024-09-17T18:16:04.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.346404+0000", 2024-09-17T18:16:04.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044663940000000003 2024-09-17T18:16:04.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.346507+0000", 2024-09-17T18:16:04.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000103237 2024-09-17T18:16:04.223 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.223 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.223 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.223 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 54/31 ECSubWrite(tid=286, reqid=osd.13.0:286, at_version=54'138, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:16:04.223 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.347140+0000", 2024-09-17T18:16:04.223 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.796574528000001, 2024-09-17T18:16:04.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005171948, 2024-09-17T18:16:04.223 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.223 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.224 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.224 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347140+0000", 2024-09-17T18:16:04.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347140+0000", 2024-09-17T18:16:04.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347142+0000", 2024-09-17T18:16:04.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4399999999999999e-06 2024-09-17T18:16:04.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347206+0000", 2024-09-17T18:16:04.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3968999999999997e-05 2024-09-17T18:16:04.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347252+0000", 2024-09-17T18:16:04.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6282000000000002e-05 2024-09-17T18:16:04.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347269+0000", 2024-09-17T18:16:04.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6486000000000001e-05 2024-09-17T18:16:04.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347410+0000", 2024-09-17T18:16:04.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000140877 2024-09-17T18:16:04.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347434+0000", 2024-09-17T18:16:04.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4399000000000001e-05 2024-09-17T18:16:04.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.352199+0000", 2024-09-17T18:16:04.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047649880000000004 2024-09-17T18:16:04.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.352312+0000", 2024-09-17T18:16:04.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000112507 2024-09-17T18:16:04.228 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.228 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.228 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.229 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 54/31 ECSubWrite(tid=287, reqid=osd.13.0:287, at_version=54'140, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:16:04.229 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.347311+0000", 2024-09-17T18:16:04.229 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.796403332000001, 2024-09-17T18:16:04.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066967789999999999, 2024-09-17T18:16:04.229 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.229 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.229 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.229 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347311+0000", 2024-09-17T18:16:04.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347311+0000", 2024-09-17T18:16:04.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347312+0000", 2024-09-17T18:16:04.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.04e-06 2024-09-17T18:16:04.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347377+0000", 2024-09-17T18:16:04.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5566000000000002e-05 2024-09-17T18:16:04.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347400+0000", 2024-09-17T18:16:04.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2719000000000001e-05 2024-09-17T18:16:04.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347420+0000", 2024-09-17T18:16:04.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9633e-05 2024-09-17T18:16:04.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.348462+0000", 2024-09-17T18:16:04.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010427279999999999 2024-09-17T18:16:04.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.348476+0000", 2024-09-17T18:16:04.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3207000000000001e-05 2024-09-17T18:16:04.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.353921+0000", 2024-09-17T18:16:04.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054453970000000003 2024-09-17T18:16:04.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354008+0000", 2024-09-17T18:16:04.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6489000000000005e-05 2024-09-17T18:16:04.234 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.234 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.234 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.234 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 59/31 ECSubWrite(tid=341, reqid=client.4565.0:547, at_version=59'182, trim_to=0'0, roll_forward_to=58'180))", 2024-09-17T18:16:04.234 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:54.406166+0000", 2024-09-17T18:16:04.234 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.7375477890000006, 2024-09-17T18:16:04.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006947717, 2024-09-17T18:16:04.235 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.235 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.235 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.235 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.406166+0000", 2024-09-17T18:16:04.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.406166+0000", 2024-09-17T18:16:04.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.406167+0000", 2024-09-17T18:16:04.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9599999999999999e-07 2024-09-17T18:16:04.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.409059+0000", 2024-09-17T18:16:04.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002891911 2024-09-17T18:16:04.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.409074+0000", 2024-09-17T18:16:04.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5498e-05 2024-09-17T18:16:04.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.409087+0000", 2024-09-17T18:16:04.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2877000000000001e-05 2024-09-17T18:16:04.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.409202+0000", 2024-09-17T18:16:04.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114904 2024-09-17T18:16:04.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.409213+0000", 2024-09-17T18:16:04.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0478e-05 2024-09-17T18:16:04.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.413074+0000", 2024-09-17T18:16:04.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038615429999999998 2024-09-17T18:16:04.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.413114+0000", 2024-09-17T18:16:04.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9910000000000002e-05 2024-09-17T18:16:04.239 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.239 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.240 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.240 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 64/31 ECSubWrite(tid=401, reqid=osd.13.0:401, at_version=64'207, trim_to=0'0, roll_forward_to=62'203))", 2024-09-17T18:16:04.240 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:59.318487+0000", 2024-09-17T18:16:04.240 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.825226765, 2024-09-17T18:16:04.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060833450000000004, 2024-09-17T18:16:04.240 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.240 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.241 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.241 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.318487+0000", 2024-09-17T18:16:04.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.318487+0000", 2024-09-17T18:16:04.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.318488+0000", 2024-09-17T18:16:04.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7000000000000003e-07 2024-09-17T18:16:04.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.318537+0000", 2024-09-17T18:16:04.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8562e-05 2024-09-17T18:16:04.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.318565+0000", 2024-09-17T18:16:04.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7929e-05 2024-09-17T18:16:04.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.318584+0000", 2024-09-17T18:16:04.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9327e-05 2024-09-17T18:16:04.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.321049+0000", 2024-09-17T18:16:04.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0024648309999999998 2024-09-17T18:16:04.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.321074+0000", 2024-09-17T18:16:04.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4946000000000001e-05 2024-09-17T18:16:04.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.324506+0000", 2024-09-17T18:16:04.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034321680000000002 2024-09-17T18:16:04.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.324571+0000", 2024-09-17T18:16:04.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4611999999999997e-05 2024-09-17T18:16:04.245 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.246 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.246 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.246 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs1 65/31 ECSubWrite(tid=112, reqid=osd.5.0:110, at_version=0'0, trim_to=0'0, roll_forward_to=65'73))", 2024-09-17T18:16:04.246 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:00.345352+0000", 2024-09-17T18:16:04.246 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.7983623299999998, 2024-09-17T18:16:04.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055866500000000003, 2024-09-17T18:16:04.246 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.246 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.247 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.247 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345352+0000", 2024-09-17T18:16:04.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345352+0000", 2024-09-17T18:16:04.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345353+0000", 2024-09-17T18:16:04.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0219999999999999e-06 2024-09-17T18:16:04.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345366+0000", 2024-09-17T18:16:04.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3434e-05 2024-09-17T18:16:04.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345400+0000", 2024-09-17T18:16:04.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3702999999999999e-05 2024-09-17T18:16:04.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345410+0000", 2024-09-17T18:16:04.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0074999999999999e-05 2024-09-17T18:16:04.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345470+0000", 2024-09-17T18:16:04.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9676999999999998e-05 2024-09-17T18:16:04.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345480+0000", 2024-09-17T18:16:04.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0105000000000001e-05 2024-09-17T18:16:04.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.350893+0000", 2024-09-17T18:16:04.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005413597 2024-09-17T18:16:04.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.350938+0000", 2024-09-17T18:16:04.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5037000000000003e-05 2024-09-17T18:16:04.251 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.251 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.252 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.252 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 65/31 ECSubWrite(tid=414, reqid=osd.13.0:414, at_version=65'215, trim_to=0'0, roll_forward_to=65'213))", 2024-09-17T18:16:04.252 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:00.353813+0000", 2024-09-17T18:16:04.252 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.7899010280000001, 2024-09-17T18:16:04.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005802565, 2024-09-17T18:16:04.252 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.252 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.252 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.252 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353813+0000", 2024-09-17T18:16:04.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353813+0000", 2024-09-17T18:16:04.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353814+0000", 2024-09-17T18:16:04.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5300000000000003e-07 2024-09-17T18:16:04.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353842+0000", 2024-09-17T18:16:04.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8059e-05 2024-09-17T18:16:04.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353864+0000", 2024-09-17T18:16:04.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2095000000000001e-05 2024-09-17T18:16:04.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353876+0000", 2024-09-17T18:16:04.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2198000000000001e-05 2024-09-17T18:16:04.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353942+0000", 2024-09-17T18:16:04.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5887000000000001e-05 2024-09-17T18:16:04.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353950+0000", 2024-09-17T18:16:04.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5650000000000004e-06 2024-09-17T18:16:04.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.359554+0000", 2024-09-17T18:16:04.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056045790000000002 2024-09-17T18:16:04.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.359616+0000", 2024-09-17T18:16:04.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1328999999999995e-05 2024-09-17T18:16:04.257 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.257 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.257 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.257 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 65/31 ECSubWrite(tid=416, reqid=osd.13.0:416, at_version=65'217, trim_to=0'0, roll_forward_to=65'213))", 2024-09-17T18:16:04.257 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:00.356590+0000", 2024-09-17T18:16:04.257 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.7871243030000001, 2024-09-17T18:16:04.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055615409999999997, 2024-09-17T18:16:04.258 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.258 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.258 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.258 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356590+0000", 2024-09-17T18:16:04.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356590+0000", 2024-09-17T18:16:04.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356591+0000", 2024-09-17T18:16:04.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7400000000000002e-07 2024-09-17T18:16:04.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356607+0000", 2024-09-17T18:16:04.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6392000000000002e-05 2024-09-17T18:16:04.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356668+0000", 2024-09-17T18:16:04.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1336999999999999e-05 2024-09-17T18:16:04.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356678+0000", 2024-09-17T18:16:04.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8169999999999994e-06 2024-09-17T18:16:04.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356757+0000", 2024-09-17T18:16:04.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8922000000000001e-05 2024-09-17T18:16:04.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356771+0000", 2024-09-17T18:16:04.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3967e-05 2024-09-17T18:16:04.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.362106+0000", 2024-09-17T18:16:04.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053352060000000003 2024-09-17T18:16:04.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.362151+0000", 2024-09-17T18:16:04.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5126000000000001e-05 2024-09-17T18:16:04.262 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.262 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.262 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.262 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.263 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.263 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:04.264 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T18:16:04.265 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:04.261+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:04.307 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:16:04.307 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:16:04.365 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:04.362+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:04.408 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.7 to 1 (10000) 2024-09-17T18:16:04.412 INFO:tasks.rados.rados.0.smithi154.stdout:250: done (4 left) 2024-09-17T18:16:04.413 INFO:tasks.rados.rados.0.smithi154.stdout:251: done (3 left) 2024-09-17T18:16:04.413 INFO:tasks.rados.rados.0.smithi154.stdout:252: done (2 left) 2024-09-17T18:16:04.413 INFO:tasks.rados.rados.0.smithi154.stdout:253: done (1 left) 2024-09-17T18:16:04.413 INFO:tasks.rados.rados.0.smithi154.stdout:254: done (0 left) 2024-09-17T18:16:04.413 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 45 current snap is 24 2024-09-17T18:16:04.413 INFO:tasks.rados.rados.0.smithi154.stdout:255: seq_num 111 ranges {753664=704512,1458176=655360,2113536=507904} 2024-09-17T18:16:04.426 INFO:tasks.rados.rados.0.smithi154.stdout:255: writing smithi15432074-45 from 753664 to 1458176 tid 1 2024-09-17T18:16:04.429 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 8 1 2024-09-17T18:16:04.432 INFO:tasks.rados.rados.0.smithi154.stdout:255: writing smithi15432074-45 from 1458176 to 2113536 tid 2 2024-09-17T18:16:04.437 INFO:tasks.rados.rados.0.smithi154.stdout:255: writing smithi15432074-45 from 2113536 to 2621440 tid 3 2024-09-17T18:16:04.438 INFO:tasks.rados.rados.0.smithi154.stdout:256: snap_create 2024-09-17T18:16:04.442 INFO:tasks.rados.rados.0.smithi154.stdout:255: finishing write tid 1 to smithi15432074-45 2024-09-17T18:16:04.444 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:04.444 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:16:04.444 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-17T18:16:04.444 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:04.449 INFO:tasks.rados.rados.0.smithi154.stdout:255: finishing write tid 2 to smithi15432074-45 2024-09-17T18:16:04.450 INFO:tasks.rados.rados.0.smithi154.stdout:255: finishing write tid 3 to smithi15432074-45 2024-09-17T18:16:04.450 INFO:tasks.rados.rados.0.smithi154.stdout:255: finishing write tid 4 to smithi15432074-45 2024-09-17T18:16:04.454 INFO:tasks.rados.rados.0.smithi154.stdout:255: finishing write tid 5 to smithi15432074-45 2024-09-17T18:16:04.454 INFO:tasks.rados.rados.0.smithi154.stdout:255: oid 45 updating version 0 to 78 2024-09-17T18:16:04.454 INFO:tasks.rados.rados.0.smithi154.stdout:255: oid 45 version 78 is already newer than 76 2024-09-17T18:16:04.454 INFO:tasks.rados.rados.0.smithi154.stdout:255: oid 45 version 78 is already newer than 77 2024-09-17T18:16:04.454 INFO:tasks.rados.rados.0.smithi154.stdout:255: oid 45 version 78 is already newer than 75 2024-09-17T18:16:04.454 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 45 v 78 (ObjNum 111 snap 24 seq_num 111) dirty exists 2024-09-17T18:16:04.454 INFO:tasks.rados.rados.0.smithi154.stdout:255: left oid 45 (ObjNum 111 snap 24 seq_num 111) 2024-09-17T18:16:04.460 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T18:16:04.466 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:04.461+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:04.567 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:16:04.566+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:16:04.623 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:04.623 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:16:04.623 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-17T18:16:04.623 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-17T18:16:04.623 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:04.639 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T18:16:04.668 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:04.666+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:04.759 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:04.759 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-17T18:16:04.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-17T18:16:04.759 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-17T18:16:04.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.759 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs5 37/31 ECSubWrite(tid=31, reqid=client.4565.0:242, at_version=37'16, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:16:04.759 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.706509+0000", 2024-09-17T18:16:04.759 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.049448419999997, 2024-09-17T18:16:04.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062454279999999999, 2024-09-17T18:16:04.759 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.759 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.760 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.760 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706509+0000", 2024-09-17T18:16:04.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706509+0000", 2024-09-17T18:16:04.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706511+0000", 2024-09-17T18:16:04.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.08e-06 2024-09-17T18:16:04.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706552+0000", 2024-09-17T18:16:04.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0723999999999998e-05 2024-09-17T18:16:04.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706585+0000", 2024-09-17T18:16:04.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3065000000000003e-05 2024-09-17T18:16:04.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706604+0000", 2024-09-17T18:16:04.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8851e-05 2024-09-17T18:16:04.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706701+0000", 2024-09-17T18:16:04.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7831999999999994e-05 2024-09-17T18:16:04.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706711+0000", 2024-09-17T18:16:04.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4239999999999999e-06 2024-09-17T18:16:04.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.712726+0000", 2024-09-17T18:16:04.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060149699999999997 2024-09-17T18:16:04.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.712754+0000", 2024-09-17T18:16:04.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8481999999999999e-05 2024-09-17T18:16:04.764 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.764 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.764 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.764 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs5 37/31 ECSubWrite(tid=32, reqid=client.4565.0:243, at_version=37'17, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:16:04.764 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.707436+0000", 2024-09-17T18:16:04.765 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.048521156, 2024-09-17T18:16:04.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053389099999999997, 2024-09-17T18:16:04.765 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.765 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.765 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.765 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707436+0000", 2024-09-17T18:16:04.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707436+0000", 2024-09-17T18:16:04.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707437+0000", 2024-09-17T18:16:04.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4700000000000001e-07 2024-09-17T18:16:04.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707450+0000", 2024-09-17T18:16:04.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2914e-05 2024-09-17T18:16:04.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707460+0000", 2024-09-17T18:16:04.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0127e-05 2024-09-17T18:16:04.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707465+0000", 2024-09-17T18:16:04.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6450000000000002e-06 2024-09-17T18:16:04.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707582+0000", 2024-09-17T18:16:04.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000116953 2024-09-17T18:16:04.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707605+0000", 2024-09-17T18:16:04.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2957000000000001e-05 2024-09-17T18:16:04.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.712758+0000", 2024-09-17T18:16:04.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051528650000000004 2024-09-17T18:16:04.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.712775+0000", 2024-09-17T18:16:04.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6901999999999998e-05 2024-09-17T18:16:04.769 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.769 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.770 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 37/31 ECSubWrite(tid=60, reqid=client.4565.0:244, at_version=37'18, trim_to=0'0, roll_forward_to=35'16))", 2024-09-17T18:16:04.770 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.725506+0000", 2024-09-17T18:16:04.770 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.030451607000003, 2024-09-17T18:16:04.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0050592679999999996, 2024-09-17T18:16:04.770 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.770 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.770 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.771 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725506+0000", 2024-09-17T18:16:04.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725506+0000", 2024-09-17T18:16:04.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725506+0000", 2024-09-17T18:16:04.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.96e-07 2024-09-17T18:16:04.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725632+0000", 2024-09-17T18:16:04.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012642999999999999 2024-09-17T18:16:04.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725646+0000", 2024-09-17T18:16:04.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3237e-05 2024-09-17T18:16:04.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725656+0000", 2024-09-17T18:16:04.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0051000000000001e-05 2024-09-17T18:16:04.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725767+0000", 2024-09-17T18:16:04.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011117599999999999 2024-09-17T18:16:04.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.725783+0000", 2024-09-17T18:16:04.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6018000000000001e-05 2024-09-17T18:16:04.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.730487+0000", 2024-09-17T18:16:04.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047037249999999997 2024-09-17T18:16:04.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.730565+0000", 2024-09-17T18:16:04.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8335000000000001e-05 2024-09-17T18:16:04.775 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.775 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.775 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.776 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 37/31 ECSubWrite(tid=61, reqid=client.4565.0:245, at_version=37'19, trim_to=0'0, roll_forward_to=35'16))", 2024-09-17T18:16:04.776 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.728042+0000", 2024-09-17T18:16:04.776 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.027915118999999, 2024-09-17T18:16:04.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048033609999999999, 2024-09-17T18:16:04.776 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.776 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.776 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.776 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728042+0000", 2024-09-17T18:16:04.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728042+0000", 2024-09-17T18:16:04.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728043+0000", 2024-09-17T18:16:04.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.02e-06 2024-09-17T18:16:04.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728120+0000", 2024-09-17T18:16:04.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7163999999999995e-05 2024-09-17T18:16:04.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728136+0000", 2024-09-17T18:16:04.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5477000000000001e-05 2024-09-17T18:16:04.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728145+0000", 2024-09-17T18:16:04.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8880000000000003e-06 2024-09-17T18:16:04.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728339+0000", 2024-09-17T18:16:04.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000194033 2024-09-17T18:16:04.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728375+0000", 2024-09-17T18:16:04.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6449999999999998e-05 2024-09-17T18:16:04.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.732814+0000", 2024-09-17T18:16:04.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044391250000000004 2024-09-17T18:16:04.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.732846+0000", 2024-09-17T18:16:04.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1204000000000001e-05 2024-09-17T18:16:04.781 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.781 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.781 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.781 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 37/31 ECSubWrite(tid=62, reqid=client.4565.0:246, at_version=37'20, trim_to=0'0, roll_forward_to=35'16))", 2024-09-17T18:16:04.781 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.728741+0000", 2024-09-17T18:16:04.782 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.027216696000004, 2024-09-17T18:16:04.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004643393, 2024-09-17T18:16:04.782 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.782 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.782 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.782 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728741+0000", 2024-09-17T18:16:04.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728741+0000", 2024-09-17T18:16:04.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728741+0000", 2024-09-17T18:16:04.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6799999999999999e-07 2024-09-17T18:16:04.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728758+0000", 2024-09-17T18:16:04.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6833999999999998e-05 2024-09-17T18:16:04.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728794+0000", 2024-09-17T18:16:04.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5474e-05 2024-09-17T18:16:04.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.728809+0000", 2024-09-17T18:16:04.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5724000000000001e-05 2024-09-17T18:16:04.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.730826+0000", 2024-09-17T18:16:04.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002016739 2024-09-17T18:16:04.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.730835+0000", 2024-09-17T18:16:04.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0699999999999996e-06 2024-09-17T18:16:04.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.733358+0000", 2024-09-17T18:16:04.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0025224539999999999 2024-09-17T18:16:04.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.733384+0000", 2024-09-17T18:16:04.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.633e-05 2024-09-17T18:16:04.786 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.786 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.786 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.787 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 42/31 ECSubWrite(tid=87, reqid=client.4565.0:358, at_version=42'26, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:04.787 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.771952+0000", 2024-09-17T18:16:04.787 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.984005619000001, 2024-09-17T18:16:04.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078941329999999994, 2024-09-17T18:16:04.787 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.787 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.787 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.787 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771952+0000", 2024-09-17T18:16:04.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771952+0000", 2024-09-17T18:16:04.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771952+0000", 2024-09-17T18:16:04.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4200000000000001e-07 2024-09-17T18:16:04.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772004+0000", 2024-09-17T18:16:04.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2176000000000003e-05 2024-09-17T18:16:04.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772035+0000", 2024-09-17T18:16:04.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0332999999999999e-05 2024-09-17T18:16:04.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772052+0000", 2024-09-17T18:16:04.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7071e-05 2024-09-17T18:16:04.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773442+0000", 2024-09-17T18:16:04.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00139061 2024-09-17T18:16:04.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773459+0000", 2024-09-17T18:16:04.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6898e-05 2024-09-17T18:16:04.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.779809+0000", 2024-09-17T18:16:04.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063501199999999999 2024-09-17T18:16:04.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.779846+0000", 2024-09-17T18:16:04.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6483000000000003e-05 2024-09-17T18:16:04.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.791 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.791 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs5 42/31 ECSubWrite(tid=38, reqid=osd.5.0:38, at_version=42'19, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T18:16:04.791 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.774494+0000", 2024-09-17T18:16:04.792 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.981463174000002, 2024-09-17T18:16:04.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046119849999999999, 2024-09-17T18:16:04.792 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.792 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.792 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.792 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774494+0000", 2024-09-17T18:16:04.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774494+0000", 2024-09-17T18:16:04.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774495+0000", 2024-09-17T18:16:04.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1399999999999997e-07 2024-09-17T18:16:04.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774533+0000", 2024-09-17T18:16:04.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8089000000000001e-05 2024-09-17T18:16:04.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774554+0000", 2024-09-17T18:16:04.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1024999999999999e-05 2024-09-17T18:16:04.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774569+0000", 2024-09-17T18:16:04.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5705e-05 2024-09-17T18:16:04.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775171+0000", 2024-09-17T18:16:04.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00060113500000000004 2024-09-17T18:16:04.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775186+0000", 2024-09-17T18:16:04.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5265999999999999e-05 2024-09-17T18:16:04.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.779061+0000", 2024-09-17T18:16:04.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003874817 2024-09-17T18:16:04.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.779106+0000", 2024-09-17T18:16:04.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5433999999999999e-05 2024-09-17T18:16:04.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.796 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.796 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.5s4 42/31 ECSubWrite(tid=39, reqid=osd.5.0:39, at_version=42'10, trim_to=0'0, roll_forward_to=38'8))", 2024-09-17T18:16:04.797 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.774627+0000", 2024-09-17T18:16:04.797 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.981330614000001, 2024-09-17T18:16:04.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044276050000000003, 2024-09-17T18:16:04.797 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.797 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.797 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.797 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774627+0000", 2024-09-17T18:16:04.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774627+0000", 2024-09-17T18:16:04.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774627+0000", 2024-09-17T18:16:04.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3799999999999997e-07 2024-09-17T18:16:04.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774656+0000", 2024-09-17T18:16:04.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8572999999999999e-05 2024-09-17T18:16:04.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774672+0000", 2024-09-17T18:16:04.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6337e-05 2024-09-17T18:16:04.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774686+0000", 2024-09-17T18:16:04.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.34e-05 2024-09-17T18:16:04.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775280+0000", 2024-09-17T18:16:04.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00059417699999999999 2024-09-17T18:16:04.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775294+0000", 2024-09-17T18:16:04.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4683e-05 2024-09-17T18:16:04.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778980+0000", 2024-09-17T18:16:04.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036859250000000001 2024-09-17T18:16:04.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.779054+0000", 2024-09-17T18:16:04.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3872e-05 2024-09-17T18:16:04.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.802 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.802 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 42/31 ECSubWrite(tid=90, reqid=client.4565.0:359, at_version=42'27, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:04.802 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.774910+0000", 2024-09-17T18:16:04.802 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.981047479000001, 2024-09-17T18:16:04.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049728860000000001, 2024-09-17T18:16:04.803 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.803 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.803 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.803 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774910+0000", 2024-09-17T18:16:04.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774910+0000", 2024-09-17T18:16:04.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774911+0000", 2024-09-17T18:16:04.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3459999999999999e-06 2024-09-17T18:16:04.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774945+0000", 2024-09-17T18:16:04.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3803000000000001e-05 2024-09-17T18:16:04.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774964+0000", 2024-09-17T18:16:04.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9117e-05 2024-09-17T18:16:04.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774978+0000", 2024-09-17T18:16:04.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4423000000000001e-05 2024-09-17T18:16:04.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776840+0000", 2024-09-17T18:16:04.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001861857 2024-09-17T18:16:04.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776855+0000", 2024-09-17T18:16:04.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4368e-05 2024-09-17T18:16:04.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.779851+0000", 2024-09-17T18:16:04.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0029963110000000002 2024-09-17T18:16:04.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.779883+0000", 2024-09-17T18:16:04.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1661000000000001e-05 2024-09-17T18:16:04.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.808 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.808 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs5 42/31 ECSubWrite(tid=42, reqid=client.4565.0:361, at_version=42'21, trim_to=0'0, roll_forward_to=42'19))", 2024-09-17T18:16:04.808 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.816741+0000", 2024-09-17T18:16:04.808 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.939216718000001, 2024-09-17T18:16:04.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053613080000000004, 2024-09-17T18:16:04.809 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.809 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.809 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.809 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.816741+0000", 2024-09-17T18:16:04.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.816741+0000", 2024-09-17T18:16:04.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.816742+0000", 2024-09-17T18:16:04.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7439999999999999e-06 2024-09-17T18:16:04.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.817689+0000", 2024-09-17T18:16:04.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000946812 2024-09-17T18:16:04.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.817720+0000", 2024-09-17T18:16:04.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0556999999999999e-05 2024-09-17T18:16:04.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.817738+0000", 2024-09-17T18:16:04.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8148999999999999e-05 2024-09-17T18:16:04.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.817885+0000", 2024-09-17T18:16:04.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014677700000000001 2024-09-17T18:16:04.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.817896+0000", 2024-09-17T18:16:04.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1406000000000001e-05 2024-09-17T18:16:04.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.822054+0000", 2024-09-17T18:16:04.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0041581780000000002 2024-09-17T18:16:04.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.822102+0000", 2024-09-17T18:16:04.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7685000000000002e-05 2024-09-17T18:16:04.813 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.813 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.814 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.814 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 43/31 ECSubWrite(tid=105, reqid=osd.4.0:105, at_version=43'38, trim_to=0'0, roll_forward_to=42'34))", 2024-09-17T18:16:04.814 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:38.771731+0000", 2024-09-17T18:16:04.814 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 25.984225959, 2024-09-17T18:16:04.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057788789999999998, 2024-09-17T18:16:04.814 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.814 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.814 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.814 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771731+0000", 2024-09-17T18:16:04.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771731+0000", 2024-09-17T18:16:04.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771732+0000", 2024-09-17T18:16:04.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8199999999999998e-07 2024-09-17T18:16:04.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771759+0000", 2024-09-17T18:16:04.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7076e-05 2024-09-17T18:16:04.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771772+0000", 2024-09-17T18:16:04.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2357999999999999e-05 2024-09-17T18:16:04.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771781+0000", 2024-09-17T18:16:04.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2380000000000003e-06 2024-09-17T18:16:04.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771871+0000", 2024-09-17T18:16:04.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0464999999999995e-05 2024-09-17T18:16:04.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771881+0000", 2024-09-17T18:16:04.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9499999999999996e-06 2024-09-17T18:16:04.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.777463+0000", 2024-09-17T18:16:04.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055820150000000001 2024-09-17T18:16:04.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.777510+0000", 2024-09-17T18:16:04.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6894999999999997e-05 2024-09-17T18:16:04.818 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.818 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.818 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.819 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs5 50/31 ECSubWrite(tid=53, reqid=client.4565.0:420, at_version=50'31, trim_to=0'0, roll_forward_to=46'29))", 2024-09-17T18:16:04.819 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:45.870546+0000", 2024-09-17T18:16:04.819 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.885411425000001, 2024-09-17T18:16:04.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042829460000000001, 2024-09-17T18:16:04.819 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.819 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.819 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.819 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:45.870546+0000", 2024-09-17T18:16:04.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:45.870546+0000", 2024-09-17T18:16:04.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:45.870546+0000", 2024-09-17T18:16:04.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.18e-07 2024-09-17T18:16:04.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:45.871078+0000", 2024-09-17T18:16:04.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00053220700000000004 2024-09-17T18:16:04.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:45.871092+0000", 2024-09-17T18:16:04.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4191e-05 2024-09-17T18:16:04.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:45.871103+0000", 2024-09-17T18:16:04.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0587999999999999e-05 2024-09-17T18:16:04.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:45.871183+0000", 2024-09-17T18:16:04.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9827000000000007e-05 2024-09-17T18:16:04.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:45.871194+0000", 2024-09-17T18:16:04.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1114999999999999e-05 2024-09-17T18:16:04.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:45.874797+0000", 2024-09-17T18:16:04.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036031940000000001 2024-09-17T18:16:04.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:45.874829+0000", 2024-09-17T18:16:04.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1705999999999998e-05 2024-09-17T18:16:04.823 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.823 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.823 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.823 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.5s4 54/31 ECSubWrite(tid=81, reqid=osd.5.0:81, at_version=54'21, trim_to=0'0, roll_forward_to=53'19))", 2024-09-17T18:16:04.824 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310887+0000", 2024-09-17T18:16:04.824 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 15.445070572000001, 2024-09-17T18:16:04.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0073816610000000003, 2024-09-17T18:16:04.824 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.824 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.824 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.824 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310887+0000", 2024-09-17T18:16:04.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310887+0000", 2024-09-17T18:16:04.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310887+0000", 2024-09-17T18:16:04.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3e-07 2024-09-17T18:16:04.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310940+0000", 2024-09-17T18:16:04.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3124999999999997e-05 2024-09-17T18:16:04.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310979+0000", 2024-09-17T18:16:04.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8452999999999999e-05 2024-09-17T18:16:04.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.311002+0000", 2024-09-17T18:16:04.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3479999999999999e-05 2024-09-17T18:16:04.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.312706+0000", 2024-09-17T18:16:04.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001703539 2024-09-17T18:16:04.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.312732+0000", 2024-09-17T18:16:04.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5982999999999998e-05 2024-09-17T18:16:04.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.318109+0000", 2024-09-17T18:16:04.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053769120000000002 2024-09-17T18:16:04.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.318268+0000", 2024-09-17T18:16:04.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015953899999999999 2024-09-17T18:16:04.829 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.829 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.829 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.829 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 54/31 ECSubWrite(tid=154, reqid=client.4565.0:520, at_version=0'0, trim_to=0'0, roll_forward_to=54'68))", 2024-09-17T18:16:04.829 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.365416+0000", 2024-09-17T18:16:04.829 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 15.390541585999999, 2024-09-17T18:16:04.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038546510000000002, 2024-09-17T18:16:04.829 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.830 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.830 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.830 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.365416+0000", 2024-09-17T18:16:04.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.365416+0000", 2024-09-17T18:16:04.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.365417+0000", 2024-09-17T18:16:04.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5430000000000001e-06 2024-09-17T18:16:04.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.365434+0000", 2024-09-17T18:16:04.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6728999999999999e-05 2024-09-17T18:16:04.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.365464+0000", 2024-09-17T18:16:04.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0056000000000002e-05 2024-09-17T18:16:04.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.365481+0000", 2024-09-17T18:16:04.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6679000000000001e-05 2024-09-17T18:16:04.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.365579+0000", 2024-09-17T18:16:04.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8224e-05 2024-09-17T18:16:04.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.365595+0000", 2024-09-17T18:16:04.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6076e-05 2024-09-17T18:16:04.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.369199+0000", 2024-09-17T18:16:04.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036036050000000002 2024-09-17T18:16:04.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.369270+0000", 2024-09-17T18:16:04.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1738999999999999e-05 2024-09-17T18:16:04.834 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.834 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.834 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.834 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 54/31 ECSubWrite(tid=156, reqid=client.4565.0:515, at_version=54'70, trim_to=0'0, roll_forward_to=54'68))", 2024-09-17T18:16:04.834 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.387529+0000", 2024-09-17T18:16:04.834 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 15.368428078999999, 2024-09-17T18:16:04.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059270210000000002, 2024-09-17T18:16:04.835 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.835 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.835 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.835 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.387529+0000", 2024-09-17T18:16:04.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.387529+0000", 2024-09-17T18:16:04.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.387532+0000", 2024-09-17T18:16:04.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.039e-06 2024-09-17T18:16:04.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.388695+0000", 2024-09-17T18:16:04.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001162377 2024-09-17T18:16:04.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.388732+0000", 2024-09-17T18:16:04.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7079000000000002e-05 2024-09-17T18:16:04.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.388757+0000", 2024-09-17T18:16:04.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.497e-05 2024-09-17T18:16:04.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.388913+0000", 2024-09-17T18:16:04.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015615799999999999 2024-09-17T18:16:04.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.388932+0000", 2024-09-17T18:16:04.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9270999999999999e-05 2024-09-17T18:16:04.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.393403+0000", 2024-09-17T18:16:04.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044705839999999997 2024-09-17T18:16:04.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.393456+0000", 2024-09-17T18:16:04.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3542999999999999e-05 2024-09-17T18:16:04.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.840 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.840 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.5s4 65/31 ECSubWrite(tid=108, reqid=osd.5.0:108, at_version=65'31, trim_to=0'0, roll_forward_to=62'29))", 2024-09-17T18:16:04.840 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:00.328597+0000", 2024-09-17T18:16:04.840 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.4273601679999999, 2024-09-17T18:16:04.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038336049999999999, 2024-09-17T18:16:04.840 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.840 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.841 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.841 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.328597+0000", 2024-09-17T18:16:04.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.328597+0000", 2024-09-17T18:16:04.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.328597+0000", 2024-09-17T18:16:04.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3500000000000002e-07 2024-09-17T18:16:04.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.328625+0000", 2024-09-17T18:16:04.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7597999999999999e-05 2024-09-17T18:16:04.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.329570+0000", 2024-09-17T18:16:04.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000945414 2024-09-17T18:16:04.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.329587+0000", 2024-09-17T18:16:04.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6396999999999999e-05 2024-09-17T18:16:04.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.329771+0000", 2024-09-17T18:16:04.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00018427999999999999 2024-09-17T18:16:04.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.329781+0000", 2024-09-17T18:16:04.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5759999999999995e-06 2024-09-17T18:16:04.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.332405+0000", 2024-09-17T18:16:04.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002624604 2024-09-17T18:16:04.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.332431+0000", 2024-09-17T18:16:04.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5401e-05 2024-09-17T18:16:04.845 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.845 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.845 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.846 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 65/31 ECSubWrite(tid=212, reqid=osd.4.0:212, at_version=65'104, trim_to=0'0, roll_forward_to=62'100))", 2024-09-17T18:16:04.846 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:00.337303+0000", 2024-09-17T18:16:04.846 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.4186539539999998, 2024-09-17T18:16:04.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007070855, 2024-09-17T18:16:04.846 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.846 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.846 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.846 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337303+0000", 2024-09-17T18:16:04.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337303+0000", 2024-09-17T18:16:04.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337304+0000", 2024-09-17T18:16:04.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1699999999999997e-07 2024-09-17T18:16:04.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337328+0000", 2024-09-17T18:16:04.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4054999999999999e-05 2024-09-17T18:16:04.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337339+0000", 2024-09-17T18:16:04.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0958000000000001e-05 2024-09-17T18:16:04.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337348+0000", 2024-09-17T18:16:04.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5150000000000006e-06 2024-09-17T18:16:04.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337452+0000", 2024-09-17T18:16:04.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104425 2024-09-17T18:16:04.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337466+0000", 2024-09-17T18:16:04.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3558e-05 2024-09-17T18:16:04.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.344327+0000", 2024-09-17T18:16:04.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068609509999999997 2024-09-17T18:16:04.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.344374+0000", 2024-09-17T18:16:04.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7475999999999997e-05 2024-09-17T18:16:04.850 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.850 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.850 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.851 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 65/31 ECSubWrite(tid=213, reqid=osd.4.0:212, at_version=0'0, trim_to=0'0, roll_forward_to=65'104))", 2024-09-17T18:16:04.851 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:00.347741+0000", 2024-09-17T18:16:04.851 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.408215878, 2024-09-17T18:16:04.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051476070000000002, 2024-09-17T18:16:04.851 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.851 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.851 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.851 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.347741+0000", 2024-09-17T18:16:04.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.347741+0000", 2024-09-17T18:16:04.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.347743+0000", 2024-09-17T18:16:04.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3999999999999999e-06 2024-09-17T18:16:04.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.347759+0000", 2024-09-17T18:16:04.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6103000000000002e-05 2024-09-17T18:16:04.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.347796+0000", 2024-09-17T18:16:04.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6925000000000003e-05 2024-09-17T18:16:04.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.347823+0000", 2024-09-17T18:16:04.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6721e-05 2024-09-17T18:16:04.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.347911+0000", 2024-09-17T18:16:04.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8382999999999997e-05 2024-09-17T18:16:04.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.347921+0000", 2024-09-17T18:16:04.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0390999999999999e-05 2024-09-17T18:16:04.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.352847+0000", 2024-09-17T18:16:04.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049259760000000003 2024-09-17T18:16:04.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.352889+0000", 2024-09-17T18:16:04.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1708000000000001e-05 2024-09-17T18:16:04.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.855 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.855 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 65/31 ECSubWrite(tid=214, reqid=osd.4.0:214, at_version=65'106, trim_to=0'0, roll_forward_to=65'104))", 2024-09-17T18:16:04.855 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:00.348764+0000", 2024-09-17T18:16:04.856 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.4071935130000002, 2024-09-17T18:16:04.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049855539999999997, 2024-09-17T18:16:04.856 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.856 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.856 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.856 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.348764+0000", 2024-09-17T18:16:04.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.348764+0000", 2024-09-17T18:16:04.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.348765+0000", 2024-09-17T18:16:04.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.077e-06 2024-09-17T18:16:04.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.348824+0000", 2024-09-17T18:16:04.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9175999999999997e-05 2024-09-17T18:16:04.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.348863+0000", 2024-09-17T18:16:04.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-17T18:16:04.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.348876+0000", 2024-09-17T18:16:04.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2643000000000001e-05 2024-09-17T18:16:04.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.348946+0000", 2024-09-17T18:16:04.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0019999999999997e-05 2024-09-17T18:16:04.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.348955+0000", 2024-09-17T18:16:04.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0350000000000007e-06 2024-09-17T18:16:04.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353714+0000", 2024-09-17T18:16:04.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047584230000000003 2024-09-17T18:16:04.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353749+0000", 2024-09-17T18:16:04.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5772000000000002e-05 2024-09-17T18:16:04.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.861 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.861 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.861 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.es6 66/31 ECSubWrite(tid=17, reqid=client.4565.0:612, at_version=66'8, trim_to=0'0, roll_forward_to=39'6))", 2024-09-17T18:16:04.861 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:01.556538+0000", 2024-09-17T18:16:04.861 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.1994190150000001, 2024-09-17T18:16:04.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039288259999999998, 2024-09-17T18:16:04.861 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:04.861 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:04.861 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:04.862 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:04.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:04.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:01.556538+0000", 2024-09-17T18:16:04.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:04.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:01.556538+0000", 2024-09-17T18:16:04.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:04.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:04.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:01.556539+0000", 2024-09-17T18:16:04.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3300000000000002e-07 2024-09-17T18:16:04.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:04.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:01.556905+0000", 2024-09-17T18:16:04.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00036629000000000002 2024-09-17T18:16:04.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:04.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:01.556927+0000", 2024-09-17T18:16:04.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2016000000000001e-05 2024-09-17T18:16:04.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:04.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:01.556942+0000", 2024-09-17T18:16:04.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5296000000000001e-05 2024-09-17T18:16:04.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:04.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:01.557026+0000", 2024-09-17T18:16:04.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3249000000000002e-05 2024-09-17T18:16:04.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:04.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:01.557037+0000", 2024-09-17T18:16:04.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0951000000000001e-05 2024-09-17T18:16:04.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:04.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:01.560385+0000", 2024-09-17T18:16:04.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003348326 2024-09-17T18:16:04.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:04.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:04.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:04.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:01.560467+0000", 2024-09-17T18:16:04.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2164999999999997e-05 2024-09-17T18:16:04.866 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.866 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.866 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.866 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:04.866 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:04.867 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:04.868 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T18:16:04.869 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:04.866+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:04.969 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:04.966+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:05.002 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:05.003 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:05.003 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:16:05.003 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:05.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T18:16:05.070 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:05.066+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:05.139 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:05.139 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:05.139 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:16:05.139 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:16:05.139 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:05.154 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T18:16:05.171 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:05.169+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:05.271 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:05.270+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:05.274 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:05.274 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:16:05.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:16:05.274 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:16:05.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.275 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 42/31 ECSubWrite(tid=87, reqid=client.4565.0:358, at_version=42'26, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:05.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.775695+0000", 2024-09-17T18:16:05.275 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.496020328, 2024-09-17T18:16:05.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013035743000000001, 2024-09-17T18:16:05.275 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.275 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775695+0000", 2024-09-17T18:16:05.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775695+0000", 2024-09-17T18:16:05.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775696+0000", 2024-09-17T18:16:05.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0699999999999997e-07 2024-09-17T18:16:05.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775753+0000", 2024-09-17T18:16:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7274000000000001e-05 2024-09-17T18:16:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775787+0000", 2024-09-17T18:16:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4102e-05 2024-09-17T18:16:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775810+0000", 2024-09-17T18:16:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3019000000000001e-05 2024-09-17T18:16:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775978+0000", 2024-09-17T18:16:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167546 2024-09-17T18:16:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.776002+0000", 2024-09-17T18:16:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4632000000000001e-05 2024-09-17T18:16:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788652+0000", 2024-09-17T18:16:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012649237000000001 2024-09-17T18:16:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788731+0000", 2024-09-17T18:16:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9425999999999995e-05 2024-09-17T18:16:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 42/31 ECSubWrite(tid=90, reqid=client.4565.0:359, at_version=42'27, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.775871+0000", 2024-09-17T18:16:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.495844911999999, 2024-09-17T18:16:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012923420999999999, 2024-09-17T18:16:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775871+0000", 2024-09-17T18:16:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775871+0000", 2024-09-17T18:16:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775872+0000", 2024-09-17T18:16:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0699999999999996e-07 2024-09-17T18:16:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775911+0000", 2024-09-17T18:16:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9221000000000003e-05 2024-09-17T18:16:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775936+0000", 2024-09-17T18:16:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5459000000000001e-05 2024-09-17T18:16:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775955+0000", 2024-09-17T18:16:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8998999999999999e-05 2024-09-17T18:16:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777777+0000", 2024-09-17T18:16:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001821135 2024-09-17T18:16:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777801+0000", 2024-09-17T18:16:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4122e-05 2024-09-17T18:16:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788743+0000", 2024-09-17T18:16:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010942383999999999 2024-09-17T18:16:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788794+0000", 2024-09-17T18:16:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1193999999999998e-05 2024-09-17T18:16:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 42/31 ECSubWrite(tid=92, reqid=client.4565.0:360, at_version=42'28, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.775988+0000", 2024-09-17T18:16:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.495727943999999, 2024-09-17T18:16:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012876787000000001, 2024-09-17T18:16:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775988+0000", 2024-09-17T18:16:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775988+0000", 2024-09-17T18:16:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775989+0000", 2024-09-17T18:16:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.08e-06 2024-09-17T18:16:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.776033+0000", 2024-09-17T18:16:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3857999999999999e-05 2024-09-17T18:16:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.776056+0000", 2024-09-17T18:16:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3691999999999999e-05 2024-09-17T18:16:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.776078+0000", 2024-09-17T18:16:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1265999999999999e-05 2024-09-17T18:16:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.779264+0000", 2024-09-17T18:16:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031865909999999999 2024-09-17T18:16:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.779283+0000", 2024-09-17T18:16:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8255000000000001e-05 2024-09-17T18:16:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788809+0000", 2024-09-17T18:16:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095260740000000007 2024-09-17T18:16:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.788865+0000", 2024-09-17T18:16:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5971000000000003e-05 2024-09-17T18:16:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 42/31 ECSubWrite(tid=93, reqid=osd.4.0:93, at_version=42'30, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.777940+0000", 2024-09-17T18:16:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.493775992, 2024-09-17T18:16:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011561182999999999, 2024-09-17T18:16:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777940+0000", 2024-09-17T18:16:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777940+0000", 2024-09-17T18:16:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777941+0000", 2024-09-17T18:16:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1400000000000001e-06 2024-09-17T18:16:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777978+0000", 2024-09-17T18:16:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7509999999999998e-05 2024-09-17T18:16:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777997+0000", 2024-09-17T18:16:05.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8683999999999999e-05 2024-09-17T18:16:05.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.778010+0000", 2024-09-17T18:16:05.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2976000000000001e-05 2024-09-17T18:16:05.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.785277+0000", 2024-09-17T18:16:05.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072665289999999999 2024-09-17T18:16:05.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.785301+0000", 2024-09-17T18:16:05.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4579e-05 2024-09-17T18:16:05.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789423+0000", 2024-09-17T18:16:05.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041222949999999998 2024-09-17T18:16:05.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789501+0000", 2024-09-17T18:16:05.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7470000000000002e-05 2024-09-17T18:16:05.294 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.294 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.294 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.294 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 42/31 ECSubWrite(tid=96, reqid=osd.4.0:96, at_version=42'32, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:05.294 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.780330+0000", 2024-09-17T18:16:05.294 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.491385565000002, 2024-09-17T18:16:05.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010450348, 2024-09-17T18:16:05.294 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.294 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.294 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.295 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780330+0000", 2024-09-17T18:16:05.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780330+0000", 2024-09-17T18:16:05.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780332+0000", 2024-09-17T18:16:05.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.426e-06 2024-09-17T18:16:05.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780362+0000", 2024-09-17T18:16:05.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0756999999999997e-05 2024-09-17T18:16:05.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780391+0000", 2024-09-17T18:16:05.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.864e-05 2024-09-17T18:16:05.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780407+0000", 2024-09-17T18:16:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5784e-05 2024-09-17T18:16:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.786414+0000", 2024-09-17T18:16:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060069770000000001 2024-09-17T18:16:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.786436+0000", 2024-09-17T18:16:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2033000000000001e-05 2024-09-17T18:16:05.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.790707+0000", 2024-09-17T18:16:05.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042716220000000001 2024-09-17T18:16:05.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.790780+0000", 2024-09-17T18:16:05.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3108999999999994e-05 2024-09-17T18:16:05.298 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.298 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.299 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 43/31 ECSubWrite(tid=105, reqid=osd.4.0:105, at_version=43'38, trim_to=0'0, roll_forward_to=42'34))", 2024-09-17T18:16:05.299 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.769850+0000", 2024-09-17T18:16:05.299 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.501865408, 2024-09-17T18:16:05.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083480640000000005, 2024-09-17T18:16:05.299 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.299 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.299 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.299 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.769850+0000", 2024-09-17T18:16:05.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.769850+0000", 2024-09-17T18:16:05.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.769852+0000", 2024-09-17T18:16:05.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7600000000000001e-06 2024-09-17T18:16:05.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.769908+0000", 2024-09-17T18:16:05.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6082000000000003e-05 2024-09-17T18:16:05.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.769984+0000", 2024-09-17T18:16:05.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5828999999999995e-05 2024-09-17T18:16:05.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.770007+0000", 2024-09-17T18:16:05.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3033000000000001e-05 2024-09-17T18:16:05.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.770609+0000", 2024-09-17T18:16:05.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00060163800000000004 2024-09-17T18:16:05.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.770648+0000", 2024-09-17T18:16:05.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9294e-05 2024-09-17T18:16:05.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778125+0000", 2024-09-17T18:16:05.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074772190000000002 2024-09-17T18:16:05.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778198+0000", 2024-09-17T18:16:05.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3208999999999997e-05 2024-09-17T18:16:05.303 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.303 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.303 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.304 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 43/31 ECSubWrite(tid=136, reqid=osd.6.0:136, at_version=43'21, trim_to=0'0, roll_forward_to=42'17))", 2024-09-17T18:16:05.304 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.781138+0000", 2024-09-17T18:16:05.304 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.490577992999999, 2024-09-17T18:16:05.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088701509999999997, 2024-09-17T18:16:05.304 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.304 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.304 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.304 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781138+0000", 2024-09-17T18:16:05.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781138+0000", 2024-09-17T18:16:05.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781140+0000", 2024-09-17T18:16:05.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9400000000000001e-06 2024-09-17T18:16:05.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781194+0000", 2024-09-17T18:16:05.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4397000000000001e-05 2024-09-17T18:16:05.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781230+0000", 2024-09-17T18:16:05.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5995999999999999e-05 2024-09-17T18:16:05.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781253+0000", 2024-09-17T18:16:05.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3402000000000001e-05 2024-09-17T18:16:05.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781430+0000", 2024-09-17T18:16:05.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017692900000000001 2024-09-17T18:16:05.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781455+0000", 2024-09-17T18:16:05.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4579e-05 2024-09-17T18:16:05.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.789864+0000", 2024-09-17T18:16:05.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084094110000000003 2024-09-17T18:16:05.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.790008+0000", 2024-09-17T18:16:05.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143497 2024-09-17T18:16:05.308 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.308 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.308 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.309 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 43/31 ECSubWrite(tid=108, reqid=osd.4.0:105, at_version=0'0, trim_to=0'0, roll_forward_to=43'38))", 2024-09-17T18:16:05.309 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.784773+0000", 2024-09-17T18:16:05.309 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.486943059000001, 2024-09-17T18:16:05.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095347230000000002, 2024-09-17T18:16:05.309 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.309 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.309 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.309 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.784773+0000", 2024-09-17T18:16:05.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.784773+0000", 2024-09-17T18:16:05.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.784775+0000", 2024-09-17T18:16:05.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1069999999999999e-06 2024-09-17T18:16:05.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.784804+0000", 2024-09-17T18:16:05.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8992e-05 2024-09-17T18:16:05.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.784842+0000", 2024-09-17T18:16:05.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7789e-05 2024-09-17T18:16:05.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.784870+0000", 2024-09-17T18:16:05.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8208000000000002e-05 2024-09-17T18:16:05.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.785024+0000", 2024-09-17T18:16:05.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000154074 2024-09-17T18:16:05.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.785049+0000", 2024-09-17T18:16:05.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4719000000000002e-05 2024-09-17T18:16:05.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.794245+0000", 2024-09-17T18:16:05.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091964739999999996 2024-09-17T18:16:05.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.794307+0000", 2024-09-17T18:16:05.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2360000000000006e-05 2024-09-17T18:16:05.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.313 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.314 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 43/31 ECSubWrite(tid=109, reqid=osd.4.0:109, at_version=43'40, trim_to=0'0, roll_forward_to=43'38))", 2024-09-17T18:16:05.314 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.786711+0000", 2024-09-17T18:16:05.314 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.485005002000001, 2024-09-17T18:16:05.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010030938999999999, 2024-09-17T18:16:05.314 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.314 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.314 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.314 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786711+0000", 2024-09-17T18:16:05.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786711+0000", 2024-09-17T18:16:05.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786712+0000", 2024-09-17T18:16:05.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4279999999999999e-06 2024-09-17T18:16:05.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786752+0000", 2024-09-17T18:16:05.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0339999999999997e-05 2024-09-17T18:16:05.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786775+0000", 2024-09-17T18:16:05.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2657e-05 2024-09-17T18:16:05.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786794+0000", 2024-09-17T18:16:05.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9108999999999999e-05 2024-09-17T18:16:05.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786985+0000", 2024-09-17T18:16:05.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019076499999999999 2024-09-17T18:16:05.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.787010+0000", 2024-09-17T18:16:05.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4686e-05 2024-09-17T18:16:05.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.796653+0000", 2024-09-17T18:16:05.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096438080000000002 2024-09-17T18:16:05.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.796742+0000", 2024-09-17T18:16:05.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8146000000000006e-05 2024-09-17T18:16:05.318 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.318 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.318 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.318 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 43/31 ECSubWrite(tid=110, reqid=osd.4.0:110, at_version=43'42, trim_to=0'0, roll_forward_to=43'38))", 2024-09-17T18:16:05.318 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.787750+0000", 2024-09-17T18:16:05.318 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.483965664999999, 2024-09-17T18:16:05.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012045577999999999, 2024-09-17T18:16:05.319 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.319 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.319 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.319 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.787750+0000", 2024-09-17T18:16:05.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.787750+0000", 2024-09-17T18:16:05.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.787752+0000", 2024-09-17T18:16:05.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0760000000000001e-06 2024-09-17T18:16:05.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.787805+0000", 2024-09-17T18:16:05.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2507999999999999e-05 2024-09-17T18:16:05.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.787847+0000", 2024-09-17T18:16:05.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2345000000000002e-05 2024-09-17T18:16:05.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.787869+0000", 2024-09-17T18:16:05.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1849e-05 2024-09-17T18:16:05.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.794393+0000", 2024-09-17T18:16:05.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065246480000000001 2024-09-17T18:16:05.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.794413+0000", 2024-09-17T18:16:05.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9485999999999999e-05 2024-09-17T18:16:05.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.799702+0000", 2024-09-17T18:16:05.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052890699999999999 2024-09-17T18:16:05.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.799796+0000", 2024-09-17T18:16:05.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3596000000000003e-05 2024-09-17T18:16:05.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.323 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.323 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 43/31 ECSubWrite(tid=189, reqid=osd.13.0:189, at_version=43'85, trim_to=0'0, roll_forward_to=43'81))", 2024-09-17T18:16:05.323 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.807401+0000", 2024-09-17T18:16:05.323 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.464314818999998, 2024-09-17T18:16:05.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074491890000000002, 2024-09-17T18:16:05.323 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.323 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.323 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.324 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807401+0000", 2024-09-17T18:16:05.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807401+0000", 2024-09-17T18:16:05.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807403+0000", 2024-09-17T18:16:05.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1330000000000002e-06 2024-09-17T18:16:05.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807495+0000", 2024-09-17T18:16:05.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.187e-05 2024-09-17T18:16:05.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807527+0000", 2024-09-17T18:16:05.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2072000000000001e-05 2024-09-17T18:16:05.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807562+0000", 2024-09-17T18:16:05.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5268999999999997e-05 2024-09-17T18:16:05.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807784+0000", 2024-09-17T18:16:05.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221936 2024-09-17T18:16:05.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.807809+0000", 2024-09-17T18:16:05.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4868999999999999e-05 2024-09-17T18:16:05.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.814780+0000", 2024-09-17T18:16:05.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069705779999999998 2024-09-17T18:16:05.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.814850+0000", 2024-09-17T18:16:05.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0462000000000004e-05 2024-09-17T18:16:05.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.327 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.328 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 43/31 ECSubWrite(tid=191, reqid=osd.13.0:191, at_version=43'87, trim_to=0'0, roll_forward_to=43'81))", 2024-09-17T18:16:05.328 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.809886+0000", 2024-09-17T18:16:05.328 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.461829867999999, 2024-09-17T18:16:05.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010136275, 2024-09-17T18:16:05.328 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.328 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.328 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.328 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.809886+0000", 2024-09-17T18:16:05.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.809886+0000", 2024-09-17T18:16:05.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.809893+0000", 2024-09-17T18:16:05.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9659999999999999e-06 2024-09-17T18:16:05.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.809956+0000", 2024-09-17T18:16:05.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2836999999999995e-05 2024-09-17T18:16:05.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.809978+0000", 2024-09-17T18:16:05.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2436999999999999e-05 2024-09-17T18:16:05.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.809993+0000", 2024-09-17T18:16:05.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5335000000000001e-05 2024-09-17T18:16:05.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.810143+0000", 2024-09-17T18:16:05.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149887 2024-09-17T18:16:05.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.810163+0000", 2024-09-17T18:16:05.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9284e-05 2024-09-17T18:16:05.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.819955+0000", 2024-09-17T18:16:05.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0097923009999999998 2024-09-17T18:16:05.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.820022+0000", 2024-09-17T18:16:05.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7228000000000001e-05 2024-09-17T18:16:05.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.332 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.332 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 43/31 ECSubWrite(tid=112, reqid=osd.4.0:110, at_version=0'0, trim_to=0'0, roll_forward_to=43'42))", 2024-09-17T18:16:05.333 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.812167+0000", 2024-09-17T18:16:05.333 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.459548422000001, 2024-09-17T18:16:05.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077905739999999998, 2024-09-17T18:16:05.333 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.333 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.333 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.333 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812167+0000", 2024-09-17T18:16:05.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812167+0000", 2024-09-17T18:16:05.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812169+0000", 2024-09-17T18:16:05.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9659999999999999e-06 2024-09-17T18:16:05.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812195+0000", 2024-09-17T18:16:05.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5726000000000001e-05 2024-09-17T18:16:05.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812225+0000", 2024-09-17T18:16:05.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0352e-05 2024-09-17T18:16:05.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812248+0000", 2024-09-17T18:16:05.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2316000000000001e-05 2024-09-17T18:16:05.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812380+0000", 2024-09-17T18:16:05.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000132781 2024-09-17T18:16:05.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812399+0000", 2024-09-17T18:16:05.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8286000000000001e-05 2024-09-17T18:16:05.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.819899+0000", 2024-09-17T18:16:05.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075004049999999999 2024-09-17T18:16:05.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.819958+0000", 2024-09-17T18:16:05.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8742000000000001e-05 2024-09-17T18:16:05.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.337 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.337 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 54/31 ECSubWrite(tid=278, reqid=client.4565.0:503, at_version=54'72, trim_to=0'0, roll_forward_to=52'68))", 2024-09-17T18:16:05.337 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:49.319817+0000", 2024-09-17T18:16:05.338 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.95189824, 2024-09-17T18:16:05.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075735790000000004, 2024-09-17T18:16:05.338 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.338 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.338 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.338 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.319817+0000", 2024-09-17T18:16:05.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.319817+0000", 2024-09-17T18:16:05.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.319819+0000", 2024-09-17T18:16:05.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8470000000000001e-06 2024-09-17T18:16:05.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.319864+0000", 2024-09-17T18:16:05.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4351999999999998e-05 2024-09-17T18:16:05.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.319894+0000", 2024-09-17T18:16:05.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0645999999999998e-05 2024-09-17T18:16:05.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.319921+0000", 2024-09-17T18:16:05.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6605999999999999e-05 2024-09-17T18:16:05.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.320240+0000", 2024-09-17T18:16:05.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031921899999999998 2024-09-17T18:16:05.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.320266+0000", 2024-09-17T18:16:05.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5641999999999999e-05 2024-09-17T18:16:05.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.327299+0000", 2024-09-17T18:16:05.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070333069999999999 2024-09-17T18:16:05.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.327391+0000", 2024-09-17T18:16:05.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1959999999999994e-05 2024-09-17T18:16:05.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.342 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.342 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 59/31 ECSubWrite(tid=341, reqid=client.4565.0:547, at_version=59'182, trim_to=0'0, roll_forward_to=58'180))", 2024-09-17T18:16:05.342 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:54.404079+0000", 2024-09-17T18:16:05.342 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.867636231000001, 2024-09-17T18:16:05.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014994599000000001, 2024-09-17T18:16:05.342 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.342 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.343 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.343 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.404079+0000", 2024-09-17T18:16:05.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.404079+0000", 2024-09-17T18:16:05.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.404082+0000", 2024-09-17T18:16:05.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2029999999999999e-06 2024-09-17T18:16:05.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.406248+0000", 2024-09-17T18:16:05.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021663989999999998 2024-09-17T18:16:05.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.406303+0000", 2024-09-17T18:16:05.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4895000000000002e-05 2024-09-17T18:16:05.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.406333+0000", 2024-09-17T18:16:05.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0488999999999999e-05 2024-09-17T18:16:05.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.406521+0000", 2024-09-17T18:16:05.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018711800000000001 2024-09-17T18:16:05.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.406554+0000", 2024-09-17T18:16:05.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3716e-05 2024-09-17T18:16:05.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.419000+0000", 2024-09-17T18:16:05.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012445820999999999 2024-09-17T18:16:05.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.419074+0000", 2024-09-17T18:16:05.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3957999999999999e-05 2024-09-17T18:16:05.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.346 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.347 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.347 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 64/31 ECSubWrite(tid=397, reqid=osd.13.0:397, at_version=64'124, trim_to=0'0, roll_forward_to=62'122))", 2024-09-17T18:16:05.347 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:59.315167+0000", 2024-09-17T18:16:05.347 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9565487099999999, 2024-09-17T18:16:05.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010291763000000001, 2024-09-17T18:16:05.347 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.347 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.347 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.347 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.315167+0000", 2024-09-17T18:16:05.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.315167+0000", 2024-09-17T18:16:05.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.315168+0000", 2024-09-17T18:16:05.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2300000000000001e-07 2024-09-17T18:16:05.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.315299+0000", 2024-09-17T18:16:05.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131531 2024-09-17T18:16:05.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.315329+0000", 2024-09-17T18:16:05.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9869000000000002e-05 2024-09-17T18:16:05.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.315353+0000", 2024-09-17T18:16:05.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3669e-05 2024-09-17T18:16:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.315694+0000", 2024-09-17T18:16:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000341114 2024-09-17T18:16:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.315722+0000", 2024-09-17T18:16:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.777e-05 2024-09-17T18:16:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.325365+0000", 2024-09-17T18:16:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096436119999999993 2024-09-17T18:16:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.325459+0000", 2024-09-17T18:16:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3574999999999998e-05 2024-09-17T18:16:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.351 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 64/31 ECSubWrite(tid=398, reqid=osd.13.0:398, at_version=64'205, trim_to=0'0, roll_forward_to=62'203))", 2024-09-17T18:16:05.352 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:59.318134+0000", 2024-09-17T18:16:05.352 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9535819620000003, 2024-09-17T18:16:05.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085825369999999995, 2024-09-17T18:16:05.352 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.352 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.352 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.352 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.318134+0000", 2024-09-17T18:16:05.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.318134+0000", 2024-09-17T18:16:05.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.318136+0000", 2024-09-17T18:16:05.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2500000000000001e-06 2024-09-17T18:16:05.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.318185+0000", 2024-09-17T18:16:05.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9245e-05 2024-09-17T18:16:05.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.318232+0000", 2024-09-17T18:16:05.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6646e-05 2024-09-17T18:16:05.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.318255+0000", 2024-09-17T18:16:05.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2959000000000002e-05 2024-09-17T18:16:05.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.318454+0000", 2024-09-17T18:16:05.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000199235 2024-09-17T18:16:05.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.318479+0000", 2024-09-17T18:16:05.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5131999999999999e-05 2024-09-17T18:16:05.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.326643+0000", 2024-09-17T18:16:05.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081636460000000001 2024-09-17T18:16:05.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.326716+0000", 2024-09-17T18:16:05.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3423999999999994e-05 2024-09-17T18:16:05.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.356 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.357 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 64/31 ECSubWrite(tid=400, reqid=osd.13.0:400, at_version=64'126, trim_to=0'0, roll_forward_to=62'122))", 2024-09-17T18:16:05.357 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:59.319392+0000", 2024-09-17T18:16:05.357 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9523237020000002, 2024-09-17T18:16:05.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090603209999999997, 2024-09-17T18:16:05.357 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.357 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.357 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.358 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319392+0000", 2024-09-17T18:16:05.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319392+0000", 2024-09-17T18:16:05.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319393+0000", 2024-09-17T18:16:05.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.393e-06 2024-09-17T18:16:05.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319467+0000", 2024-09-17T18:16:05.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3517999999999996e-05 2024-09-17T18:16:05.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319495+0000", 2024-09-17T18:16:05.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7623e-05 2024-09-17T18:16:05.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319516+0000", 2024-09-17T18:16:05.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1160000000000001e-05 2024-09-17T18:16:05.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.321074+0000", 2024-09-17T18:16:05.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001557824 2024-09-17T18:16:05.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.321102+0000", 2024-09-17T18:16:05.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8829000000000001e-05 2024-09-17T18:16:05.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.328372+0000", 2024-09-17T18:16:05.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072695930000000004 2024-09-17T18:16:05.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.328452+0000", 2024-09-17T18:16:05.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0381000000000002e-05 2024-09-17T18:16:05.361 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.361 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.361 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.362 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 64/31 ECSubWrite(tid=401, reqid=osd.13.0:401, at_version=64'207, trim_to=0'0, roll_forward_to=62'203))", 2024-09-17T18:16:05.362 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:59.320918+0000", 2024-09-17T18:16:05.362 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9507979200000003, 2024-09-17T18:16:05.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076670150000000001, 2024-09-17T18:16:05.362 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.362 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.362 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.362 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.320918+0000", 2024-09-17T18:16:05.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.320918+0000", 2024-09-17T18:16:05.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.320919+0000", 2024-09-17T18:16:05.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5770000000000001e-06 2024-09-17T18:16:05.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.320982+0000", 2024-09-17T18:16:05.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2539000000000006e-05 2024-09-17T18:16:05.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.321018+0000", 2024-09-17T18:16:05.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5908999999999998e-05 2024-09-17T18:16:05.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.321041+0000", 2024-09-17T18:16:05.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2802e-05 2024-09-17T18:16:05.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.321199+0000", 2024-09-17T18:16:05.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015831600000000001 2024-09-17T18:16:05.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.321224+0000", 2024-09-17T18:16:05.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5143e-05 2024-09-17T18:16:05.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.328499+0000", 2024-09-17T18:16:05.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072745550000000003 2024-09-17T18:16:05.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.328585+0000", 2024-09-17T18:16:05.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6174000000000005e-05 2024-09-17T18:16:05.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.366 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.366 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 65/31 ECSubWrite(tid=416, reqid=osd.13.0:416, at_version=65'217, trim_to=0'0, roll_forward_to=65'213))", 2024-09-17T18:16:05.366 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:00.356457+0000", 2024-09-17T18:16:05.366 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.9152589149999999, 2024-09-17T18:16:05.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010011841, 2024-09-17T18:16:05.367 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.367 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.367 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.367 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356457+0000", 2024-09-17T18:16:05.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356457+0000", 2024-09-17T18:16:05.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356458+0000", 2024-09-17T18:16:05.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6600000000000005e-07 2024-09-17T18:16:05.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356477+0000", 2024-09-17T18:16:05.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9440999999999999e-05 2024-09-17T18:16:05.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356488+0000", 2024-09-17T18:16:05.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0961000000000001e-05 2024-09-17T18:16:05.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356496+0000", 2024-09-17T18:16:05.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0860000000000002e-06 2024-09-17T18:16:05.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356623+0000", 2024-09-17T18:16:05.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012676399999999999 2024-09-17T18:16:05.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356648+0000", 2024-09-17T18:16:05.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5239e-05 2024-09-17T18:16:05.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.366433+0000", 2024-09-17T18:16:05.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0097845710000000006 2024-09-17T18:16:05.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.366469+0000", 2024-09-17T18:16:05.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5913e-05 2024-09-17T18:16:05.371 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.371 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.371 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.371 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.371 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.371 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:05.371 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T18:16:05.373 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T18:16:05.374 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:05.370+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:05.417 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.8 to 1 (10000) 2024-09-17T18:16:05.421 INFO:tasks.rados.rados.0.smithi154.stdout:255: done (1 left) 2024-09-17T18:16:05.421 INFO:tasks.rados.rados.0.smithi154.stdout:256: done (0 left) 2024-09-17T18:16:05.421 INFO:tasks.rados.rados.0.smithi154.stdout:257: delete oid 18 current snap is 25 2024-09-17T18:16:05.433 INFO:tasks.rados.rados.0.smithi154.stdout:257: done (0 left) 2024-09-17T18:16:05.433 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 26 current snap is 25 2024-09-17T18:16:05.433 INFO:tasks.rados.rados.0.smithi154.stdout:258: seq_num 113 ranges {0=737280,737280=557056,1294336=606208} 2024-09-17T18:16:05.440 INFO:tasks.rados.rados.0.smithi154.stdout:258: writing smithi15432074-26 from 0 to 737280 tid 1 2024-09-17T18:16:05.442 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 9 1 2024-09-17T18:16:05.447 INFO:tasks.rados.rados.0.smithi154.stdout:258: writing smithi15432074-26 from 737280 to 1294336 tid 2 2024-09-17T18:16:05.454 INFO:tasks.rados.rados.0.smithi154.stdout:258: writing smithi15432074-26 from 1294336 to 1900544 tid 3 2024-09-17T18:16:05.454 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 34 current snap is 25 2024-09-17T18:16:05.454 INFO:tasks.rados.rados.0.smithi154.stdout:259: seq_num 114 ranges {475136=753664,1228800=688128,1916928=475136} 2024-09-17T18:16:05.468 INFO:tasks.rados.rados.0.smithi154.stdout:259: writing smithi15432074-34 from 475136 to 1228800 tid 1 2024-09-17T18:16:05.474 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:16:05.470+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:16:05.476 INFO:tasks.rados.rados.0.smithi154.stdout:259: writing smithi15432074-34 from 1228800 to 1916928 tid 2 2024-09-17T18:16:05.482 INFO:tasks.rados.rados.0.smithi154.stdout:259: writing smithi15432074-34 from 1916928 to 2392064 tid 3 2024-09-17T18:16:05.482 INFO:tasks.rados.rados.0.smithi154.stdout:260: delete oid 21 current snap is 25 2024-09-17T18:16:05.482 INFO:tasks.rados.rados.0.smithi154.stdout:258: finishing write tid 1 to smithi15432074-26 2024-09-17T18:16:05.482 INFO:tasks.rados.rados.0.smithi154.stdout:258: finishing write tid 2 to smithi15432074-26 2024-09-17T18:16:05.482 INFO:tasks.rados.rados.0.smithi154.stdout:258: finishing write tid 3 to smithi15432074-26 2024-09-17T18:16:05.482 INFO:tasks.rados.rados.0.smithi154.stdout:258: finishing write tid 4 to smithi15432074-26 2024-09-17T18:16:05.482 INFO:tasks.rados.rados.0.smithi154.stdout:258: finishing write tid 5 to smithi15432074-26 2024-09-17T18:16:05.482 INFO:tasks.rados.rados.0.smithi154.stdout:258: oid 26 updating version 0 to 29 2024-09-17T18:16:05.482 INFO:tasks.rados.rados.0.smithi154.stdout:258: oid 26 updating version 29 to 31 2024-09-17T18:16:05.482 INFO:tasks.rados.rados.0.smithi154.stdout:258: oid 26 version 31 is already newer than 30 2024-09-17T18:16:05.482 INFO:tasks.rados.rados.0.smithi154.stdout:258: oid 26 version 31 is already newer than 28 2024-09-17T18:16:05.483 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 26 v 31 (ObjNum 113 snap 25 seq_num 113) dirty exists 2024-09-17T18:16:05.483 INFO:tasks.rados.rados.0.smithi154.stdout:258: left oid 26 (ObjNum 113 snap 25 seq_num 113) 2024-09-17T18:16:05.483 INFO:tasks.rados.rados.0.smithi154.stdout:259: finishing write tid 1 to smithi15432074-34 2024-09-17T18:16:05.487 INFO:tasks.rados.rados.0.smithi154.stdout:259: finishing write tid 2 to smithi15432074-34 2024-09-17T18:16:05.489 INFO:tasks.rados.rados.0.smithi154.stdout:259: finishing write tid 3 to smithi15432074-34 2024-09-17T18:16:05.489 INFO:tasks.rados.rados.0.smithi154.stdout:259: finishing write tid 4 to smithi15432074-34 2024-09-17T18:16:05.489 INFO:tasks.rados.rados.0.smithi154.stdout:258: done (2 left) 2024-09-17T18:16:05.489 INFO:tasks.rados.rados.0.smithi154.stdout:260: done (1 left) 2024-09-17T18:16:05.489 INFO:tasks.rados.rados.0.smithi154.stdout:261: delete oid 3 current snap is 25 2024-09-17T18:16:05.491 INFO:tasks.rados.rados.0.smithi154.stdout:259: finishing write tid 5 to smithi15432074-34 2024-09-17T18:16:05.491 INFO:tasks.rados.rados.0.smithi154.stdout:259: oid 34 updating version 0 to 108 2024-09-17T18:16:05.491 INFO:tasks.rados.rados.0.smithi154.stdout:259: oid 34 version 108 is already newer than 107 2024-09-17T18:16:05.491 INFO:tasks.rados.rados.0.smithi154.stdout:259: oid 34 version 108 is already newer than 105 2024-09-17T18:16:05.491 INFO:tasks.rados.rados.0.smithi154.stdout:259: oid 34 version 108 is already newer than 106 2024-09-17T18:16:05.491 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 34 v 108 (ObjNum 114 snap 25 seq_num 114) dirty exists 2024-09-17T18:16:05.492 INFO:tasks.rados.rados.0.smithi154.stdout:259: left oid 34 (ObjNum 114 snap 25 seq_num 114) 2024-09-17T18:16:05.494 INFO:tasks.rados.rados.0.smithi154.stdout:259: done (1 left) 2024-09-17T18:16:05.494 INFO:tasks.rados.rados.0.smithi154.stdout:261: done (0 left) 2024-09-17T18:16:05.494 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 15 current snap is 25 2024-09-17T18:16:05.494 INFO:tasks.rados.rados.0.smithi154.stdout:262: seq_num 117 ranges {1671168=425984,2097152=606208,2703360=540672,3244032=409600} 2024-09-17T18:16:05.515 INFO:tasks.rados.rados.0.smithi154.stdout:262: writing smithi15432074-15 from 1671168 to 2097152 tid 1 2024-09-17T18:16:05.520 INFO:tasks.rados.rados.0.smithi154.stdout:262: writing smithi15432074-15 from 2097152 to 2703360 tid 2 2024-09-17T18:16:05.525 INFO:tasks.rados.rados.0.smithi154.stdout:262: writing smithi15432074-15 from 2703360 to 3244032 tid 3 2024-09-17T18:16:05.528 INFO:tasks.rados.rados.0.smithi154.stdout:262: writing smithi15432074-15 from 3244032 to 3653632 tid 4 2024-09-17T18:16:05.528 INFO:tasks.rados.rados.0.smithi154.stdout:263: delete oid 30 current snap is 25 2024-09-17T18:16:05.528 INFO:tasks.rados.rados.0.smithi154.stdout:262: finishing write tid 1 to smithi15432074-15 2024-09-17T18:16:05.530 INFO:tasks.rados.rados.0.smithi154.stdout:262: finishing write tid 2 to smithi15432074-15 2024-09-17T18:16:05.533 INFO:tasks.rados.rados.0.smithi154.stdout:262: finishing write tid 3 to smithi15432074-15 2024-09-17T18:16:05.535 INFO:tasks.rados.rados.0.smithi154.stdout:263: done (1 left) 2024-09-17T18:16:05.536 INFO:tasks.rados.rados.0.smithi154.stdout:264: snap_create 2024-09-17T18:16:05.538 INFO:tasks.rados.rados.0.smithi154.stdout:262: finishing write tid 4 to smithi15432074-15 2024-09-17T18:16:05.541 INFO:tasks.rados.rados.0.smithi154.stdout:262: finishing write tid 5 to smithi15432074-15 2024-09-17T18:16:05.543 INFO:tasks.rados.rados.0.smithi154.stdout:262: finishing write tid 6 to smithi15432074-15 2024-09-17T18:16:05.543 INFO:tasks.rados.rados.0.smithi154.stdout:262: oid 15 updating version 0 to 138 2024-09-17T18:16:05.543 INFO:tasks.rados.rados.0.smithi154.stdout:262: oid 15 updating version 138 to 139 2024-09-17T18:16:05.543 INFO:tasks.rados.rados.0.smithi154.stdout:262: oid 15 updating version 139 to 142 2024-09-17T18:16:05.543 INFO:tasks.rados.rados.0.smithi154.stdout:262: oid 15 version 142 is already newer than 141 2024-09-17T18:16:05.543 INFO:tasks.rados.rados.0.smithi154.stdout:262: oid 15 version 142 is already newer than 140 2024-09-17T18:16:05.543 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 15 v 142 (ObjNum 117 snap 25 seq_num 117) dirty exists 2024-09-17T18:16:05.543 INFO:tasks.rados.rados.0.smithi154.stdout:262: left oid 15 (ObjNum 117 snap 25 seq_num 117) 2024-09-17T18:16:05.562 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:05.562 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:05.562 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:16:05.562 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:05.575 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:05.573+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:05.576 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T18:16:05.676 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:05.674+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:05.740 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:16:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:16:05.745 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:05.754 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T18:16:05.799 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:05.798+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:05.877 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:05.874+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:05.879 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:05.879 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:16:05.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:16:05.879 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:16:05.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.879 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:361 3.cs0 3:38dc802b:::smithi15432074-44:head [copy-from ver 19] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:05.879 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764426+0000", 2024-09-17T18:16:05.879 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.111180828999998, 2024-09-17T18:16:05.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059937576999999999, 2024-09-17T18:16:05.879 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.879 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.880 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:05.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.880 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 361 2024-09-17T18:16:05.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.880 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764426+0000", 2024-09-17T18:16:05.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764426+0000", 2024-09-17T18:16:05.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764430+0000", 2024-09-17T18:16:05.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1930000000000003e-06 2024-09-17T18:16:05.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764447+0000", 2024-09-17T18:16:05.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6461999999999999e-05 2024-09-17T18:16:05.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764481+0000", 2024-09-17T18:16:05.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3905999999999997e-05 2024-09-17T18:16:05.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764498+0000", 2024-09-17T18:16:05.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7102e-05 2024-09-17T18:16:05.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764652+0000", 2024-09-17T18:16:05.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015383000000000001 2024-09-17T18:16:05.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:05.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764670+0000", 2024-09-17T18:16:05.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7946000000000001e-05 2024-09-17T18:16:05.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.769352+0000", 2024-09-17T18:16:05.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046824400000000004 2024-09-17T18:16:05.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.769609+0000", 2024-09-17T18:16:05.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025651899999999997 2024-09-17T18:16:05.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.818303+0000", 2024-09-17T18:16:05.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048694505999999999 2024-09-17T18:16:05.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.823809+0000", 2024-09-17T18:16:05.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055063359999999997 2024-09-17T18:16:05.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:05.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.824248+0000", 2024-09-17T18:16:05.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043867 2024-09-17T18:16:05.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.824364+0000", 2024-09-17T18:16:05.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115667 2024-09-17T18:16:05.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.886 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.886 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:362 3.cs0 3:38dc802b:::smithi15432074-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:05.886 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764538+0000", 2024-09-17T18:16:05.886 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.111069034, 2024-09-17T18:16:05.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058448629000000002, 2024-09-17T18:16:05.886 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.886 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.886 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:05.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.887 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.887 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 362 2024-09-17T18:16:05.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.887 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764538+0000", 2024-09-17T18:16:05.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764538+0000", 2024-09-17T18:16:05.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764540+0000", 2024-09-17T18:16:05.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.556e-06 2024-09-17T18:16:05.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764548+0000", 2024-09-17T18:16:05.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-17T18:16:05.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764570+0000", 2024-09-17T18:16:05.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2093e-05 2024-09-17T18:16:05.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764587+0000", 2024-09-17T18:16:05.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7048999999999999e-05 2024-09-17T18:16:05.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764835+0000", 2024-09-17T18:16:05.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024845899999999997 2024-09-17T18:16:05.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:05.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764853+0000", 2024-09-17T18:16:05.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7452000000000002e-05 2024-09-17T18:16:05.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.771487+0000", 2024-09-17T18:16:05.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066343749999999996 2024-09-17T18:16:05.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-09-17T18:16:05.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.771582+0000", 2024-09-17T18:16:05.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5038999999999996e-05 2024-09-17T18:16:05.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.822681+0000", 2024-09-17T18:16:05.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.051098466000000002 2024-09-17T18:16:05.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.822841+0000", 2024-09-17T18:16:05.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016044 2024-09-17T18:16:05.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.822987+0000", 2024-09-17T18:16:05.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145597 2024-09-17T18:16:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 42/31 ECSubWrite(tid=40, reqid=client.4565.0:363, at_version=42'26, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:16:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.767243+0000", 2024-09-17T18:16:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.108364275, 2024-09-17T18:16:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014866835, 2024-09-17T18:16:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767243+0000", 2024-09-17T18:16:05.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767243+0000", 2024-09-17T18:16:05.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767243+0000", 2024-09-17T18:16:05.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9299999999999998e-07 2024-09-17T18:16:05.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767281+0000", 2024-09-17T18:16:05.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7279e-05 2024-09-17T18:16:05.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767303+0000", 2024-09-17T18:16:05.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2575e-05 2024-09-17T18:16:05.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767319+0000", 2024-09-17T18:16:05.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5536000000000002e-05 2024-09-17T18:16:05.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767527+0000", 2024-09-17T18:16:05.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000208531 2024-09-17T18:16:05.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.767551+0000", 2024-09-17T18:16:05.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4046e-05 2024-09-17T18:16:05.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.782022+0000", 2024-09-17T18:16:05.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014470518999999999 2024-09-17T18:16:05.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.782110+0000", 2024-09-17T18:16:05.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7855999999999994e-05 2024-09-17T18:16:05.896 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.896 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.897 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 42/31 ECSubWrite(tid=45, reqid=osd.7.0:45, at_version=42'32, trim_to=0'0, roll_forward_to=42'30))", 2024-09-17T18:16:05.897 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.797590+0000", 2024-09-17T18:16:05.897 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.078016936000001, 2024-09-17T18:16:05.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010515893, 2024-09-17T18:16:05.897 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.897 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.897 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.897 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797590+0000", 2024-09-17T18:16:05.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797590+0000", 2024-09-17T18:16:05.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797592+0000", 2024-09-17T18:16:05.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.767e-06 2024-09-17T18:16:05.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797642+0000", 2024-09-17T18:16:05.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0553999999999997e-05 2024-09-17T18:16:05.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797676+0000", 2024-09-17T18:16:05.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3287999999999997e-05 2024-09-17T18:16:05.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797704+0000", 2024-09-17T18:16:05.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8632999999999998e-05 2024-09-17T18:16:05.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797821+0000", 2024-09-17T18:16:05.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011641699999999999 2024-09-17T18:16:05.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797835+0000", 2024-09-17T18:16:05.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3947e-05 2024-09-17T18:16:05.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.808015+0000", 2024-09-17T18:16:05.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010180708 2024-09-17T18:16:05.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.808106+0000", 2024-09-17T18:16:05.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0579000000000001e-05 2024-09-17T18:16:05.901 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.901 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.901 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.901 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s4 43/31 ECSubWrite(tid=21, reqid=osd.0.0:20, at_version=0'0, trim_to=0'0, roll_forward_to=43'12))", 2024-09-17T18:16:05.902 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.791776+0000", 2024-09-17T18:16:05.902 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.083830543000001, 2024-09-17T18:16:05.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010331819000000001, 2024-09-17T18:16:05.902 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.902 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.902 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:05.902 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791776+0000", 2024-09-17T18:16:05.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791776+0000", 2024-09-17T18:16:05.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791778+0000", 2024-09-17T18:16:05.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.026e-06 2024-09-17T18:16:05.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791799+0000", 2024-09-17T18:16:05.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1965999999999999e-05 2024-09-17T18:16:05.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791827+0000", 2024-09-17T18:16:05.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7752000000000001e-05 2024-09-17T18:16:05.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791852+0000", 2024-09-17T18:16:05.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4318999999999999e-05 2024-09-17T18:16:05.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.792109+0000", 2024-09-17T18:16:05.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025731300000000001 2024-09-17T18:16:05.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.792134+0000", 2024-09-17T18:16:05.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5289000000000001e-05 2024-09-17T18:16:05.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.802016+0000", 2024-09-17T18:16:05.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0098818440000000007 2024-09-17T18:16:05.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.802108+0000", 2024-09-17T18:16:05.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2310000000000002e-05 2024-09-17T18:16:05.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.906 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.906 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:470 3.5s0 3:a2c8c783:::smithi15432074-23:head [append 0~770048] snapc 10=[10,e,d,c,b,a,9,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:16:05.906 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.394208+0000", 2024-09-17T18:16:05.906 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.481398853999998, 2024-09-17T18:16:05.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013112441000000001, 2024-09-17T18:16:05.906 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.906 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.906 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:05.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.907 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 470 2024-09-17T18:16:05.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.907 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.394208+0000", 2024-09-17T18:16:05.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.394208+0000", 2024-09-17T18:16:05.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.394212+0000", 2024-09-17T18:16:05.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.783e-06 2024-09-17T18:16:05.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.396103+0000", 2024-09-17T18:16:05.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001890536 2024-09-17T18:16:05.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.396139+0000", 2024-09-17T18:16:05.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6452000000000003e-05 2024-09-17T18:16:05.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.396162+0000", 2024-09-17T18:16:05.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.321e-05 2024-09-17T18:16:05.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.396348+0000", 2024-09-17T18:16:05.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000185627 2024-09-17T18:16:05.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.396612+0000", 2024-09-17T18:16:05.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026402400000000002 2024-09-17T18:16:05.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.399779+0000", 2024-09-17T18:16:05.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003167034 2024-09-17T18:16:05.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.406389+0000", 2024-09-17T18:16:05.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066103330000000004 2024-09-17T18:16:05.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:05.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.407075+0000", 2024-09-17T18:16:05.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00068585399999999996 2024-09-17T18:16:05.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.407321+0000", 2024-09-17T18:16:05.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024558799999999998 2024-09-17T18:16:05.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.912 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.912 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.912 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:471 3.5s0 3:a2c8c783:::smithi15432074-23:head [append 0~475136] snapc 10=[10,e,d,c,b,a,9,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:16:05.912 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.398508+0000", 2024-09-17T18:16:05.912 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.477099001999999, 2024-09-17T18:16:05.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015127979, 2024-09-17T18:16:05.912 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.912 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.912 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:05.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.913 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.913 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 471 2024-09-17T18:16:05.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.913 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.398508+0000", 2024-09-17T18:16:05.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.398508+0000", 2024-09-17T18:16:05.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.398511+0000", 2024-09-17T18:16:05.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1499999999999999e-06 2024-09-17T18:16:05.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.401134+0000", 2024-09-17T18:16:05.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026232780000000002 2024-09-17T18:16:05.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.401166+0000", 2024-09-17T18:16:05.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1068999999999997e-05 2024-09-17T18:16:05.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.401188+0000", 2024-09-17T18:16:05.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2138999999999999e-05 2024-09-17T18:16:05.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402672+0000", 2024-09-17T18:16:05.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014845800000000001 2024-09-17T18:16:05.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402945+0000", 2024-09-17T18:16:05.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027317999999999998 2024-09-17T18:16:05.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.404772+0000", 2024-09-17T18:16:05.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018261589999999999 2024-09-17T18:16:05.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.407924+0000", 2024-09-17T18:16:05.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003152434 2024-09-17T18:16:05.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:05.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.413412+0000", 2024-09-17T18:16:05.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054877520000000003 2024-09-17T18:16:05.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.413636+0000", 2024-09-17T18:16:05.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000224238 2024-09-17T18:16:05.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.917 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.918 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.918 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:472 3.5s0 3:a2c8c783:::smithi15432074-23:head [append 0~294912] snapc 10=[10,e,d,c,b,a,9,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:16:05.918 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.401285+0000", 2024-09-17T18:16:05.918 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.474321646, 2024-09-17T18:16:05.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013531102999999999, 2024-09-17T18:16:05.918 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.918 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.918 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:05.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.919 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.919 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 472 2024-09-17T18:16:05.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.919 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.401285+0000", 2024-09-17T18:16:05.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.401285+0000", 2024-09-17T18:16:05.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.401309+0000", 2024-09-17T18:16:05.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3693000000000002e-05 2024-09-17T18:16:05.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402070+0000", 2024-09-17T18:16:05.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00076068700000000002 2024-09-17T18:16:05.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402110+0000", 2024-09-17T18:16:05.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0669e-05 2024-09-17T18:16:05.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402131+0000", 2024-09-17T18:16:05.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0632000000000002e-05 2024-09-17T18:16:05.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.408140+0000", 2024-09-17T18:16:05.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060090309999999997 2024-09-17T18:16:05.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.408291+0000", 2024-09-17T18:16:05.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015131399999999999 2024-09-17T18:16:05.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.409479+0000", 2024-09-17T18:16:05.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001187958 2024-09-17T18:16:05.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.413958+0000", 2024-09-17T18:16:05.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044783720000000004 2024-09-17T18:16:05.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:05.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.414668+0000", 2024-09-17T18:16:05.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00071016199999999997 2024-09-17T18:16:05.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.414816+0000", 2024-09-17T18:16:05.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014858499999999999 2024-09-17T18:16:05.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.924 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.924 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:473 3.5s0 3:a2c8c783:::smithi15432074-23:head [setxattr _header (57) in=7b] snapc 10=[10,e,d,c,b,a,9,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:16:05.924 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.402167+0000", 2024-09-17T18:16:05.924 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.473439922000001, 2024-09-17T18:16:05.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017279360000000001, 2024-09-17T18:16:05.924 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.924 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.924 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:05.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.925 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 473 2024-09-17T18:16:05.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.925 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402167+0000", 2024-09-17T18:16:05.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402167+0000", 2024-09-17T18:16:05.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402169+0000", 2024-09-17T18:16:05.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.916e-06 2024-09-17T18:16:05.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402190+0000", 2024-09-17T18:16:05.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1223e-05 2024-09-17T18:16:05.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402216+0000", 2024-09-17T18:16:05.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5309000000000001e-05 2024-09-17T18:16:05.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402231+0000", 2024-09-17T18:16:05.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5509e-05 2024-09-17T18:16:05.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.410884+0000", 2024-09-17T18:16:05.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0086531990000000003 2024-09-17T18:16:05.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.411174+0000", 2024-09-17T18:16:05.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028940299999999998 2024-09-17T18:16:05.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.412548+0000", 2024-09-17T18:16:05.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001374754 2024-09-17T18:16:05.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.413961+0000", 2024-09-17T18:16:05.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014127390000000001 2024-09-17T18:16:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.419201+0000", 2024-09-17T18:16:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052399170000000002 2024-09-17T18:16:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.419446+0000", 2024-09-17T18:16:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024539100000000002 2024-09-17T18:16:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.930 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:474 3.5s0 3:a2c8c783:::smithi15432074-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:16:05.930 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.402261+0000", 2024-09-17T18:16:05.930 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.473346236000001, 2024-09-17T18:16:05.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023005754, 2024-09-17T18:16:05.930 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.930 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.930 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:05.930 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.930 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.930 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.930 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 474 2024-09-17T18:16:05.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.931 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402261+0000", 2024-09-17T18:16:05.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402261+0000", 2024-09-17T18:16:05.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402262+0000", 2024-09-17T18:16:05.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4899999999999999e-06 2024-09-17T18:16:05.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402269+0000", 2024-09-17T18:16:05.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-17T18:16:05.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402292+0000", 2024-09-17T18:16:05.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3223000000000001e-05 2024-09-17T18:16:05.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402307+0000", 2024-09-17T18:16:05.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4698999999999999e-05 2024-09-17T18:16:05.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.414926+0000", 2024-09-17T18:16:05.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012618704999999999 2024-09-17T18:16:05.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:05.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.415062+0000", 2024-09-17T18:16:05.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135962 2024-09-17T18:16:05.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.421765+0000", 2024-09-17T18:16:05.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006702871 2024-09-17T18:16:05.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.422025+0000", 2024-09-17T18:16:05.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026092800000000001 2024-09-17T18:16:05.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.425267+0000", 2024-09-17T18:16:05.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032411229999999998 2024-09-17T18:16:05.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.935 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.935 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:486 3.cs0 3:38dc802b:::smithi15432074-44:head [rollback d] snapc 10=[10,e,d,c,b,a,9,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:16:05.935 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.495733+0000", 2024-09-17T18:16:05.935 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.379873976999999, 2024-09-17T18:16:05.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010914418, 2024-09-17T18:16:05.935 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.935 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.935 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:05.935 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.936 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 486 2024-09-17T18:16:05.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.936 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495733+0000", 2024-09-17T18:16:05.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495733+0000", 2024-09-17T18:16:05.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495734+0000", 2024-09-17T18:16:05.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2899999999999999e-06 2024-09-17T18:16:05.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495742+0000", 2024-09-17T18:16:05.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.17e-06 2024-09-17T18:16:05.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495761+0000", 2024-09-17T18:16:05.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9619e-05 2024-09-17T18:16:05.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495776+0000", 2024-09-17T18:16:05.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5143000000000001e-05 2024-09-17T18:16:05.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.498331+0000", 2024-09-17T18:16:05.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025548799999999998 2024-09-17T18:16:05.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.498583+0000", 2024-09-17T18:16:05.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025148500000000002 2024-09-17T18:16:05.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.499883+0000", 2024-09-17T18:16:05.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013001429999999999 2024-09-17T18:16:05.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.504350+0000", 2024-09-17T18:16:05.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044670359999999997 2024-09-17T18:16:05.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:05.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.506595+0000", 2024-09-17T18:16:05.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002244855 2024-09-17T18:16:05.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.506647+0000", 2024-09-17T18:16:05.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2797000000000003e-05 2024-09-17T18:16:05.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.941 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.941 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:487 3.cs0 3:38dc802b:::smithi15432074-44:head [append 0~0] snapc 10=[10,e,d,c,b,a,9,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:16:05.941 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.495799+0000", 2024-09-17T18:16:05.941 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.379808142999998, 2024-09-17T18:16:05.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011588322, 2024-09-17T18:16:05.941 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.941 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.941 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:05.941 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.942 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 487 2024-09-17T18:16:05.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.942 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495799+0000", 2024-09-17T18:16:05.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495799+0000", 2024-09-17T18:16:05.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495800+0000", 2024-09-17T18:16:05.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.217e-06 2024-09-17T18:16:05.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495809+0000", 2024-09-17T18:16:05.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5429999999999994e-06 2024-09-17T18:16:05.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495825+0000", 2024-09-17T18:16:05.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6646e-05 2024-09-17T18:16:05.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.495838+0000", 2024-09-17T18:16:05.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2927e-05 2024-09-17T18:16:05.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.500688+0000", 2024-09-17T18:16:05.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048501630000000002 2024-09-17T18:16:05.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.500829+0000", 2024-09-17T18:16:05.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014030100000000001 2024-09-17T18:16:05.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.501524+0000", 2024-09-17T18:16:05.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00069572299999999998 2024-09-17T18:16:05.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.506771+0000", 2024-09-17T18:16:05.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052469500000000002 2024-09-17T18:16:05.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:05.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.506866+0000", 2024-09-17T18:16:05.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4309999999999997e-05 2024-09-17T18:16:05.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.507387+0000", 2024-09-17T18:16:05.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00052154199999999995 2024-09-17T18:16:05.946 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.946 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.947 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.947 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:500 3.cs0 3:3e0a97af:::smithi15432074-40:head [append 0~0] snapc 10=[10,e,d,c,b,a,9,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:16:05.947 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.520851+0000", 2024-09-17T18:16:05.947 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.354756434999999, 2024-09-17T18:16:05.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011797518, 2024-09-17T18:16:05.947 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.947 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.947 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:05.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.947 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 500 2024-09-17T18:16:05.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.948 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.520851+0000", 2024-09-17T18:16:05.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.520851+0000", 2024-09-17T18:16:05.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.520851+0000", 2024-09-17T18:16:05.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2200000000000003e-07 2024-09-17T18:16:05.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.520855+0000", 2024-09-17T18:16:05.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6899999999999998e-06 2024-09-17T18:16:05.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.520863+0000", 2024-09-17T18:16:05.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2619999999999998e-06 2024-09-17T18:16:05.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.520871+0000", 2024-09-17T18:16:05.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.413e-06 2024-09-17T18:16:05.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.524179+0000", 2024-09-17T18:16:05.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033083359999999998 2024-09-17T18:16:05.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.524297+0000", 2024-09-17T18:16:05.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011831499999999999 2024-09-17T18:16:05.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.526125+0000", 2024-09-17T18:16:05.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001828103 2024-09-17T18:16:05.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.529133+0000", 2024-09-17T18:16:05.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030072889999999998 2024-09-17T18:16:05.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:05.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.532557+0000", 2024-09-17T18:16:05.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034243170000000001 2024-09-17T18:16:05.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.532648+0000", 2024-09-17T18:16:05.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1070999999999996e-05 2024-09-17T18:16:05.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.952 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.953 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:599 3.cs0 3:38dc802b:::smithi15432074-44:10 [read 0~1523712,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-09-17T18:16:05.953 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:01.316724+0000", 2024-09-17T18:16:05.953 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.5588827529999998, 2024-09-17T18:16:05.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021213203, 2024-09-17T18:16:05.953 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.953 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.953 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:05.953 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.953 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.953 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.953 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 599 2024-09-17T18:16:05.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.954 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316724+0000", 2024-09-17T18:16:05.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316724+0000", 2024-09-17T18:16:05.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316728+0000", 2024-09-17T18:16:05.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5300000000000001e-06 2024-09-17T18:16:05.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316744+0000", 2024-09-17T18:16:05.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.645e-05 2024-09-17T18:16:05.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316786+0000", 2024-09-17T18:16:05.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1535999999999997e-05 2024-09-17T18:16:05.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316853+0000", 2024-09-17T18:16:05.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6973999999999999e-05 2024-09-17T18:16:05.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317003+0000", 2024-09-17T18:16:05.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015050600000000001 2024-09-17T18:16:05.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:05.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317027+0000", 2024-09-17T18:16:05.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3864000000000001e-05 2024-09-17T18:16:05.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.324538+0000", 2024-09-17T18:16:05.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075108040000000003 2024-09-17T18:16:05.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.324814+0000", 2024-09-17T18:16:05.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027571699999999998 2024-09-17T18:16:05.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.337937+0000", 2024-09-17T18:16:05.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013123822 2024-09-17T18:16:05.958 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.958 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.958 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.958 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:600 3.cs0 3:38dc802b:::smithi15432074-44:10 [read 0~1523712,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-09-17T18:16:05.958 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:01.316912+0000", 2024-09-17T18:16:05.958 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.5586948710000001, 2024-09-17T18:16:05.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023099135999999999, 2024-09-17T18:16:05.959 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.959 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.959 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:05.959 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.959 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.959 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.959 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 600 2024-09-17T18:16:05.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.959 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316912+0000", 2024-09-17T18:16:05.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316912+0000", 2024-09-17T18:16:05.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316914+0000", 2024-09-17T18:16:05.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8169999999999999e-06 2024-09-17T18:16:05.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316927+0000", 2024-09-17T18:16:05.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3339000000000001e-05 2024-09-17T18:16:05.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316950+0000", 2024-09-17T18:16:05.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2220000000000001e-05 2024-09-17T18:16:05.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316965+0000", 2024-09-17T18:16:05.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5248999999999999e-05 2024-09-17T18:16:05.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317186+0000", 2024-09-17T18:16:05.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022110899999999999 2024-09-17T18:16:05.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:05.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317203+0000", 2024-09-17T18:16:05.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6979000000000001e-05 2024-09-17T18:16:05.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.325935+0000", 2024-09-17T18:16:05.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087319549999999996 2024-09-17T18:16:05.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.326231+0000", 2024-09-17T18:16:05.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000295846 2024-09-17T18:16:05.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.340011+0000", 2024-09-17T18:16:05.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013780621999999999 2024-09-17T18:16:05.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.963 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.964 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:601 3.cs0 3:38dc802b:::smithi15432074-44:10 [read 0~1523712,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-09-17T18:16:05.964 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:01.316998+0000", 2024-09-17T18:16:05.964 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.5586085760000001, 2024-09-17T18:16:05.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024730305000000001, 2024-09-17T18:16:05.964 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.964 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.964 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:05.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.964 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 601 2024-09-17T18:16:05.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.965 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316998+0000", 2024-09-17T18:16:05.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316998+0000", 2024-09-17T18:16:05.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317000+0000", 2024-09-17T18:16:05.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.42e-06 2024-09-17T18:16:05.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317007+0000", 2024-09-17T18:16:05.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0829999999999998e-06 2024-09-17T18:16:05.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317025+0000", 2024-09-17T18:16:05.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7796e-05 2024-09-17T18:16:05.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317038+0000", 2024-09-17T18:16:05.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3322999999999999e-05 2024-09-17T18:16:05.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317646+0000", 2024-09-17T18:16:05.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00060809199999999996 2024-09-17T18:16:05.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:05.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317697+0000", 2024-09-17T18:16:05.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0478e-05 2024-09-17T18:16:05.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.327064+0000", 2024-09-17T18:16:05.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093677059999999999 2024-09-17T18:16:05.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.327616+0000", 2024-09-17T18:16:05.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055202599999999995 2024-09-17T18:16:05.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.341729+0000", 2024-09-17T18:16:05.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014112381 2024-09-17T18:16:05.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.969 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.969 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:652 3.cs0 3:391d6b13:::smithi15432074-45:head [append 0~704512] snapc 19=[19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T18:16:05.969 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:04.427016+0000", 2024-09-17T18:16:05.969 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.4485907060000001, 2024-09-17T18:16:05.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015602883, 2024-09-17T18:16:05.970 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.970 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.970 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:05.970 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.970 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.970 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.970 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 652 2024-09-17T18:16:05.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.970 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.427016+0000", 2024-09-17T18:16:05.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.427016+0000", 2024-09-17T18:16:05.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.427019+0000", 2024-09-17T18:16:05.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9340000000000002e-06 2024-09-17T18:16:05.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.428281+0000", 2024-09-17T18:16:05.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001262174 2024-09-17T18:16:05.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.428317+0000", 2024-09-17T18:16:05.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6035999999999999e-05 2024-09-17T18:16:05.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.428335+0000", 2024-09-17T18:16:05.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7672999999999998e-05 2024-09-17T18:16:05.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.428539+0000", 2024-09-17T18:16:05.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020341900000000001 2024-09-17T18:16:05.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:05.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.428556+0000", 2024-09-17T18:16:05.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7022999999999999e-05 2024-09-17T18:16:05.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.432463+0000", 2024-09-17T18:16:05.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039073739999999999 2024-09-17T18:16:05.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.432612+0000", 2024-09-17T18:16:05.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014906699999999999 2024-09-17T18:16:05.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.435027+0000", 2024-09-17T18:16:05.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024145450000000001 2024-09-17T18:16:05.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.442138+0000", 2024-09-17T18:16:05.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071110619999999996 2024-09-17T18:16:05.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:05.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.442468+0000", 2024-09-17T18:16:05.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033053899999999997 2024-09-17T18:16:05.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.442619+0000", 2024-09-17T18:16:05.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151037 2024-09-17T18:16:05.976 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.976 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.976 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.976 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:653 3.cs0 3:391d6b13:::smithi15432074-45:head [append 0~655360] snapc 19=[19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T18:16:05.976 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:04.433175+0000", 2024-09-17T18:16:05.976 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.442431582, 2024-09-17T18:16:05.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016424386999999999, 2024-09-17T18:16:05.976 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.976 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.977 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:05.977 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.977 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.977 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.977 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 653 2024-09-17T18:16:05.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.977 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.433175+0000", 2024-09-17T18:16:05.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.433175+0000", 2024-09-17T18:16:05.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.433178+0000", 2024-09-17T18:16:05.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4229999999999999e-06 2024-09-17T18:16:05.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.434099+0000", 2024-09-17T18:16:05.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092069600000000004 2024-09-17T18:16:05.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.434128+0000", 2024-09-17T18:16:05.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9759000000000001e-05 2024-09-17T18:16:05.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.434148+0000", 2024-09-17T18:16:05.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9596e-05 2024-09-17T18:16:05.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.437688+0000", 2024-09-17T18:16:05.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035405329999999998 2024-09-17T18:16:05.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.437871+0000", 2024-09-17T18:16:05.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018253900000000001 2024-09-17T18:16:05.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.440162+0000", 2024-09-17T18:16:05.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002290528 2024-09-17T18:16:05.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.446434+0000", 2024-09-17T18:16:05.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062723479999999996 2024-09-17T18:16:05.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:05.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.449395+0000", 2024-09-17T18:16:05.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029607990000000001 2024-09-17T18:16:05.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.449600+0000", 2024-09-17T18:16:05.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020516600000000001 2024-09-17T18:16:05.982 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.982 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.982 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.982 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:654 3.cs0 3:391d6b13:::smithi15432074-45:head [append 0~507904] snapc 19=[19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-17T18:16:05.982 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:04.438245+0000", 2024-09-17T18:16:05.982 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.437361807, 2024-09-17T18:16:05.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012170913, 2024-09-17T18:16:05.982 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.982 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.982 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:05.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.983 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.983 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.983 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 654 2024-09-17T18:16:05.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.983 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.438245+0000", 2024-09-17T18:16:05.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.438245+0000", 2024-09-17T18:16:05.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.438248+0000", 2024-09-17T18:16:05.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.01e-06 2024-09-17T18:16:05.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.440800+0000", 2024-09-17T18:16:05.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025518250000000002 2024-09-17T18:16:05.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.440832+0000", 2024-09-17T18:16:05.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2295999999999997e-05 2024-09-17T18:16:05.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.440853+0000", 2024-09-17T18:16:05.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0230000000000001e-05 2024-09-17T18:16:05.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.442875+0000", 2024-09-17T18:16:05.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020228339999999998 2024-09-17T18:16:05.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.443100+0000", 2024-09-17T18:16:05.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000224835 2024-09-17T18:16:05.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:05.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.444540+0000", 2024-09-17T18:16:05.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001439947 2024-09-17T18:16:05.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:05.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.446757+0000", 2024-09-17T18:16:05.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022165000000000002 2024-09-17T18:16:05.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:05.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.450214+0000", 2024-09-17T18:16:05.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034575109999999999 2024-09-17T18:16:05.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.450416+0000", 2024-09-17T18:16:05.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020192499999999999 2024-09-17T18:16:05.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.987 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.988 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.988 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:656 3.cs0 3:391d6b13:::smithi15432074-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e69)", 2024-09-17T18:16:05.988 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:04.440961+0000", 2024-09-17T18:16:05.988 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.4346459089999999, 2024-09-17T18:16:05.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01347661, 2024-09-17T18:16:05.988 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:05.988 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:05.988 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:05.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:05.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:05.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:05.988 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 656 2024-09-17T18:16:05.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.989 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:05.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:05.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.440961+0000", 2024-09-17T18:16:05.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:05.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.440961+0000", 2024-09-17T18:16:05.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:05.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:05.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.440962+0000", 2024-09-17T18:16:05.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3430000000000001e-06 2024-09-17T18:16:05.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:05.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.440969+0000", 2024-09-17T18:16:05.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1369999999999999e-06 2024-09-17T18:16:05.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:05.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.440987+0000", 2024-09-17T18:16:05.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8462999999999999e-05 2024-09-17T18:16:05.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:05.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.441002+0000", 2024-09-17T18:16:05.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4959e-05 2024-09-17T18:16:05.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.448802+0000", 2024-09-17T18:16:05.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077996130000000004 2024-09-17T18:16:05.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:05.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.449067+0000", 2024-09-17T18:16:05.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000265741 2024-09-17T18:16:05.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:05.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.452413+0000", 2024-09-17T18:16:05.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033456369999999998 2024-09-17T18:16:05.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:05.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.452576+0000", 2024-09-17T18:16:05.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016267300000000001 2024-09-17T18:16:05.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:05.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:05.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:05.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:04.454438+0000", 2024-09-17T18:16:05.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001862044 2024-09-17T18:16:05.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.993 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:05.993 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:05.993 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:05.995 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T18:16:05.995 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:05.990+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:06.095 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:16:06.094+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:16:06.165 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:06.166 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:06.166 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:16:06.166 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:06.180 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T18:16:06.196 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:06.193+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:06.297 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:16:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:16:06.297 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:06.298 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:06.293+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:06.311 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T18:16:06.334 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T18:16:06.398 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:06.397+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:06.425 INFO:teuthology.orchestra.run.smithi087.stderr:noscrub is unset 2024-09-17T18:16:06.425 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.9 to 1 (10000) 2024-09-17T18:16:06.432 INFO:tasks.rados.rados.0.smithi154.stdout:262: done (1 left) 2024-09-17T18:16:06.432 INFO:tasks.rados.rados.0.smithi154.stdout:264: done (0 left) 2024-09-17T18:16:06.432 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 25 current snap is 26 2024-09-17T18:16:06.432 INFO:tasks.rados.rados.0.smithi154.stdout:265: seq_num 119 ranges {1802240=458752,2260992=507904,2768896=507904,3276800=458752,3735552=81920} 2024-09-17T18:16:06.433 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:06.433 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:16:06.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:16:06.433 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:16:06.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.434 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 39/31 ECSubWrite(tid=112, reqid=client.4565.0:283, at_version=39'42, trim_to=0'0, roll_forward_to=36'38))", 2024-09-17T18:16:06.434 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:34.776485+0000", 2024-09-17T18:16:06.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.654182153000001, 2024-09-17T18:16:06.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056460369999999996, 2024-09-17T18:16:06.434 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.434 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.776485+0000", 2024-09-17T18:16:06.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.776485+0000", 2024-09-17T18:16:06.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.776486+0000", 2024-09-17T18:16:06.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.649e-06 2024-09-17T18:16:06.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.776530+0000", 2024-09-17T18:16:06.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4292000000000002e-05 2024-09-17T18:16:06.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.776561+0000", 2024-09-17T18:16:06.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0595000000000001e-05 2024-09-17T18:16:06.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.776583+0000", 2024-09-17T18:16:06.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2259000000000002e-05 2024-09-17T18:16:06.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.778018+0000", 2024-09-17T18:16:06.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014344780000000001 2024-09-17T18:16:06.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.778037+0000", 2024-09-17T18:16:06.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8873e-05 2024-09-17T18:16:06.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.782043+0000", 2024-09-17T18:16:06.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004006725 2024-09-17T18:16:06.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:34.782131+0000", 2024-09-17T18:16:06.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7165999999999999e-05 2024-09-17T18:16:06.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.438 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.439 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s3 42/31 ECSubWrite(tid=39, reqid=osd.5.0:39, at_version=42'10, trim_to=0'0, roll_forward_to=38'8))", 2024-09-17T18:16:06.439 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.775168+0000", 2024-09-17T18:16:06.439 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.655498180999999, 2024-09-17T18:16:06.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006571843, 2024-09-17T18:16:06.439 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.439 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.439 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.439 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775168+0000", 2024-09-17T18:16:06.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775168+0000", 2024-09-17T18:16:06.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775169+0000", 2024-09-17T18:16:06.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4e-07 2024-09-17T18:16:06.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775226+0000", 2024-09-17T18:16:06.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7003999999999998e-05 2024-09-17T18:16:06.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775289+0000", 2024-09-17T18:16:06.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2997999999999996e-05 2024-09-17T18:16:06.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775314+0000", 2024-09-17T18:16:06.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4915000000000001e-05 2024-09-17T18:16:06.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775886+0000", 2024-09-17T18:16:06.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057149100000000003 2024-09-17T18:16:06.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.775911+0000", 2024-09-17T18:16:06.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5035999999999999e-05 2024-09-17T18:16:06.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.781679+0000", 2024-09-17T18:16:06.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057678470000000004 2024-09-17T18:16:06.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.781740+0000", 2024-09-17T18:16:06.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1711999999999995e-05 2024-09-17T18:16:06.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.443 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.444 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 42/31 ECSubWrite(tid=157, reqid=client.4565.0:339, at_version=42'65, trim_to=0'0, roll_forward_to=40'63))", 2024-09-17T18:16:06.444 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.780013+0000", 2024-09-17T18:16:06.444 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.65065405, 2024-09-17T18:16:06.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063106330000000004, 2024-09-17T18:16:06.444 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.444 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.444 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.444 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780013+0000", 2024-09-17T18:16:06.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780013+0000", 2024-09-17T18:16:06.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780013+0000", 2024-09-17T18:16:06.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8199999999999999e-07 2024-09-17T18:16:06.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780187+0000", 2024-09-17T18:16:06.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017382000000000001 2024-09-17T18:16:06.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780207+0000", 2024-09-17T18:16:06.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9593999999999999e-05 2024-09-17T18:16:06.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780221+0000", 2024-09-17T18:16:06.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4191e-05 2024-09-17T18:16:06.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780323+0000", 2024-09-17T18:16:06.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102228 2024-09-17T18:16:06.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.780339+0000", 2024-09-17T18:16:06.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5426000000000001e-05 2024-09-17T18:16:06.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.786234+0000", 2024-09-17T18:16:06.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058950929999999997 2024-09-17T18:16:06.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.786323+0000", 2024-09-17T18:16:06.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9499000000000005e-05 2024-09-17T18:16:06.448 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.448 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.448 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.448 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s3 42/31 ECSubWrite(tid=40, reqid=osd.5.0:39, at_version=0'0, trim_to=0'0, roll_forward_to=42'10))", 2024-09-17T18:16:06.449 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.784652+0000", 2024-09-17T18:16:06.449 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.646014697999998, 2024-09-17T18:16:06.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078691309999999997, 2024-09-17T18:16:06.449 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.449 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.449 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.449 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784652+0000", 2024-09-17T18:16:06.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784652+0000", 2024-09-17T18:16:06.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784654+0000", 2024-09-17T18:16:06.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4830000000000002e-06 2024-09-17T18:16:06.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784682+0000", 2024-09-17T18:16:06.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7572e-05 2024-09-17T18:16:06.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784729+0000", 2024-09-17T18:16:06.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7391000000000001e-05 2024-09-17T18:16:06.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784754+0000", 2024-09-17T18:16:06.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4474999999999999e-05 2024-09-17T18:16:06.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784895+0000", 2024-09-17T18:16:06.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000140696 2024-09-17T18:16:06.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.784910+0000", 2024-09-17T18:16:06.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5634e-05 2024-09-17T18:16:06.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.792426+0000", 2024-09-17T18:16:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007515341 2024-09-17T18:16:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.792521+0000", 2024-09-17T18:16:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5538999999999994e-05 2024-09-17T18:16:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 42/31 ECSubWrite(tid=160, reqid=osd.13.0:160, at_version=42'69, trim_to=0'0, roll_forward_to=40'63))", 2024-09-17T18:16:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.789009+0000", 2024-09-17T18:16:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.641658061000001, 2024-09-17T18:16:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061681419999999997, 2024-09-17T18:16:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789009+0000", 2024-09-17T18:16:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789009+0000", 2024-09-17T18:16:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789010+0000", 2024-09-17T18:16:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.178e-06 2024-09-17T18:16:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789042+0000", 2024-09-17T18:16:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1888999999999999e-05 2024-09-17T18:16:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789059+0000", 2024-09-17T18:16:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7116999999999999e-05 2024-09-17T18:16:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789072+0000", 2024-09-17T18:16:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2999999999999999e-05 2024-09-17T18:16:06.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789626+0000", 2024-09-17T18:16:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055469600000000003 2024-09-17T18:16:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.789648+0000", 2024-09-17T18:16:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1362e-05 2024-09-17T18:16:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.795075+0000", 2024-09-17T18:16:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054275139999999996 2024-09-17T18:16:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.795177+0000", 2024-09-17T18:16:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010138599999999999 2024-09-17T18:16:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 43/31 ECSubWrite(tid=183, reqid=osd.13.0:183, at_version=43'79, trim_to=0'0, roll_forward_to=42'77))", 2024-09-17T18:16:06.458 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.778765+0000", 2024-09-17T18:16:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.651901439, 2024-09-17T18:16:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072569269999999998, 2024-09-17T18:16:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778765+0000", 2024-09-17T18:16:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778765+0000", 2024-09-17T18:16:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778766+0000", 2024-09-17T18:16:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.54e-07 2024-09-17T18:16:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778846+0000", 2024-09-17T18:16:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9586999999999995e-05 2024-09-17T18:16:06.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.778893+0000", 2024-09-17T18:16:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7583999999999997e-05 2024-09-17T18:16:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779009+0000", 2024-09-17T18:16:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115702 2024-09-17T18:16:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779290+0000", 2024-09-17T18:16:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000281327 2024-09-17T18:16:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779309+0000", 2024-09-17T18:16:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8967e-05 2024-09-17T18:16:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.785917+0000", 2024-09-17T18:16:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066076379999999999 2024-09-17T18:16:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786022+0000", 2024-09-17T18:16:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105368 2024-09-17T18:16:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 43/31 ECSubWrite(tid=184, reqid=osd.13.0:184, at_version=43'81, trim_to=0'0, roll_forward_to=42'77))", 2024-09-17T18:16:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.779073+0000", 2024-09-17T18:16:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.651593758000001, 2024-09-17T18:16:06.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072302470000000004, 2024-09-17T18:16:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779073+0000", 2024-09-17T18:16:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779073+0000", 2024-09-17T18:16:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779074+0000", 2024-09-17T18:16:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1200000000000001e-06 2024-09-17T18:16:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779130+0000", 2024-09-17T18:16:06.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6153999999999998e-05 2024-09-17T18:16:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779157+0000", 2024-09-17T18:16:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6452999999999999e-05 2024-09-17T18:16:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779177+0000", 2024-09-17T18:16:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0052e-05 2024-09-17T18:16:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781445+0000", 2024-09-17T18:16:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022686130000000001 2024-09-17T18:16:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.781470+0000", 2024-09-17T18:16:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4249000000000001e-05 2024-09-17T18:16:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786228+0000", 2024-09-17T18:16:06.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047580330000000001 2024-09-17T18:16:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.786303+0000", 2024-09-17T18:16:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5573000000000003e-05 2024-09-17T18:16:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 43/31 ECSubWrite(tid=20, reqid=osd.0.0:20, at_version=43'12, trim_to=0'0, roll_forward_to=35'10))", 2024-09-17T18:16:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.779543+0000", 2024-09-17T18:16:06.468 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.651123578, 2024-09-17T18:16:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056962799999999997, 2024-09-17T18:16:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779543+0000", 2024-09-17T18:16:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779543+0000", 2024-09-17T18:16:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779544+0000", 2024-09-17T18:16:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8599999999999998e-07 2024-09-17T18:16:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779589+0000", 2024-09-17T18:16:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4947999999999997e-05 2024-09-17T18:16:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779612+0000", 2024-09-17T18:16:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3533e-05 2024-09-17T18:16:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779637+0000", 2024-09-17T18:16:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4941999999999999e-05 2024-09-17T18:16:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779817+0000", 2024-09-17T18:16:06.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018006200000000001 2024-09-17T18:16:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.779842+0000", 2024-09-17T18:16:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4643000000000001e-05 2024-09-17T18:16:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.785150+0000", 2024-09-17T18:16:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053080829999999999 2024-09-17T18:16:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.785239+0000", 2024-09-17T18:16:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9582999999999999e-05 2024-09-17T18:16:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 43/31 ECSubWrite(tid=21, reqid=osd.0.0:20, at_version=0'0, trim_to=0'0, roll_forward_to=43'12))", 2024-09-17T18:16:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.791383+0000", 2024-09-17T18:16:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.639283244000001, 2024-09-17T18:16:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056022310000000001, 2024-09-17T18:16:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.473 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791383+0000", 2024-09-17T18:16:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791383+0000", 2024-09-17T18:16:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791384+0000", 2024-09-17T18:16:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9999999999999995e-07 2024-09-17T18:16:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791405+0000", 2024-09-17T18:16:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0602e-05 2024-09-17T18:16:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791441+0000", 2024-09-17T18:16:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5707999999999998e-05 2024-09-17T18:16:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.791460+0000", 2024-09-17T18:16:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9660000000000002e-05 2024-09-17T18:16:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.792110+0000", 2024-09-17T18:16:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00064953899999999998 2024-09-17T18:16:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.792134+0000", 2024-09-17T18:16:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4289000000000001e-05 2024-09-17T18:16:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.796896+0000", 2024-09-17T18:16:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047621230000000001 2024-09-17T18:16:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.796986+0000", 2024-09-17T18:16:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9309999999999997e-05 2024-09-17T18:16:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s3 43/31 ECSubWrite(tid=46, reqid=osd.5.0:46, at_version=43'12, trim_to=0'0, roll_forward_to=42'10))", 2024-09-17T18:16:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.793230+0000", 2024-09-17T18:16:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.637437163000001, 2024-09-17T18:16:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062083850000000003, 2024-09-17T18:16:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793230+0000", 2024-09-17T18:16:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793230+0000", 2024-09-17T18:16:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793230+0000", 2024-09-17T18:16:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5200000000000002e-07 2024-09-17T18:16:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793282+0000", 2024-09-17T18:16:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1882000000000002e-05 2024-09-17T18:16:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793302+0000", 2024-09-17T18:16:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0369000000000001e-05 2024-09-17T18:16:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793317+0000", 2024-09-17T18:16:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5226e-05 2024-09-17T18:16:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793458+0000", 2024-09-17T18:16:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014025100000000001 2024-09-17T18:16:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.793486+0000", 2024-09-17T18:16:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8309e-05 2024-09-17T18:16:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.799325+0000", 2024-09-17T18:16:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058389940000000001 2024-09-17T18:16:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.799438+0000", 2024-09-17T18:16:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112902 2024-09-17T18:16:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 43/31 ECSubWrite(tid=187, reqid=client.4565.0:365, at_version=43'83, trim_to=0'0, roll_forward_to=43'79))", 2024-09-17T18:16:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.797068+0000", 2024-09-17T18:16:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.633599094000001, 2024-09-17T18:16:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055186039999999999, 2024-09-17T18:16:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797068+0000", 2024-09-17T18:16:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797068+0000", 2024-09-17T18:16:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797070+0000", 2024-09-17T18:16:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0470000000000001e-06 2024-09-17T18:16:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797177+0000", 2024-09-17T18:16:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010758499999999999 2024-09-17T18:16:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797206+0000", 2024-09-17T18:16:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9264999999999998e-05 2024-09-17T18:16:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797230+0000", 2024-09-17T18:16:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3289999999999999e-05 2024-09-17T18:16:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797412+0000", 2024-09-17T18:16:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181845 2024-09-17T18:16:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.797435+0000", 2024-09-17T18:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3108999999999998e-05 2024-09-17T18:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.802517+0000", 2024-09-17T18:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050827240000000003 2024-09-17T18:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.802586+0000", 2024-09-17T18:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8738999999999994e-05 2024-09-17T18:16:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 54/31 ECSubWrite(tid=277, reqid=osd.13.0:277, at_version=54'134, trim_to=0'0, roll_forward_to=53'132))", 2024-09-17T18:16:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:49.318671+0000", 2024-09-17T18:16:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.111996085000001, 2024-09-17T18:16:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061435220000000002, 2024-09-17T18:16:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.318671+0000", 2024-09-17T18:16:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.318671+0000", 2024-09-17T18:16:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.318671+0000", 2024-09-17T18:16:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7999999999999995e-07 2024-09-17T18:16:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.318725+0000", 2024-09-17T18:16:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4117999999999999e-05 2024-09-17T18:16:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.318762+0000", 2024-09-17T18:16:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6918999999999997e-05 2024-09-17T18:16:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.318789+0000", 2024-09-17T18:16:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6956000000000001e-05 2024-09-17T18:16:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.319387+0000", 2024-09-17T18:16:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000597903 2024-09-17T18:16:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.319430+0000", 2024-09-17T18:16:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3142000000000001e-05 2024-09-17T18:16:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.324720+0000", 2024-09-17T18:16:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052901939999999998 2024-09-17T18:16:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:49.324814+0000", 2024-09-17T18:16:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3610000000000007e-05 2024-09-17T18:16:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 59/31 ECSubWrite(tid=341, reqid=client.4565.0:547, at_version=59'182, trim_to=0'0, roll_forward_to=58'180))", 2024-09-17T18:16:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:54.407175+0000", 2024-09-17T18:16:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.023491576, 2024-09-17T18:16:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012035451000000001, 2024-09-17T18:16:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.407175+0000", 2024-09-17T18:16:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.407175+0000", 2024-09-17T18:16:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.407176+0000", 2024-09-17T18:16:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4799999999999998e-07 2024-09-17T18:16:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.409218+0000", 2024-09-17T18:16:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020420830000000001 2024-09-17T18:16:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.409257+0000", 2024-09-17T18:16:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9007000000000001e-05 2024-09-17T18:16:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.409281+0000", 2024-09-17T18:16:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4536e-05 2024-09-17T18:16:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.409466+0000", 2024-09-17T18:16:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018473799999999999 2024-09-17T18:16:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.409492+0000", 2024-09-17T18:16:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6302e-05 2024-09-17T18:16:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.419122+0000", 2024-09-17T18:16:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096294169999999995 2024-09-17T18:16:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.419211+0000", 2024-09-17T18:16:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8819999999999993e-05 2024-09-17T18:16:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 64/31 ECSubWrite(tid=398, reqid=osd.13.0:398, at_version=64'205, trim_to=0'0, roll_forward_to=62'203))", 2024-09-17T18:16:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:59.319109+0000", 2024-09-17T18:16:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 7.1115572379999996, 2024-09-17T18:16:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064842500000000004, 2024-09-17T18:16:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319109+0000", 2024-09-17T18:16:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319109+0000", 2024-09-17T18:16:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319111+0000", 2024-09-17T18:16:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.114e-06 2024-09-17T18:16:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319169+0000", 2024-09-17T18:16:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8807999999999997e-05 2024-09-17T18:16:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319201+0000", 2024-09-17T18:16:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1742000000000002e-05 2024-09-17T18:16:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319225+0000", 2024-09-17T18:16:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3553e-05 2024-09-17T18:16:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319369+0000", 2024-09-17T18:16:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014480999999999999 2024-09-17T18:16:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319397+0000", 2024-09-17T18:16:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7248999999999999e-05 2024-09-17T18:16:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.325504+0000", 2024-09-17T18:16:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061070930000000001 2024-09-17T18:16:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.325594+0000", 2024-09-17T18:16:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9881000000000002e-05 2024-09-17T18:16:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 64/31 ECSubWrite(tid=401, reqid=osd.13.0:401, at_version=64'207, trim_to=0'0, roll_forward_to=62'203))", 2024-09-17T18:16:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:59.319279+0000", 2024-09-17T18:16:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 7.1113876290000002, 2024-09-17T18:16:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082455189999999998, 2024-09-17T18:16:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319279+0000", 2024-09-17T18:16:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319279+0000", 2024-09-17T18:16:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319280+0000", 2024-09-17T18:16:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.093e-06 2024-09-17T18:16:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319351+0000", 2024-09-17T18:16:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1081999999999995e-05 2024-09-17T18:16:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319374+0000", 2024-09-17T18:16:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2993000000000002e-05 2024-09-17T18:16:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.319393+0000", 2024-09-17T18:16:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-09-17T18:16:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.321636+0000", 2024-09-17T18:16:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002242857 2024-09-17T18:16:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.321661+0000", 2024-09-17T18:16:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5599e-05 2024-09-17T18:16:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.327398+0000", 2024-09-17T18:16:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057366500000000003 2024-09-17T18:16:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:59.327525+0000", 2024-09-17T18:16:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012657599999999999 2024-09-17T18:16:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s1 65/31 ECSubWrite(tid=38, reqid=osd.10.0:37, at_version=0'0, trim_to=0'0, roll_forward_to=65'27))", 2024-09-17T18:16:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:00.339481+0000", 2024-09-17T18:16:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.0911861529999998, 2024-09-17T18:16:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064484299999999998, 2024-09-17T18:16:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.339481+0000", 2024-09-17T18:16:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.339481+0000", 2024-09-17T18:16:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.339482+0000", 2024-09-17T18:16:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.654e-06 2024-09-17T18:16:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.339508+0000", 2024-09-17T18:16:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6072e-05 2024-09-17T18:16:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.339537+0000", 2024-09-17T18:16:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8413000000000001e-05 2024-09-17T18:16:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.339556+0000", 2024-09-17T18:16:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9636e-05 2024-09-17T18:16:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.339987+0000", 2024-09-17T18:16:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043039599999999999 2024-09-17T18:16:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.340012+0000", 2024-09-17T18:16:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.497e-05 2024-09-17T18:16:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.345842+0000", 2024-09-17T18:16:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058304710000000003 2024-09-17T18:16:06.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.345929+0000", 2024-09-17T18:16:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6817999999999994e-05 2024-09-17T18:16:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.0s2 65/31 ECSubWrite(tid=31, reqid=osd.3.0:30, at_version=0'0, trim_to=0'0, roll_forward_to=65'25))", 2024-09-17T18:16:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:00.341161+0000", 2024-09-17T18:16:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.089505215, 2024-09-17T18:16:06.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072934870000000004, 2024-09-17T18:16:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.341161+0000", 2024-09-17T18:16:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.341161+0000", 2024-09-17T18:16:06.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.341164+0000", 2024-09-17T18:16:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0600000000000002e-06 2024-09-17T18:16:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.341214+0000", 2024-09-17T18:16:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0052999999999997e-05 2024-09-17T18:16:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.341241+0000", 2024-09-17T18:16:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7115999999999999e-05 2024-09-17T18:16:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.341260+0000", 2024-09-17T18:16:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9052999999999999e-05 2024-09-17T18:16:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.341412+0000", 2024-09-17T18:16:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015241199999999999 2024-09-17T18:16:06.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.341438+0000", 2024-09-17T18:16:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5916999999999999e-05 2024-09-17T18:16:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.348368+0000", 2024-09-17T18:16:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069297450000000002 2024-09-17T18:16:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.348455+0000", 2024-09-17T18:16:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7131000000000003e-05 2024-09-17T18:16:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 65/31 ECSubWrite(tid=412, reqid=osd.13.0:409, at_version=0'0, trim_to=0'0, roll_forward_to=65'213))", 2024-09-17T18:16:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:00.352602+0000", 2024-09-17T18:16:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.0780644940000004, 2024-09-17T18:16:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067958940000000002, 2024-09-17T18:16:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.517 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.352602+0000", 2024-09-17T18:16:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.352602+0000", 2024-09-17T18:16:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.352604+0000", 2024-09-17T18:16:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2960000000000001e-06 2024-09-17T18:16:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.352631+0000", 2024-09-17T18:16:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6353e-05 2024-09-17T18:16:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.352671+0000", 2024-09-17T18:16:06.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9845999999999998e-05 2024-09-17T18:16:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.352692+0000", 2024-09-17T18:16:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1676e-05 2024-09-17T18:16:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.352859+0000", 2024-09-17T18:16:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166486 2024-09-17T18:16:06.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.352885+0000", 2024-09-17T18:16:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5979e-05 2024-09-17T18:16:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.359322+0000", 2024-09-17T18:16:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006437206 2024-09-17T18:16:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.359398+0000", 2024-09-17T18:16:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6051999999999996e-05 2024-09-17T18:16:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 65/31 ECSubWrite(tid=414, reqid=osd.13.0:414, at_version=65'215, trim_to=0'0, roll_forward_to=65'213))", 2024-09-17T18:16:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:00.355024+0000", 2024-09-17T18:16:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.0756425109999999, 2024-09-17T18:16:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087546129999999996, 2024-09-17T18:16:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.522 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.355024+0000", 2024-09-17T18:16:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.355024+0000", 2024-09-17T18:16:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.355026+0000", 2024-09-17T18:16:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.637e-06 2024-09-17T18:16:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.355081+0000", 2024-09-17T18:16:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5089000000000001e-05 2024-09-17T18:16:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.355116+0000", 2024-09-17T18:16:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5012000000000003e-05 2024-09-17T18:16:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.355144+0000", 2024-09-17T18:16:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8436e-05 2024-09-17T18:16:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.355292+0000", 2024-09-17T18:16:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000147639 2024-09-17T18:16:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.355316+0000", 2024-09-17T18:16:06.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4136000000000001e-05 2024-09-17T18:16:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.363688+0000", 2024-09-17T18:16:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083721090000000008 2024-09-17T18:16:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.363779+0000", 2024-09-17T18:16:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0555000000000003e-05 2024-09-17T18:16:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.526 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 65/31 ECSubWrite(tid=416, reqid=osd.13.0:416, at_version=65'217, trim_to=0'0, roll_forward_to=65'213))", 2024-09-17T18:16:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:00.356581+0000", 2024-09-17T18:16:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.0740852390000004, 2024-09-17T18:16:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010230197, 2024-09-17T18:16:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356581+0000", 2024-09-17T18:16:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356581+0000", 2024-09-17T18:16:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356583+0000", 2024-09-17T18:16:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.889e-06 2024-09-17T18:16:06.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356627+0000", 2024-09-17T18:16:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3532999999999998e-05 2024-09-17T18:16:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356655+0000", 2024-09-17T18:16:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7914000000000001e-05 2024-09-17T18:16:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356674+0000", 2024-09-17T18:16:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9533000000000001e-05 2024-09-17T18:16:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356756+0000", 2024-09-17T18:16:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2040999999999996e-05 2024-09-17T18:16:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.356766+0000", 2024-09-17T18:16:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4620000000000002e-06 2024-09-17T18:16:06.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.366731+0000", 2024-09-17T18:16:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099654070000000008 2024-09-17T18:16:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:00.366812+0000", 2024-09-17T18:16:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0418000000000002e-05 2024-09-17T18:16:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.532 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.532 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:06.534 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 10 1 2024-09-17T18:16:06.535 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T18:16:06.536 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:16:06.537 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:16:06.537 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:16:06.538 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:16:06.539 INFO:tasks.rados.rados.0.smithi154.stdout:265: writing smithi15432074-25 from 1802240 to 2260992 tid 1 2024-09-17T18:16:06.539 INFO:tasks.rados.rados.0.smithi154.stdout:265: writing smithi15432074-25 from 2260992 to 2768896 tid 2 2024-09-17T18:16:06.539 INFO:tasks.rados.rados.0.smithi154.stdout:265: writing smithi15432074-25 from 2768896 to 3276800 tid 3 2024-09-17T18:16:06.539 INFO:tasks.rados.rados.0.smithi154.stdout:265: writing smithi15432074-25 from 3276800 to 3735552 tid 4 2024-09-17T18:16:06.539 INFO:tasks.rados.rados.0.smithi154.stdout:265: writing smithi15432074-25 from 3735552 to 3817472 tid 5 2024-09-17T18:16:06.539 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 11 current snap is 26 2024-09-17T18:16:06.539 INFO:tasks.rados.rados.0.smithi154.stdout:266: seq_num 120 ranges {180224=475136,655360=655360,1310720=622592,1933312=278528} 2024-09-17T18:16:06.539 INFO:tasks.rados.rados.0.smithi154.stdout:266: writing smithi15432074-11 from 180224 to 655360 tid 1 2024-09-17T18:16:06.539 INFO:tasks.rados.rados.0.smithi154.stdout:266: writing smithi15432074-11 from 655360 to 1310720 tid 2 2024-09-17T18:16:06.540 INFO:tasks.rados.rados.0.smithi154.stdout:266: writing smithi15432074-11 from 1310720 to 1933312 tid 3 2024-09-17T18:16:06.540 INFO:tasks.rados.rados.0.smithi154.stdout:266: writing smithi15432074-11 from 1933312 to 2211840 tid 4 2024-09-17T18:16:06.540 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 9 current snap is 26 2024-09-17T18:16:06.540 INFO:tasks.rados.rados.0.smithi154.stdout:267: seq_num 121 ranges {147456=491520,638976=802816,1441792=720896,2162688=32768} 2024-09-17T18:16:06.540 INFO:tasks.rados.rados.0.smithi154.stdout:267: writing smithi15432074-9 from 147456 to 638976 tid 1 2024-09-17T18:16:06.540 INFO:tasks.rados.rados.0.smithi154.stdout:267: writing smithi15432074-9 from 638976 to 1441792 tid 2 2024-09-17T18:16:06.540 INFO:tasks.rados.rados.0.smithi154.stdout:267: writing smithi15432074-9 from 1441792 to 2162688 tid 3 2024-09-17T18:16:06.540 INFO:tasks.rados.rados.0.smithi154.stdout:267: writing smithi15432074-9 from 2162688 to 2195456 tid 4 2024-09-17T18:16:06.540 INFO:tasks.rados.rados.0.smithi154.stdout:268: read oid 27 snap -1 2024-09-17T18:16:06.540 INFO:tasks.rados.rados.0.smithi154.stdout:268: expect (ObjNum 37 snap 0 seq_num 37) 2024-09-17T18:16:06.540 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 37 current snap is 26 2024-09-17T18:16:06.540 INFO:tasks.rados.rados.0.smithi154.stdout:265: finishing write tid 1 to smithi15432074-25 2024-09-17T18:16:06.541 INFO:tasks.rados.rados.0.smithi154.stdout:269: seq_num 122 ranges {1802240=507904,2310144=425984,2736128=442368,3178496=540672,3719168=147456} 2024-09-17T18:16:06.541 INFO:tasks.rados.rados.0.smithi154.stdout:269: writing smithi15432074-37 from 1802240 to 2310144 tid 1 2024-09-17T18:16:06.541 INFO:tasks.rados.rados.0.smithi154.stdout:269: writing smithi15432074-37 from 2310144 to 2736128 tid 2 2024-09-17T18:16:06.541 INFO:tasks.rados.rados.0.smithi154.stdout:269: writing smithi15432074-37 from 2736128 to 3178496 tid 3 2024-09-17T18:16:06.541 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:06.529+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:06.543 INFO:tasks.rados.rados.0.smithi154.stdout:269: writing smithi15432074-37 from 3178496 to 3719168 tid 4 2024-09-17T18:16:06.543 INFO:tasks.rados.rados.0.smithi154.stdout:269: writing smithi15432074-37 from 3719168 to 3866624 tid 5 2024-09-17T18:16:06.543 INFO:tasks.rados.rados.0.smithi154.stdout:270: delete oid 16 current snap is 26 2024-09-17T18:16:06.543 INFO:tasks.rados.rados.0.smithi154.stdout:265: finishing write tid 2 to smithi15432074-25 2024-09-17T18:16:06.543 INFO:tasks.rados.rados.0.smithi154.stdout:265: finishing write tid 3 to smithi15432074-25 2024-09-17T18:16:06.543 INFO:tasks.rados.rados.0.smithi154.stdout:265: finishing write tid 4 to smithi15432074-25 2024-09-17T18:16:06.543 INFO:tasks.rados.rados.0.smithi154.stdout:265: finishing write tid 5 to smithi15432074-25 2024-09-17T18:16:06.543 INFO:tasks.rados.rados.0.smithi154.stdout:266: finishing write tid 1 to smithi15432074-11 2024-09-17T18:16:06.543 INFO:tasks.rados.rados.0.smithi154.stdout:266: finishing write tid 2 to smithi15432074-11 2024-09-17T18:16:06.544 INFO:tasks.rados.rados.0.smithi154.stdout:266: finishing write tid 3 to smithi15432074-11 2024-09-17T18:16:06.544 INFO:tasks.rados.rados.0.smithi154.stdout:266: finishing write tid 4 to smithi15432074-11 2024-09-17T18:16:06.544 INFO:tasks.rados.rados.0.smithi154.stdout:265: finishing write tid 6 to smithi15432074-25 2024-09-17T18:16:06.544 INFO:tasks.rados.rados.0.smithi154.stdout:266: finishing write tid 5 to smithi15432074-11 2024-09-17T18:16:06.544 INFO:tasks.rados.rados.0.smithi154.stdout:266: finishing write tid 6 to smithi15432074-11 2024-09-17T18:16:06.544 INFO:tasks.rados.rados.0.smithi154.stdout:266: oid 11 updating version 0 to 145 2024-09-17T18:16:06.544 INFO:tasks.rados.rados.0.smithi154.stdout:266: oid 11 version 145 is already newer than 144 2024-09-17T18:16:06.544 INFO:tasks.rados.rados.0.smithi154.stdout:266: oid 11 updating version 145 to 146 2024-09-17T18:16:06.544 INFO:tasks.rados.rados.0.smithi154.stdout:266: oid 11 updating version 146 to 148 2024-09-17T18:16:06.544 INFO:tasks.rados.rados.0.smithi154.stdout:266: oid 11 version 148 is already newer than 147 2024-09-17T18:16:06.544 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 11 v 148 (ObjNum 120 snap 26 seq_num 120) dirty exists 2024-09-17T18:16:06.544 INFO:tasks.rados.rados.0.smithi154.stdout:266: left oid 11 (ObjNum 120 snap 26 seq_num 120) 2024-09-17T18:16:06.544 INFO:tasks.rados.rados.0.smithi154.stdout:265: finishing write tid 7 to smithi15432074-25 2024-09-17T18:16:06.545 INFO:tasks.rados.rados.0.smithi154.stdout:265: oid 25 updating version 0 to 110 2024-09-17T18:16:06.545 INFO:tasks.rados.rados.0.smithi154.stdout:265: oid 25 updating version 110 to 111 2024-09-17T18:16:06.545 INFO:tasks.rados.rados.0.smithi154.stdout:265: oid 25 updating version 111 to 112 2024-09-17T18:16:06.545 INFO:tasks.rados.rados.0.smithi154.stdout:265: oid 25 updating version 112 to 114 2024-09-17T18:16:06.545 INFO:tasks.rados.rados.0.smithi154.stdout:265: oid 25 updating version 114 to 115 2024-09-17T18:16:06.545 INFO:tasks.rados.rados.0.smithi154.stdout:265: oid 25 version 115 is already newer than 113 2024-09-17T18:16:06.545 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 25 v 115 (ObjNum 119 snap 26 seq_num 119) dirty exists 2024-09-17T18:16:06.545 INFO:tasks.rados.rados.0.smithi154.stdout:265: left oid 25 (ObjNum 119 snap 26 seq_num 119) 2024-09-17T18:16:06.545 INFO:tasks.rados.rados.0.smithi154.stdout:267: finishing write tid 1 to smithi15432074-9 2024-09-17T18:16:06.545 INFO:tasks.rados.rados.0.smithi154.stdout:268: expect (ObjNum 37 snap 0 seq_num 37) 2024-09-17T18:16:06.545 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 196986 2024-09-17T18:16:06.546 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:16:06.546 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:16:06.560 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 468112 2024-09-17T18:16:06.562 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:16:06.562 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:16:06.564 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:06.577 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:16:06.578 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:16:06.579 INFO:tasks.rados.rados.0.smithi154.stdout:267: finishing write tid 2 to smithi15432074-9 2024-09-17T18:16:06.579 INFO:tasks.rados.rados.0.smithi154.stdout:267: finishing write tid 3 to smithi15432074-9 2024-09-17T18:16:06.579 INFO:tasks.rados.rados.0.smithi154.stdout:267: finishing write tid 4 to smithi15432074-9 2024-09-17T18:16:06.579 INFO:tasks.rados.rados.0.smithi154.stdout:267: finishing write tid 5 to smithi15432074-9 2024-09-17T18:16:06.579 INFO:tasks.rados.rados.0.smithi154.stdout:267: finishing write tid 6 to smithi15432074-9 2024-09-17T18:16:06.579 INFO:tasks.rados.rados.0.smithi154.stdout:267: oid 9 updating version 0 to 30 2024-09-17T18:16:06.580 INFO:tasks.rados.rados.0.smithi154.stdout:267: oid 9 version 30 is already newer than 29 2024-09-17T18:16:06.580 INFO:tasks.rados.rados.0.smithi154.stdout:267: oid 9 updating version 30 to 31 2024-09-17T18:16:06.580 INFO:tasks.rados.rados.0.smithi154.stdout:267: oid 9 updating version 31 to 33 2024-09-17T18:16:06.580 INFO:tasks.rados.rados.0.smithi154.stdout:267: oid 9 version 33 is already newer than 32 2024-09-17T18:16:06.580 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 9 v 33 (ObjNum 121 snap 26 seq_num 121) dirty exists 2024-09-17T18:16:06.580 INFO:tasks.rados.rados.0.smithi154.stdout:267: left oid 9 (ObjNum 121 snap 26 seq_num 121) 2024-09-17T18:16:06.580 INFO:tasks.rados.rados.0.smithi154.stdout:265: done (5 left) 2024-09-17T18:16:06.580 INFO:tasks.rados.rados.0.smithi154.stdout:266: done (4 left) 2024-09-17T18:16:06.580 INFO:tasks.rados.rados.0.smithi154.stdout:267: done (3 left) 2024-09-17T18:16:06.580 INFO:tasks.rados.rados.0.smithi154.stdout:268: done (2 left) 2024-09-17T18:16:06.580 INFO:tasks.rados.rados.0.smithi154.stdout:270: done (1 left) 2024-09-17T18:16:06.580 INFO:tasks.rados.rados.0.smithi154.stdout:271: copy_from oid 23 from oid 12 current snap is 26 2024-09-17T18:16:06.580 INFO:tasks.rados.rados.0.smithi154.stdout:269: finishing write tid 1 to smithi15432074-37 2024-09-17T18:16:06.581 INFO:tasks.rados.rados.0.smithi154.stdout:269: finishing write tid 2 to smithi15432074-37 2024-09-17T18:16:06.581 INFO:tasks.rados.rados.0.smithi154.stdout:269: finishing write tid 3 to smithi15432074-37 2024-09-17T18:16:06.581 INFO:tasks.rados.rados.0.smithi154.stdout:269: finishing write tid 4 to smithi15432074-37 2024-09-17T18:16:06.581 INFO:tasks.rados.rados.0.smithi154.stdout:269: finishing write tid 5 to smithi15432074-37 2024-09-17T18:16:06.581 INFO:tasks.rados.rados.0.smithi154.stdout:269: finishing write tid 6 to smithi15432074-37 2024-09-17T18:16:06.581 INFO:tasks.rados.rados.0.smithi154.stdout:269: finishing write tid 7 to smithi15432074-37 2024-09-17T18:16:06.581 INFO:tasks.rados.rados.0.smithi154.stdout:269: oid 37 updating version 0 to 234 2024-09-17T18:16:06.581 INFO:tasks.rados.rados.0.smithi154.stdout:269: oid 37 updating version 234 to 235 2024-09-17T18:16:06.581 INFO:tasks.rados.rados.0.smithi154.stdout:269: oid 37 version 235 is already newer than 233 2024-09-17T18:16:06.581 INFO:tasks.rados.rados.0.smithi154.stdout:269: oid 37 updating version 235 to 237 2024-09-17T18:16:06.581 INFO:tasks.rados.rados.0.smithi154.stdout:269: oid 37 updating version 237 to 238 2024-09-17T18:16:06.581 INFO:tasks.rados.rados.0.smithi154.stdout:269: oid 37 version 238 is already newer than 236 2024-09-17T18:16:06.581 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 37 v 238 (ObjNum 122 snap 26 seq_num 122) dirty exists 2024-09-17T18:16:06.582 INFO:tasks.rados.rados.0.smithi154.stdout:269: left oid 37 (ObjNum 122 snap 26 seq_num 122) 2024-09-17T18:16:06.582 INFO:tasks.rados.rados.0.smithi154.stdout:269: done (1 left) 2024-09-17T18:16:06.582 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 34 current snap is 26 2024-09-17T18:16:06.582 INFO:tasks.rados.rados.0.smithi154.stdout:272: seq_num 124 ranges {2392064=540672,2932736=720896,3653632=786432,4440064=49152} 2024-09-17T18:16:06.594 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:16:06.594 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:16:06.600 INFO:tasks.rados.rados.0.smithi154.stdout:272: writing smithi15432074-34 from 2392064 to 2932736 tid 1 2024-09-17T18:16:06.605 INFO:tasks.rados.rados.0.smithi154.stdout:272: writing smithi15432074-34 from 2932736 to 3653632 tid 2 2024-09-17T18:16:06.612 INFO:tasks.rados.rados.0.smithi154.stdout:272: writing smithi15432074-34 from 3653632 to 4440064 tid 3 2024-09-17T18:16:06.612 INFO:tasks.rados.rados.0.smithi154.stdout:272: writing smithi15432074-34 from 4440064 to 4489216 tid 4 2024-09-17T18:16:06.612 INFO:tasks.rados.rados.0.smithi154.stdout:273: rmattr oid 26 current snap is 26 2024-09-17T18:16:06.612 INFO:tasks.rados.rados.0.smithi154.stdout:273: done (2 left) 2024-09-17T18:16:06.613 INFO:tasks.rados.rados.0.smithi154.stdout:274: rollback oid 24 current snap is 26 2024-09-17T18:16:06.613 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 24 to 5 2024-09-17T18:16:06.613 INFO:tasks.rados.rados.0.smithi154.stdout:272: finishing write tid 1 to smithi15432074-34 2024-09-17T18:16:06.613 INFO:tasks.rados.rados.0.smithi154.stdout:271: finishing copy_from racing read to smithi15432074-23 2024-09-17T18:16:06.613 INFO:tasks.rados.rados.0.smithi154.stdout:275: setattr oid 14 current snap is 26 2024-09-17T18:16:06.614 INFO:tasks.rados.rados.0.smithi154.stdout:276: delete oid 30 current snap is 26 2024-09-17T18:16:06.619 INFO:tasks.rados.rados.0.smithi154.stdout:271: finishing copy_from to smithi15432074-23 2024-09-17T18:16:06.619 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 23 v 82 (ObjNum 97 snap 16 seq_num 97) dirty exists 2024-09-17T18:16:06.621 INFO:tasks.rados.rados.0.smithi154.stdout:271: done (4 left) 2024-09-17T18:16:06.621 INFO:tasks.rados.rados.0.smithi154.stdout:276: done (3 left) 2024-09-17T18:16:06.621 INFO:tasks.rados.rados.0.smithi154.stdout:277: read oid 31 snap -1 2024-09-17T18:16:06.621 INFO:tasks.rados.rados.0.smithi154.stdout:277: expect (ObjNum 7 snap 0 seq_num 7) 2024-09-17T18:16:06.621 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 29 current snap is 26 2024-09-17T18:16:06.621 INFO:tasks.rados.rados.0.smithi154.stdout:278: seq_num 126 ranges {475136=573440,1048576=622592,1671168=622592,2293760=311296} 2024-09-17T18:16:06.622 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:16:06.622 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:16:06.628 INFO:tasks.rados.rados.0.smithi154.stdout:278: writing smithi15432074-29 from 475136 to 1048576 tid 1 2024-09-17T18:16:06.632 INFO:tasks.rados.rados.0.smithi154.stdout:278: writing smithi15432074-29 from 1048576 to 1671168 tid 2 2024-09-17T18:16:06.633 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:06.630+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:06.636 INFO:tasks.rados.rados.0.smithi154.stdout:278: writing smithi15432074-29 from 1671168 to 2293760 tid 3 2024-09-17T18:16:06.639 INFO:tasks.rados.rados.0.smithi154.stdout:278: writing smithi15432074-29 from 2293760 to 2605056 tid 4 2024-09-17T18:16:06.639 INFO:tasks.rados.rados.0.smithi154.stdout:279: setattr oid 18 current snap is 26 2024-09-17T18:16:06.639 INFO:tasks.rados.rados.0.smithi154.stdout:272: finishing write tid 2 to smithi15432074-34 2024-09-17T18:16:06.639 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 14 v 15 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-09-17T18:16:06.639 INFO:tasks.rados.rados.0.smithi154.stdout:272: finishing write tid 3 to smithi15432074-34 2024-09-17T18:16:06.639 INFO:tasks.rados.rados.0.smithi154.stdout:277: expect (ObjNum 7 snap 0 seq_num 7) 2024-09-17T18:16:06.639 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 44607 2024-09-17T18:16:06.642 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 114594 2024-09-17T18:16:06.644 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 123709 2024-09-17T18:16:06.644 INFO:tasks.rados.rados.0.smithi154.stdout:272: finishing write tid 4 to smithi15432074-34 2024-09-17T18:16:06.644 INFO:tasks.rados.rados.0.smithi154.stdout:272: finishing write tid 5 to smithi15432074-34 2024-09-17T18:16:06.644 INFO:tasks.rados.rados.0.smithi154.stdout:274: finishing rollback tid 0 to smithi15432074-24 2024-09-17T18:16:06.644 INFO:tasks.rados.rados.0.smithi154.stdout:272: finishing write tid 6 to smithi15432074-34 2024-09-17T18:16:06.644 INFO:tasks.rados.rados.0.smithi154.stdout:272: oid 34 updating version 0 to 117 2024-09-17T18:16:06.644 INFO:tasks.rados.rados.0.smithi154.stdout:272: oid 34 updating version 117 to 121 2024-09-17T18:16:06.644 INFO:tasks.rados.rados.0.smithi154.stdout:272: oid 34 version 121 is already newer than 119 2024-09-17T18:16:06.644 INFO:tasks.rados.rados.0.smithi154.stdout:272: oid 34 version 121 is already newer than 118 2024-09-17T18:16:06.644 INFO:tasks.rados.rados.0.smithi154.stdout:272: oid 34 version 121 is already newer than 120 2024-09-17T18:16:06.645 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 34 v 121 (ObjNum 124 snap 26 seq_num 124) dirty exists 2024-09-17T18:16:06.645 INFO:tasks.rados.rados.0.smithi154.stdout:272: left oid 34 (ObjNum 124 snap 26 seq_num 124) 2024-09-17T18:16:06.645 INFO:tasks.rados.rados.0.smithi154.stdout:274: finishing rollback tid 1 to smithi15432074-24 2024-09-17T18:16:06.645 INFO:tasks.rados.rados.0.smithi154.stdout:274: finishing rollback tid 2 to smithi15432074-24 2024-09-17T18:16:06.645 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 24 v 125 (ObjNum 67 snap 5 seq_num 67) dirty exists 2024-09-17T18:16:06.645 INFO:tasks.rados.rados.0.smithi154.stdout:272: done (5 left) 2024-09-17T18:16:06.645 INFO:tasks.rados.rados.0.smithi154.stdout:274: done (4 left) 2024-09-17T18:16:06.645 INFO:tasks.rados.rados.0.smithi154.stdout:275: done (3 left) 2024-09-17T18:16:06.645 INFO:tasks.rados.rados.0.smithi154.stdout:277: done (2 left) 2024-09-17T18:16:06.645 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 49 current snap is 26 2024-09-17T18:16:06.645 INFO:tasks.rados.rados.0.smithi154.stdout:278: finishing write tid 1 to smithi15432074-29 2024-09-17T18:16:06.645 INFO:tasks.rados.rados.0.smithi154.stdout:278: finishing write tid 2 to smithi15432074-29 2024-09-17T18:16:06.645 INFO:tasks.rados.rados.0.smithi154.stdout:280: seq_num 127 ranges {3358720=589824,3948544=753664,4702208=475136,5177344=327680} 2024-09-17T18:16:06.648 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:16:06.648 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:16:06.665 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:16:06.665 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:16:06.666 INFO:tasks.rados.rados.0.smithi154.stdout:280: writing smithi15432074-49 from 3358720 to 3948544 tid 1 2024-09-17T18:16:06.670 INFO:tasks.rados.rados.0.smithi154.stdout:280: writing smithi15432074-49 from 3948544 to 4702208 tid 2 2024-09-17T18:16:06.673 INFO:tasks.rados.rados.0.smithi154.stdout:280: writing smithi15432074-49 from 4702208 to 5177344 tid 3 2024-09-17T18:16:06.675 INFO:tasks.rados.rados.0.smithi154.stdout:280: writing smithi15432074-49 from 5177344 to 5505024 tid 4 2024-09-17T18:16:06.675 INFO:tasks.rados.rados.0.smithi154.stdout:281: delete oid 39 current snap is 26 2024-09-17T18:16:06.675 INFO:tasks.rados.rados.0.smithi154.stdout:278: finishing write tid 3 to smithi15432074-29 2024-09-17T18:16:06.675 INFO:tasks.rados.rados.0.smithi154.stdout:278: finishing write tid 4 to smithi15432074-29 2024-09-17T18:16:06.676 INFO:tasks.rados.rados.0.smithi154.stdout:278: finishing write tid 5 to smithi15432074-29 2024-09-17T18:16:06.676 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 18 v 239 (ObjNum 705 snap 0 seq_num 2994306960) dirty exists 2024-09-17T18:16:06.676 INFO:tasks.rados.rados.0.smithi154.stdout:278: finishing write tid 6 to smithi15432074-29 2024-09-17T18:16:06.676 INFO:tasks.rados.rados.0.smithi154.stdout:278: oid 29 updating version 0 to 54 2024-09-17T18:16:06.676 INFO:tasks.rados.rados.0.smithi154.stdout:278: oid 29 version 54 is already newer than 50 2024-09-17T18:16:06.676 INFO:tasks.rados.rados.0.smithi154.stdout:278: oid 29 version 54 is already newer than 52 2024-09-17T18:16:06.676 INFO:tasks.rados.rados.0.smithi154.stdout:278: oid 29 version 54 is already newer than 53 2024-09-17T18:16:06.676 INFO:tasks.rados.rados.0.smithi154.stdout:278: oid 29 version 54 is already newer than 51 2024-09-17T18:16:06.676 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 29 v 54 (ObjNum 126 snap 26 seq_num 126) dirty exists 2024-09-17T18:16:06.676 INFO:tasks.rados.rados.0.smithi154.stdout:278: left oid 29 (ObjNum 126 snap 26 seq_num 126) 2024-09-17T18:16:06.678 INFO:tasks.rados.rados.0.smithi154.stdout:280: finishing write tid 1 to smithi15432074-49 2024-09-17T18:16:06.680 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:06.681 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:16:06.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.681 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:738 3.as0 3:57f0af22:::smithi15432074-39:head [stat out=16b,delete] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:06.681 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:06.675543+0000", 2024-09-17T18:16:06.681 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0047964390000000004, 2024-09-17T18:16:06.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048333059999999999, 2024-09-17T18:16:06.681 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:06.681 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:06.681 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:06.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:06.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:06.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:06.682 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 738 2024-09-17T18:16:06.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.682 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:06.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:06.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:06.675543+0000", 2024-09-17T18:16:06.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:06.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:06.675543+0000", 2024-09-17T18:16:06.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:06.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:06.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:06.675544+0000", 2024-09-17T18:16:06.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.519e-06 2024-09-17T18:16:06.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:06.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:06.675551+0000", 2024-09-17T18:16:06.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4609999999999996e-06 2024-09-17T18:16:06.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:06.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:06.675565+0000", 2024-09-17T18:16:06.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4567e-05 2024-09-17T18:16:06.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:06.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:06.675574+0000", 2024-09-17T18:16:06.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9889999999999998e-06 2024-09-17T18:16:06.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:06.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:06.675663+0000", 2024-09-17T18:16:06.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9098000000000007e-05 2024-09-17T18:16:06.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:06.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:06.675801+0000", 2024-09-17T18:16:06.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013766700000000001 2024-09-17T18:16:06.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:06.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:06.676753+0000", 2024-09-17T18:16:06.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000951956 2024-09-17T18:16:06.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:06.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:06.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:06.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:06.679242+0000", 2024-09-17T18:16:06.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024894190000000001 2024-09-17T18:16:06.686 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.686 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:06.686 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.686 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:06.686 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-17T18:16:06.686 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 1 2024-09-17T18:16:06.686 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:06.687 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:16:06.687 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:16:06.687 INFO:tasks.rados.rados.0.smithi154.stdout:278: done (3 left) 2024-09-17T18:16:06.688 INFO:tasks.rados.rados.0.smithi154.stdout:279: done (2 left) 2024-09-17T18:16:06.688 INFO:tasks.rados.rados.0.smithi154.stdout:281: done (1 left) 2024-09-17T18:16:06.688 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 18 current snap is 26 2024-09-17T18:16:06.688 INFO:tasks.rados.rados.0.smithi154.stdout:282: seq_num 129 ranges {0=622592,622592=655360,1277952=688128,1966080=212992} 2024-09-17T18:16:06.688 INFO:tasks.rados.rados.0.smithi154.stdout:282: writing smithi15432074-18 from 0 to 622592 tid 1 2024-09-17T18:16:06.689 INFO:tasks.rados.rados.0.smithi154.stdout:282: writing smithi15432074-18 from 622592 to 1277952 tid 2 2024-09-17T18:16:06.694 INFO:tasks.rados.rados.0.smithi154.stdout:282: writing smithi15432074-18 from 1277952 to 1966080 tid 3 2024-09-17T18:16:06.695 INFO:tasks.rados.rados.0.smithi154.stdout:282: writing smithi15432074-18 from 1966080 to 2179072 tid 4 2024-09-17T18:16:06.695 INFO:tasks.rados.rados.0.smithi154.stdout:283: read oid 13 snap -1 2024-09-17T18:16:06.696 INFO:tasks.rados.rados.0.smithi154.stdout:283: expect (ObjNum 109 snap 23 seq_num 109) 2024-09-17T18:16:06.696 INFO:tasks.rados.rados.0.smithi154.stdout:284: delete oid 47 current snap is 26 2024-09-17T18:16:06.696 INFO:tasks.rados.rados.0.smithi154.stdout:280: finishing write tid 2 to smithi15432074-49 2024-09-17T18:16:06.696 INFO:tasks.rados.rados.0.smithi154.stdout:280: finishing write tid 3 to smithi15432074-49 2024-09-17T18:16:06.696 INFO:tasks.rados.rados.0.smithi154.stdout:280: finishing write tid 4 to smithi15432074-49 2024-09-17T18:16:06.696 INFO:tasks.rados.rados.0.smithi154.stdout:280: finishing write tid 5 to smithi15432074-49 2024-09-17T18:16:06.696 INFO:tasks.rados.rados.0.smithi154.stdout:280: finishing write tid 6 to smithi15432074-49 2024-09-17T18:16:06.696 INFO:tasks.rados.rados.0.smithi154.stdout:280: oid 49 updating version 0 to 52 2024-09-17T18:16:06.696 INFO:tasks.rados.rados.0.smithi154.stdout:280: oid 49 version 52 is already newer than 51 2024-09-17T18:16:06.696 INFO:tasks.rados.rados.0.smithi154.stdout:280: oid 49 version 52 is already newer than 48 2024-09-17T18:16:06.696 INFO:tasks.rados.rados.0.smithi154.stdout:280: oid 49 version 52 is already newer than 50 2024-09-17T18:16:06.696 INFO:tasks.rados.rados.0.smithi154.stdout:280: oid 49 version 52 is already newer than 49 2024-09-17T18:16:06.696 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 49 v 52 (ObjNum 127 snap 26 seq_num 127) dirty exists 2024-09-17T18:16:06.697 INFO:tasks.rados.rados.0.smithi154.stdout:280: left oid 49 (ObjNum 127 snap 26 seq_num 127) 2024-09-17T18:16:06.701 INFO:tasks.rados.rados.0.smithi154.stdout:282: finishing write tid 1 to smithi15432074-18 2024-09-17T18:16:06.701 INFO:tasks.rados.rados.0.smithi154.stdout:282: finishing write tid 2 to smithi15432074-18 2024-09-17T18:16:06.702 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T18:16:06.702 INFO:tasks.rados.rados.0.smithi154.stdout:280: done (3 left) 2024-09-17T18:16:06.702 INFO:tasks.rados.rados.0.smithi154.stdout:284: done (2 left) 2024-09-17T18:16:06.703 INFO:tasks.rados.rados.0.smithi154.stdout:285: snap_remove snap 3 2024-09-17T18:16:06.718 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:16:06.718 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:16:06.734 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:06.729+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:06.749 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:16:06.749 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:16:06.778 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:16:06.779 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:16:06.796 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:16:06.797 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:16:06.817 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:16:06.817 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:16:06.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:16:06.813+0000 7f7546d70640 0 -- 172.21.15.87:0/2763282158 >> [v2:172.21.15.154:6824/3670919160,v1:172.21.15.154:6825/3670919160] conn(0x7f75402253d0 msgr2=0x7f7540227800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T18:16:06.836 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:06.834+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:06.870 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:06.870 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:06.885 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T18:16:06.936 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:06.933+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:07.037 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:07.033+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:07.041 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:16:07.041 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:16:07.049 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:07.049 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:07.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T18:16:07.138 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:07.133+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:07.197 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:07.197 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:07.212 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T18:16:07.260 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:07.258+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:07.379 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:07.379 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:07.380 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T18:16:07.380 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:07.377+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:07.428 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.10 to 1 (10000) 2024-09-17T18:16:07.435 INFO:tasks.rados.rados.0.smithi154.stdout:285: done (2 left) 2024-09-17T18:16:07.435 INFO:tasks.rados.rados.0.smithi154.stdout:286: delete oid 1 current snap is 26 2024-09-17T18:16:07.435 INFO:tasks.rados.rados.0.smithi154.stdout:282: finishing write tid 3 to smithi15432074-18 2024-09-17T18:16:07.435 INFO:tasks.rados.rados.0.smithi154.stdout:282: finishing write tid 4 to smithi15432074-18 2024-09-17T18:16:07.435 INFO:tasks.rados.rados.0.smithi154.stdout:282: finishing write tid 5 to smithi15432074-18 2024-09-17T18:16:07.436 INFO:tasks.rados.rados.0.smithi154.stdout:283: expect (ObjNum 109 snap 23 seq_num 109) 2024-09-17T18:16:07.436 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:07.468 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 11 1 2024-09-17T18:16:07.480 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:07.477+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:07.535 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:07.561 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:07.561 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:07.575 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T18:16:07.579 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1045566 2024-09-17T18:16:07.579 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:07.577+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:07.605 INFO:tasks.rados.rados.0.smithi154.stdout:282: finishing write tid 6 to smithi15432074-18 2024-09-17T18:16:07.605 INFO:tasks.rados.rados.0.smithi154.stdout:282: oid 18 updating version 0 to 242 2024-09-17T18:16:07.605 INFO:tasks.rados.rados.0.smithi154.stdout:282: oid 18 version 242 is already newer than 241 2024-09-17T18:16:07.606 INFO:tasks.rados.rados.0.smithi154.stdout:282: oid 18 updating version 242 to 244 2024-09-17T18:16:07.606 INFO:tasks.rados.rados.0.smithi154.stdout:282: oid 18 version 244 is already newer than 240 2024-09-17T18:16:07.606 INFO:tasks.rados.rados.0.smithi154.stdout:282: oid 18 version 244 is already newer than 243 2024-09-17T18:16:07.606 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 18 v 244 (ObjNum 129 snap 26 seq_num 129) dirty exists 2024-09-17T18:16:07.606 INFO:tasks.rados.rados.0.smithi154.stdout:282: left oid 18 (ObjNum 129 snap 26 seq_num 129) 2024-09-17T18:16:07.606 INFO:tasks.rados.rados.0.smithi154.stdout:282: done (2 left) 2024-09-17T18:16:07.606 INFO:tasks.rados.rados.0.smithi154.stdout:283: done (1 left) 2024-09-17T18:16:07.606 INFO:tasks.rados.rados.0.smithi154.stdout:286: done (0 left) 2024-09-17T18:16:07.606 INFO:tasks.rados.rados.0.smithi154.stdout:287: snap_remove snap 24 2024-09-17T18:16:07.681 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:07.677+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:07.700 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:07.700 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:07.714 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T18:16:07.782 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:07.777+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:07.836 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:07.836 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:07.850 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T18:16:07.883 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:07.877+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:07.972 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:07.972 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:07.983 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:07.982+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:07.986 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T18:16:08.084 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:08.082+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:08.155 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:08.155 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:08.170 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T18:16:08.185 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:08.181+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:08.285 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:16:08.282+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:16:08.294 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:08.294 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:08.308 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T18:16:08.312 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.11 to 1 (10000) 2024-09-17T18:16:08.318 INFO:tasks.rados.rados.0.smithi154.stdout:287: done (0 left) 2024-09-17T18:16:08.318 INFO:tasks.rados.rados.0.smithi154.stdout:288: copy_from oid 10 from oid 22 current snap is 26 2024-09-17T18:16:08.319 INFO:tasks.rados.rados.0.smithi154.stdout:289: copy_from oid 26 from oid 33 current snap is 26 2024-09-17T18:16:08.319 INFO:tasks.rados.rados.0.smithi154.stdout:290: copy_from oid 37 from oid 38 current snap is 26 2024-09-17T18:16:08.319 INFO:tasks.rados.rados.0.smithi154.stdout:291: snap_create 2024-09-17T18:16:08.348 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 12 1 2024-09-17T18:16:08.357 INFO:tasks.rados.rados.0.smithi154.stdout:288: finishing copy_from to smithi15432074-10 2024-09-17T18:16:08.357 INFO:tasks.rados.rados.0.smithi154.stdout:288: got expected ENOENT (src dne) 2024-09-17T18:16:08.357 INFO:tasks.rados.rados.0.smithi154.stdout:288: finishing copy_from racing read to smithi15432074-10 2024-09-17T18:16:08.357 INFO:tasks.rados.rados.0.smithi154.stdout:290: finishing copy_from racing read to smithi15432074-37 2024-09-17T18:16:08.365 INFO:tasks.rados.rados.0.smithi154.stdout:290: finishing copy_from to smithi15432074-37 2024-09-17T18:16:08.365 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 37 v 6 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-09-17T18:16:08.369 INFO:tasks.rados.rados.0.smithi154.stdout:289: finishing copy_from racing read to smithi15432074-26 2024-09-17T18:16:08.374 INFO:tasks.rados.rados.0.smithi154.stdout:289: finishing copy_from to smithi15432074-26 2024-09-17T18:16:08.374 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 26 v 62 (ObjNum 87 snap 14 seq_num 87) dirty exists 2024-09-17T18:16:08.391 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:08.389+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:08.443 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:08.443 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:08.458 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T18:16:08.487 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:08.481+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:08.537 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T18:16:08.579 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:08.579 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:08.587 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:08.586+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:08.593 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T18:16:08.689 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:08.685+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:08.756 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:08.756 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:08.771 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T18:16:08.815 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:08.814+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:08.888 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:08.888 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:08.890 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:08.885+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:08.903 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T18:16:08.992 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:08.989+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:09.037 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:09.037 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:09.051 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T18:16:09.060 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T18:16:09.095 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:09.093+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:09.169 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:09.169 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:09.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T18:16:09.193 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:09.189+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:09.217 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:16:09.218 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:16:09.237 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:16:09.238 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:16:09.259 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:16:09.260 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:16:09.280 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:16:09.280 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:16:09.294 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:09.289+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:09.298 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:16:09.299 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:16:09.313 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.12 to 1 (10000) 2024-09-17T18:16:09.313 INFO:teuthology.orchestra.run.smithi087.stderr:nodeep-scrub is unset 2024-09-17T18:16:09.318 INFO:tasks.rados.rados.0.smithi154.stdout:288: done (3 left) 2024-09-17T18:16:09.319 INFO:tasks.rados.rados.0.smithi154.stdout:289: done (2 left) 2024-09-17T18:16:09.319 INFO:tasks.rados.rados.0.smithi154.stdout:290: done (1 left) 2024-09-17T18:16:09.319 INFO:tasks.rados.rados.0.smithi154.stdout:291: done (0 left) 2024-09-17T18:16:09.319 INFO:tasks.rados.rados.0.smithi154.stdout:292: snap_remove snap 18 2024-09-17T18:16:09.321 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:16:09.321 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:16:09.337 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 13 1 2024-09-17T18:16:09.343 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:16:09.343 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:16:09.360 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T18:16:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T18:16:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T18:16:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 43/31 ECSubWrite(tid=135, reqid=osd.6.0:135, at_version=43'19, trim_to=0'0, roll_forward_to=42'17))", 2024-09-17T18:16:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.777285+0000", 2024-09-17T18:16:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.579699886, 2024-09-17T18:16:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090781219999999992, 2024-09-17T18:16:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777285+0000", 2024-09-17T18:16:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777285+0000", 2024-09-17T18:16:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777285+0000", 2024-09-17T18:16:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4000000000000002e-07 2024-09-17T18:16:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777344+0000", 2024-09-17T18:16:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8978999999999999e-05 2024-09-17T18:16:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777376+0000", 2024-09-17T18:16:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1532999999999998e-05 2024-09-17T18:16:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777398+0000", 2024-09-17T18:16:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2541999999999999e-05 2024-09-17T18:16:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777568+0000", 2024-09-17T18:16:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016965900000000001 2024-09-17T18:16:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777594+0000", 2024-09-17T18:16:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5732999999999999e-05 2024-09-17T18:16:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786283+0000", 2024-09-17T18:16:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086891280000000008 2024-09-17T18:16:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786363+0000", 2024-09-17T18:16:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0007999999999997e-05 2024-09-17T18:16:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 43/31 ECSubWrite(tid=136, reqid=osd.6.0:136, at_version=43'21, trim_to=0'0, roll_forward_to=42'17))", 2024-09-17T18:16:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.779871+0000", 2024-09-17T18:16:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.577113257000001, 2024-09-17T18:16:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010748845999999999, 2024-09-17T18:16:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779871+0000", 2024-09-17T18:16:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779871+0000", 2024-09-17T18:16:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779873+0000", 2024-09-17T18:16:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9860000000000001e-06 2024-09-17T18:16:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779952+0000", 2024-09-17T18:16:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8191999999999999e-05 2024-09-17T18:16:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779981+0000", 2024-09-17T18:16:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9675e-05 2024-09-17T18:16:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.780002+0000", 2024-09-17T18:16:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0713999999999999e-05 2024-09-17T18:16:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.780164+0000", 2024-09-17T18:16:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000161559 2024-09-17T18:16:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.780189+0000", 2024-09-17T18:16:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5539000000000001e-05 2024-09-17T18:16:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790548+0000", 2024-09-17T18:16:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010358590000000001 2024-09-17T18:16:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790620+0000", 2024-09-17T18:16:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2590999999999997e-05 2024-09-17T18:16:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.2s1 43/31 ECSubWrite(tid=22, reqid=osd.14.0:22, at_version=43'18, trim_to=0'0, roll_forward_to=42'16))", 2024-09-17T18:16:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.785984+0000", 2024-09-17T18:16:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.571000364, 2024-09-17T18:16:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010839348, 2024-09-17T18:16:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785984+0000", 2024-09-17T18:16:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785984+0000", 2024-09-17T18:16:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785985+0000", 2024-09-17T18:16:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-07 2024-09-17T18:16:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786040+0000", 2024-09-17T18:16:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4694999999999997e-05 2024-09-17T18:16:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786073+0000", 2024-09-17T18:16:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3328999999999999e-05 2024-09-17T18:16:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786096+0000", 2024-09-17T18:16:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2643e-05 2024-09-17T18:16:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786277+0000", 2024-09-17T18:16:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000181669 2024-09-17T18:16:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.786303+0000", 2024-09-17T18:16:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6149e-05 2024-09-17T18:16:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796720+0000", 2024-09-17T18:16:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010416752 2024-09-17T18:16:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796824+0000", 2024-09-17T18:16:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103491 2024-09-17T18:16:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.2s1 43/31 ECSubWrite(tid=23, reqid=osd.14.0:23, at_version=43'20, trim_to=0'0, roll_forward_to=42'16))", 2024-09-17T18:16:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.788662+0000", 2024-09-17T18:16:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.568322455000001, 2024-09-17T18:16:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096349590000000002, 2024-09-17T18:16:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788662+0000", 2024-09-17T18:16:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788662+0000", 2024-09-17T18:16:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788664+0000", 2024-09-17T18:16:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9240000000000001e-06 2024-09-17T18:16:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788715+0000", 2024-09-17T18:16:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1028e-05 2024-09-17T18:16:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788749+0000", 2024-09-17T18:16:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3358999999999997e-05 2024-09-17T18:16:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.788771+0000", 2024-09-17T18:16:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1943999999999999e-05 2024-09-17T18:16:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790286+0000", 2024-09-17T18:16:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015151819999999999 2024-09-17T18:16:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790299+0000", 2024-09-17T18:16:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3302000000000001e-05 2024-09-17T18:16:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.798203+0000", 2024-09-17T18:16:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079036650000000007 2024-09-17T18:16:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.798297+0000", 2024-09-17T18:16:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4555000000000005e-05 2024-09-17T18:16:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs3 43/31 ECSubWrite(tid=44, reqid=osd.5.0:44, at_version=43'23, trim_to=0'0, roll_forward_to=42'21))", 2024-09-17T18:16:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.790263+0000", 2024-09-17T18:16:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.566721751999999, 2024-09-17T18:16:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088116389999999996, 2024-09-17T18:16:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790263+0000", 2024-09-17T18:16:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790263+0000", 2024-09-17T18:16:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790264+0000", 2024-09-17T18:16:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0399999999999996e-07 2024-09-17T18:16:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790322+0000", 2024-09-17T18:16:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8798999999999997e-05 2024-09-17T18:16:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790356+0000", 2024-09-17T18:16:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3172e-05 2024-09-17T18:16:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790379+0000", 2024-09-17T18:16:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3059000000000001e-05 2024-09-17T18:16:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790531+0000", 2024-09-17T18:16:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015204300000000001 2024-09-17T18:16:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790554+0000", 2024-09-17T18:16:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3445999999999999e-05 2024-09-17T18:16:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.799018+0000", 2024-09-17T18:16:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008464325 2024-09-17T18:16:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.799075+0000", 2024-09-17T18:16:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6190999999999998e-05 2024-09-17T18:16:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs3 43/31 ECSubWrite(tid=45, reqid=osd.5.0:45, at_version=43'25, trim_to=0'0, roll_forward_to=42'21))", 2024-09-17T18:16:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.790430+0000", 2024-09-17T18:16:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.566554909000001, 2024-09-17T18:16:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011985595999999999, 2024-09-17T18:16:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790430+0000", 2024-09-17T18:16:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790430+0000", 2024-09-17T18:16:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790431+0000", 2024-09-17T18:16:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0999999999999997e-07 2024-09-17T18:16:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790473+0000", 2024-09-17T18:16:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2178999999999997e-05 2024-09-17T18:16:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790494+0000", 2024-09-17T18:16:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1526e-05 2024-09-17T18:16:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.790514+0000", 2024-09-17T18:16:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9222999999999999e-05 2024-09-17T18:16:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794972+0000", 2024-09-17T18:16:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044584150000000003 2024-09-17T18:16:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794996+0000", 2024-09-17T18:16:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4192000000000001e-05 2024-09-17T18:16:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.802330+0000", 2024-09-17T18:16:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073335029999999999 2024-09-17T18:16:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.802415+0000", 2024-09-17T18:16:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5648000000000004e-05 2024-09-17T18:16:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s6 43/31 ECSubWrite(tid=48, reqid=osd.7.0:48, at_version=43'36, trim_to=0'0, roll_forward_to=42'32))", 2024-09-17T18:16:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.791326+0000", 2024-09-17T18:16:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.565658791000001, 2024-09-17T18:16:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099638959999999999, 2024-09-17T18:16:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791326+0000", 2024-09-17T18:16:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791326+0000", 2024-09-17T18:16:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791327+0000", 2024-09-17T18:16:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0899999999999999e-06 2024-09-17T18:16:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791369+0000", 2024-09-17T18:16:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2462000000000001e-05 2024-09-17T18:16:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791394+0000", 2024-09-17T18:16:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4246000000000001e-05 2024-09-17T18:16:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791412+0000", 2024-09-17T18:16:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8556e-05 2024-09-17T18:16:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.795134+0000", 2024-09-17T18:16:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037219000000000002 2024-09-17T18:16:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.795157+0000", 2024-09-17T18:16:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3156e-05 2024-09-17T18:16:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.801210+0000", 2024-09-17T18:16:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060524250000000002 2024-09-17T18:16:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.801290+0000", 2024-09-17T18:16:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0061000000000005e-05 2024-09-17T18:16:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 53/31 ECSubWrite(tid=140, reqid=client.4565.0:458, at_version=53'25, trim_to=0'0, roll_forward_to=52'23))", 2024-09-17T18:16:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:48.377510+0000", 2024-09-17T18:16:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 20.979474538000002, 2024-09-17T18:16:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010092136, 2024-09-17T18:16:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.377510+0000", 2024-09-17T18:16:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.377510+0000", 2024-09-17T18:16:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.377511+0000", 2024-09-17T18:16:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9000000000000002e-07 2024-09-17T18:16:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.378388+0000", 2024-09-17T18:16:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00087706399999999999 2024-09-17T18:16:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.378430+0000", 2024-09-17T18:16:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2321999999999999e-05 2024-09-17T18:16:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.378456+0000", 2024-09-17T18:16:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6069999999999999e-05 2024-09-17T18:16:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.378704+0000", 2024-09-17T18:16:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000247944 2024-09-17T18:16:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.378730+0000", 2024-09-17T18:16:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5588999999999998e-05 2024-09-17T18:16:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.387499+0000", 2024-09-17T18:16:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087697460000000001 2024-09-17T18:16:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.387602+0000", 2024-09-17T18:16:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010301099999999999 2024-09-17T18:16:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 53/31 ECSubWrite(tid=141, reqid=client.4565.0:459, at_version=53'26, trim_to=0'0, roll_forward_to=52'23))", 2024-09-17T18:16:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:48.383804+0000", 2024-09-17T18:16:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 20.97318031, 2024-09-17T18:16:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098318940000000007, 2024-09-17T18:16:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.383804+0000", 2024-09-17T18:16:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.383804+0000", 2024-09-17T18:16:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.383807+0000", 2024-09-17T18:16:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2139999999999999e-06 2024-09-17T18:16:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.384257+0000", 2024-09-17T18:16:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00044987800000000002 2024-09-17T18:16:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.384292+0000", 2024-09-17T18:16:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5225999999999998e-05 2024-09-17T18:16:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.384316+0000", 2024-09-17T18:16:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4116000000000001e-05 2024-09-17T18:16:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.384541+0000", 2024-09-17T18:16:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000224811 2024-09-17T18:16:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.384565+0000", 2024-09-17T18:16:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4732999999999999e-05 2024-09-17T18:16:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.393535+0000", 2024-09-17T18:16:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0089697749999999993 2024-09-17T18:16:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:48.393636+0000", 2024-09-17T18:16:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101141 2024-09-17T18:16:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.as4 54/31 ECSubWrite(tid=276, reqid=client.4565.0:502, at_version=54'71, trim_to=0'0, roll_forward_to=52'68))", 2024-09-17T18:16:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.317044+0000", 2024-09-17T18:16:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 20.039940855000001, 2024-09-17T18:16:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091146730000000002, 2024-09-17T18:16:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.317044+0000", 2024-09-17T18:16:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.317044+0000", 2024-09-17T18:16:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.317044+0000", 2024-09-17T18:16:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.51e-07 2024-09-17T18:16:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.317189+0000", 2024-09-17T18:16:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014444800000000001 2024-09-17T18:16:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.317210+0000", 2024-09-17T18:16:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1107999999999998e-05 2024-09-17T18:16:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.317228+0000", 2024-09-17T18:16:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8368000000000001e-05 2024-09-17T18:16:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.318360+0000", 2024-09-17T18:16:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011315780000000001 2024-09-17T18:16:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.318382+0000", 2024-09-17T18:16:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2189999999999999e-05 2024-09-17T18:16:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.326053+0000", 2024-09-17T18:16:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076711890000000001 2024-09-17T18:16:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.326159+0000", 2024-09-17T18:16:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010534100000000001 2024-09-17T18:16:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 54/31 ECSubWrite(tid=147, reqid=osd.6.0:147, at_version=54'31, trim_to=0'0, roll_forward_to=53'28))", 2024-09-17T18:16:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.338852+0000", 2024-09-17T18:16:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 20.018132265999999, 2024-09-17T18:16:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090757890000000008, 2024-09-17T18:16:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.338852+0000", 2024-09-17T18:16:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.338852+0000", 2024-09-17T18:16:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.338854+0000", 2024-09-17T18:16:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6670000000000001e-06 2024-09-17T18:16:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.338908+0000", 2024-09-17T18:16:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3418000000000003e-05 2024-09-17T18:16:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.338934+0000", 2024-09-17T18:16:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6322999999999999e-05 2024-09-17T18:16:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339028+0000", 2024-09-17T18:16:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4374000000000001e-05 2024-09-17T18:16:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339201+0000", 2024-09-17T18:16:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017309199999999999 2024-09-17T18:16:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339227+0000", 2024-09-17T18:16:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5712999999999999e-05 2024-09-17T18:16:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.347835+0000", 2024-09-17T18:16:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086075890000000006 2024-09-17T18:16:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.347928+0000", 2024-09-17T18:16:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3613e-05 2024-09-17T18:16:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:602 3.0s0 3:0dbbb22b:::smithi15432074-50:16 [read 639218~3079950,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-09-17T18:16:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:01.316754+0000", 2024-09-17T18:16:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0402310949999993, 2024-09-17T18:16:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014939278, 2024-09-17T18:16:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 602 2024-09-17T18:16:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.316754+0000", 2024-09-17T18:16:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.316754+0000", 2024-09-17T18:16:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.316757+0000", 2024-09-17T18:16:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8330000000000004e-06 2024-09-17T18:16:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.316790+0000", 2024-09-17T18:16:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2768999999999997e-05 2024-09-17T18:16:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.316828+0000", 2024-09-17T18:16:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8166e-05 2024-09-17T18:16:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.316847+0000", 2024-09-17T18:16:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8757e-05 2024-09-17T18:16:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317077+0000", 2024-09-17T18:16:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023028299999999999 2024-09-17T18:16:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-17T18:16:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317096+0000", 2024-09-17T18:16:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9034000000000001e-05 2024-09-17T18:16:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.321697+0000", 2024-09-17T18:16:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046008910000000002 2024-09-17T18:16:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.321862+0000", 2024-09-17T18:16:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016449300000000001 2024-09-17T18:16:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.331693+0000", 2024-09-17T18:16:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098310519999999998 2024-09-17T18:16:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:603 3.0s0 3:0dbbb22b:::smithi15432074-50:16 [read 2050151~1669017,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-09-17T18:16:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:01.316894+0000", 2024-09-17T18:16:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.040090288, 2024-09-17T18:16:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016058693999999998, 2024-09-17T18:16:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 603 2024-09-17T18:16:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.316894+0000", 2024-09-17T18:16:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.316894+0000", 2024-09-17T18:16:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.316896+0000", 2024-09-17T18:16:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1060000000000001e-06 2024-09-17T18:16:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.316901+0000", 2024-09-17T18:16:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.643e-06 2024-09-17T18:16:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.316915+0000", 2024-09-17T18:16:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3507e-05 2024-09-17T18:16:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.316925+0000", 2024-09-17T18:16:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0463e-05 2024-09-17T18:16:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317222+0000", 2024-09-17T18:16:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000296638 2024-09-17T18:16:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317227+0000", 2024-09-17T18:16:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0370000000000002e-06 2024-09-17T18:16:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.322419+0000", 2024-09-17T18:16:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051918470000000003 2024-09-17T18:16:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.322560+0000", 2024-09-17T18:16:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000141409 2024-09-17T18:16:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.332953+0000", 2024-09-17T18:16:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010393044000000001 2024-09-17T18:16:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:604 3.0s0 3:0dbbb22b:::smithi15432074-50:16 [read 2070882~1648286,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-09-17T18:16:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:01.317027+0000", 2024-09-17T18:16:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0399574489999992, 2024-09-17T18:16:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017178397000000001, 2024-09-17T18:16:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 604 2024-09-17T18:16:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317027+0000", 2024-09-17T18:16:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317027+0000", 2024-09-17T18:16:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317028+0000", 2024-09-17T18:16:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5700000000000001e-07 2024-09-17T18:16:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317044+0000", 2024-09-17T18:16:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.539e-05 2024-09-17T18:16:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317060+0000", 2024-09-17T18:16:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6878999999999999e-05 2024-09-17T18:16:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317070+0000", 2024-09-17T18:16:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8169999999999994e-06 2024-09-17T18:16:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317266+0000", 2024-09-17T18:16:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019572 2024-09-17T18:16:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317270+0000", 2024-09-17T18:16:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.34e-06 2024-09-17T18:16:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.325365+0000", 2024-09-17T18:16:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0080942819999999995 2024-09-17T18:16:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.325515+0000", 2024-09-17T18:16:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000150729 2024-09-17T18:16:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.334206+0000", 2024-09-17T18:16:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086903829999999994 2024-09-17T18:16:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:611 3.0s0 3:0c709a8a:::smithi15432074-26:head [delete] snapc 16=[16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-17T18:16:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:01.317084+0000", 2024-09-17T18:16:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0399009330000002, 2024-09-17T18:16:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017792371000000001, 2024-09-17T18:16:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 611 2024-09-17T18:16:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317084+0000", 2024-09-17T18:16:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317084+0000", 2024-09-17T18:16:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317085+0000", 2024-09-17T18:16:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1999999999999998e-07 2024-09-17T18:16:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317088+0000", 2024-09-17T18:16:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8469999999999998e-06 2024-09-17T18:16:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317101+0000", 2024-09-17T18:16:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2529e-05 2024-09-17T18:16:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317110+0000", 2024-09-17T18:16:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0759999999999992e-06 2024-09-17T18:16:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317295+0000", 2024-09-17T18:16:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185019 2024-09-17T18:16:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.317299+0000", 2024-09-17T18:16:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2649999999999998e-06 2024-09-17T18:16:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.326513+0000", 2024-09-17T18:16:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092137369999999996 2024-09-17T18:16:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.326756+0000", 2024-09-17T18:16:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000243088 2024-09-17T18:16:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.327619+0000", 2024-09-17T18:16:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00086282800000000005 2024-09-17T18:16:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.334429+0000", 2024-09-17T18:16:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0068101760000000003 2024-09-17T18:16:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.334704+0000", 2024-09-17T18:16:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027508300000000002 2024-09-17T18:16:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:01.334876+0000", 2024-09-17T18:16:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000171903 2024-09-17T18:16:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:659 3.0s0 3:0c709a8a:::smithi15432074-26:head [append 0~737280] snapc 1a=[1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T18:16:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:05.440935+0000", 2024-09-17T18:16:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.9160493509999998, 2024-09-17T18:16:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022050706, 2024-09-17T18:16:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 659 2024-09-17T18:16:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.440935+0000", 2024-09-17T18:16:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.440935+0000", 2024-09-17T18:16:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.440939+0000", 2024-09-17T18:16:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7629999999999998e-06 2024-09-17T18:16:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.441875+0000", 2024-09-17T18:16:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093599000000000004 2024-09-17T18:16:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.441913+0000", 2024-09-17T18:16:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8216000000000001e-05 2024-09-17T18:16:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.441936+0000", 2024-09-17T18:16:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2935999999999999e-05 2024-09-17T18:16:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.442090+0000", 2024-09-17T18:16:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015369299999999999 2024-09-17T18:16:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-17T18:16:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.442107+0000", 2024-09-17T18:16:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6983e-05 2024-09-17T18:16:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.446230+0000", 2024-09-17T18:16:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041234490000000004 2024-09-17T18:16:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.446453+0000", 2024-09-17T18:16:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022280100000000001 2024-09-17T18:16:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.449103+0000", 2024-09-17T18:16:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026499679999999999 2024-09-17T18:16:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.455639+0000", 2024-09-17T18:16:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065355969999999998 2024-09-17T18:16:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.462747+0000", 2024-09-17T18:16:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0071083129999999998 2024-09-17T18:16:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.462986+0000", 2024-09-17T18:16:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023899699999999999 2024-09-17T18:16:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:660 3.0s0 3:0c709a8a:::smithi15432074-26:head [append 0~557056] snapc 1a=[1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T18:16:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:05.447090+0000", 2024-09-17T18:16:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.9098942609999998, 2024-09-17T18:16:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016989488000000001, 2024-09-17T18:16:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 660 2024-09-17T18:16:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.447090+0000", 2024-09-17T18:16:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.447090+0000", 2024-09-17T18:16:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.447093+0000", 2024-09-17T18:16:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0199999999999999e-06 2024-09-17T18:16:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.447824+0000", 2024-09-17T18:16:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00073009099999999999 2024-09-17T18:16:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.447867+0000", 2024-09-17T18:16:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3548999999999999e-05 2024-09-17T18:16:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.447887+0000", 2024-09-17T18:16:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0207000000000002e-05 2024-09-17T18:16:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.451295+0000", 2024-09-17T18:16:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034081139999999998 2024-09-17T18:16:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.451710+0000", 2024-09-17T18:16:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041484300000000003 2024-09-17T18:16:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.454016+0000", 2024-09-17T18:16:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023060630000000001 2024-09-17T18:16:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.463012+0000", 2024-09-17T18:16:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0089952020000000008 2024-09-17T18:16:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.463904+0000", 2024-09-17T18:16:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00089239400000000002 2024-09-17T18:16:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.464080+0000", 2024-09-17T18:16:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017600499999999999 2024-09-17T18:16:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:661 3.0s0 3:0c709a8a:::smithi15432074-26:head [append 0~606208] snapc 1a=[1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T18:16:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:05.455175+0000", 2024-09-17T18:16:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.9018092800000002, 2024-09-17T18:16:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098084079999999994, 2024-09-17T18:16:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 661 2024-09-17T18:16:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.455175+0000", 2024-09-17T18:16:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.455175+0000", 2024-09-17T18:16:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.455178+0000", 2024-09-17T18:16:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6599999999999999e-06 2024-09-17T18:16:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456071+0000", 2024-09-17T18:16:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00089324800000000002 2024-09-17T18:16:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456109+0000", 2024-09-17T18:16:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7431999999999997e-05 2024-09-17T18:16:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456133+0000", 2024-09-17T18:16:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4593e-05 2024-09-17T18:16:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456605+0000", 2024-09-17T18:16:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047198800000000001 2024-09-17T18:16:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456926+0000", 2024-09-17T18:16:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032040500000000001 2024-09-17T18:16:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.459094+0000", 2024-09-17T18:16:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021678829999999998 2024-09-17T18:16:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.463015+0000", 2024-09-17T18:16:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0039218389999999999 2024-09-17T18:16:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.464922+0000", 2024-09-17T18:16:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0019062180000000001 2024-09-17T18:16:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.464984+0000", 2024-09-17T18:16:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2142000000000002e-05 2024-09-17T18:16:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:662 3.0s0 3:0c709a8a:::smithi15432074-26:head [setxattr _header (57) in=7b] snapc 1a=[1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T18:16:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:05.456173+0000", 2024-09-17T18:16:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.9008118180000002, 2024-09-17T18:16:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0089481000000000005, 2024-09-17T18:16:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 662 2024-09-17T18:16:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456173+0000", 2024-09-17T18:16:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456173+0000", 2024-09-17T18:16:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456175+0000", 2024-09-17T18:16:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0600000000000002e-06 2024-09-17T18:16:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456185+0000", 2024-09-17T18:16:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9159999999999996e-06 2024-09-17T18:16:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456208+0000", 2024-09-17T18:16:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2955999999999998e-05 2024-09-17T18:16:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456223+0000", 2024-09-17T18:16:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5194000000000001e-05 2024-09-17T18:16:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.460933+0000", 2024-09-17T18:16:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047098050000000001 2024-09-17T18:16:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.461174+0000", 2024-09-17T18:16:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024156500000000001 2024-09-17T18:16:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.461943+0000", 2024-09-17T18:16:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00076831200000000005 2024-09-17T18:16:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.464106+0000", 2024-09-17T18:16:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021629470000000001 2024-09-17T18:16:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.465070+0000", 2024-09-17T18:16:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00096425199999999997 2024-09-17T18:16:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.465121+0000", 2024-09-17T18:16:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1093e-05 2024-09-17T18:16:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:663 3.0s0 3:0c709a8a:::smithi15432074-26:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e70)", 2024-09-17T18:16:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:05.456248+0000", 2024-09-17T18:16:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.9007364600000001, 2024-09-17T18:16:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011644844999999999, 2024-09-17T18:16:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 663 2024-09-17T18:16:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456248+0000", 2024-09-17T18:16:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456248+0000", 2024-09-17T18:16:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456250+0000", 2024-09-17T18:16:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5030000000000001e-06 2024-09-17T18:16:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456257+0000", 2024-09-17T18:16:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0840000000000003e-06 2024-09-17T18:16:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456277+0000", 2024-09-17T18:16:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9865e-05 2024-09-17T18:16:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.456297+0000", 2024-09-17T18:16:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9797e-05 2024-09-17T18:16:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.466113+0000", 2024-09-17T18:16:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009816043 2024-09-17T18:16:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.466340+0000", 2024-09-17T18:16:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022750400000000001 2024-09-17T18:16:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.467893+0000", 2024-09-17T18:16:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015530489999999999 2024-09-17T18:16:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.476 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:09.477 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:16:09.478 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:16:09.478 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:16:09.479 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:16:09.479 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T18:16:09.479 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:09.473+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:09.480 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:16:09.480 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:16:09.480 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:16:09.481 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:16:09.481 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:16:09.481 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:16:09.481 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:16:09.482 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:16:09.497 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:16:09.497 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:16:09.579 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:09.577+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:09.649 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:09.650 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:09.650 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T18:16:09.650 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:09.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T18:16:09.711 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:09.709+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:09.721 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:16:09.721 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:16:09.749 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:16:09.749 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:16:09.780 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:09.778+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:09.783 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:09.783 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:09.783 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T18:16:09.783 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T18:16:09.783 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:09.797 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T18:16:09.881 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:09.878+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:09.964 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:09.965 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T18:16:09.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T18:16:09.965 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T18:16:09.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.965 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:363 3.9s0 3:9d124c8a:::smithi15432074-25:head [delete] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+full_force+supports_pool_eio e42)", 2024-09-17T18:16:09.965 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:37.764061+0000", 2024-09-17T18:16:09.965 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.198387963000002, 2024-09-17T18:16:09.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025800416999999999, 2024-09-17T18:16:09.966 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.966 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.966 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:09.966 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:09.966 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:09.966 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:09.966 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 363 2024-09-17T18:16:09.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.966 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764061+0000", 2024-09-17T18:16:09.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764061+0000", 2024-09-17T18:16:09.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764063+0000", 2024-09-17T18:16:09.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0640000000000001e-06 2024-09-17T18:16:09.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764072+0000", 2024-09-17T18:16:09.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5799999999999992e-06 2024-09-17T18:16:09.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764093+0000", 2024-09-17T18:16:09.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1495e-05 2024-09-17T18:16:09.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764107+0000", 2024-09-17T18:16:09.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3923999999999999e-05 2024-09-17T18:16:09.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764184+0000", 2024-09-17T18:16:09.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7185e-05 2024-09-17T18:16:09.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-17T18:16:09.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764194+0000", 2024-09-17T18:16:09.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.798e-06 2024-09-17T18:16:09.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.765898+0000", 2024-09-17T18:16:09.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0017036530000000001 2024-09-17T18:16:09.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:09.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766028+0000", 2024-09-17T18:16:09.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012982299999999999 2024-09-17T18:16:09.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766720+0000", 2024-09-17T18:16:09.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069236299999999998 2024-09-17T18:16:09.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.775694+0000", 2024-09-17T18:16:09.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0089743789999999993 2024-09-17T18:16:09.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:09.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.789778+0000", 2024-09-17T18:16:09.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014084051 2024-09-17T18:16:09.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.789862+0000", 2024-09-17T18:16:09.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3102000000000005e-05 2024-09-17T18:16:09.972 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.972 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.972 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.972 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(osd.5.22:2 3.9s0 3:9634a0c7:::smithi15432074-24:head [assert-version v19,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:09.972 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:37.770314+0000", 2024-09-17T18:16:09.972 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.192135233000002, 2024-09-17T18:16:09.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033325575000000003, 2024-09-17T18:16:09.973 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.973 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.973 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:09.973 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770314+0000", 2024-09-17T18:16:09.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770314+0000", 2024-09-17T18:16:09.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770317+0000", 2024-09-17T18:16:09.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.627e-06 2024-09-17T18:16:09.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770327+0000", 2024-09-17T18:16:09.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0789e-05 2024-09-17T18:16:09.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770356+0000", 2024-09-17T18:16:09.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8940000000000001e-05 2024-09-17T18:16:09.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770377+0000", 2024-09-17T18:16:09.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0361999999999999e-05 2024-09-17T18:16:09.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.775952+0000", 2024-09-17T18:16:09.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005575333 2024-09-17T18:16:09.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:09.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.776188+0000", 2024-09-17T18:16:09.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000235982 2024-09-17T18:16:09.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.795949+0000", 2024-09-17T18:16:09.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019760771999999999 2024-09-17T18:16:09.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:09.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.796074+0000", 2024-09-17T18:16:09.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012547900000000001 2024-09-17T18:16:09.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.803639+0000", 2024-09-17T18:16:09.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007565291 2024-09-17T18:16:09.977 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.977 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.977 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.978 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:398 3.9s0 3:91028b13:::smithi15432074-34:head [append 0~606208] snapc d=[d,c,b,a,9,8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T18:16:09.978 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:43.828873+0000", 2024-09-17T18:16:09.978 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.133576000000001, 2024-09-17T18:16:09.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022798233000000001, 2024-09-17T18:16:09.978 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.978 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.978 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:09.978 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:09.978 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:09.978 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:09.978 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 398 2024-09-17T18:16:09.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.979 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.828873+0000", 2024-09-17T18:16:09.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.828873+0000", 2024-09-17T18:16:09.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.828877+0000", 2024-09-17T18:16:09.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6569999999999999e-06 2024-09-17T18:16:09.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.829552+0000", 2024-09-17T18:16:09.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00067549600000000004 2024-09-17T18:16:09.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.829586+0000", 2024-09-17T18:16:09.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3923e-05 2024-09-17T18:16:09.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.829604+0000", 2024-09-17T18:16:09.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7425999999999999e-05 2024-09-17T18:16:09.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.829883+0000", 2024-09-17T18:16:09.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027969300000000002 2024-09-17T18:16:09.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-17T18:16:09.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.829965+0000", 2024-09-17T18:16:09.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1755000000000006e-05 2024-09-17T18:16:09.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.833780+0000", 2024-09-17T18:16:09.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038152870000000001 2024-09-17T18:16:09.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:09.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.834070+0000", 2024-09-17T18:16:09.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028968 2024-09-17T18:16:09.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:09.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.837763+0000", 2024-09-17T18:16:09.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036926369999999999 2024-09-17T18:16:09.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:09.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843381+0000", 2024-09-17T18:16:09.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056183989999999996 2024-09-17T18:16:09.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:09.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.851445+0000", 2024-09-17T18:16:09.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0080642149999999996 2024-09-17T18:16:09.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.851671+0000", 2024-09-17T18:16:09.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022606500000000001 2024-09-17T18:16:09.984 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.984 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.984 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.984 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:402 3.9s0 3:91028b13:::smithi15432074-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48)", 2024-09-17T18:16:09.984 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:43.843801+0000", 2024-09-17T18:16:09.984 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.118647797000001, 2024-09-17T18:16:09.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016980807000000001, 2024-09-17T18:16:09.985 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.985 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.985 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:09.985 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:09.985 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:09.985 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:09.985 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 402 2024-09-17T18:16:09.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.985 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843801+0000", 2024-09-17T18:16:09.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843801+0000", 2024-09-17T18:16:09.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843803+0000", 2024-09-17T18:16:09.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5689999999999999e-06 2024-09-17T18:16:09.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843810+0000", 2024-09-17T18:16:09.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5329999999999997e-06 2024-09-17T18:16:09.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843834+0000", 2024-09-17T18:16:09.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3354e-05 2024-09-17T18:16:09.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843854+0000", 2024-09-17T18:16:09.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0438999999999999e-05 2024-09-17T18:16:09.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.855070+0000", 2024-09-17T18:16:09.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011216248999999999 2024-09-17T18:16:09.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:09.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.855397+0000", 2024-09-17T18:16:09.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032609499999999999 2024-09-17T18:16:09.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.858525+0000", 2024-09-17T18:16:09.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031287849999999998 2024-09-17T18:16:09.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:09.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.858731+0000", 2024-09-17T18:16:09.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020568600000000001 2024-09-17T18:16:09.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.860782+0000", 2024-09-17T18:16:09.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002051097 2024-09-17T18:16:09.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.989 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.990 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(osd.4.23:3 3.9s0 3:91028b13:::smithi15432074-34:head [assert-version v49,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:09.990 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.322844+0000", 2024-09-17T18:16:09.990 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 20.639604882, 2024-09-17T18:16:09.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021374363, 2024-09-17T18:16:09.990 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.990 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.990 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:09.990 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.322844+0000", 2024-09-17T18:16:09.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.322844+0000", 2024-09-17T18:16:09.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.322848+0000", 2024-09-17T18:16:09.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5640000000000001e-06 2024-09-17T18:16:09.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.322863+0000", 2024-09-17T18:16:09.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5559000000000001e-05 2024-09-17T18:16:09.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.322896+0000", 2024-09-17T18:16:09.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2688999999999998e-05 2024-09-17T18:16:09.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.322917+0000", 2024-09-17T18:16:09.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1406000000000001e-05 2024-09-17T18:16:09.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.326995+0000", 2024-09-17T18:16:09.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040777790000000001 2024-09-17T18:16:09.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:09.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.327260+0000", 2024-09-17T18:16:09.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026509400000000001 2024-09-17T18:16:09.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:09.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.344219+0000", 2024-09-17T18:16:09.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016958272 2024-09-17T18:16:09.994 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.994 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:09.994 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:09.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.994 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:528 3.9s0 3:9c3858d0:::smithi15432074-4:head [read 752861~574243,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-17T18:16:09.994 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:50.318464+0000", 2024-09-17T18:16:09.994 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.643984979999999, 2024-09-17T18:16:09.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015264338000000001, 2024-09-17T18:16:09.994 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:09.995 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:09.995 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:09.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:09.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:09.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:09.995 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 528 2024-09-17T18:16:09.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.995 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:09.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:09.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318464+0000", 2024-09-17T18:16:09.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:09.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318464+0000", 2024-09-17T18:16:09.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:09.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:09.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318466+0000", 2024-09-17T18:16:09.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7740000000000001e-06 2024-09-17T18:16:09.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:09.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318476+0000", 2024-09-17T18:16:09.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7030000000000001e-06 2024-09-17T18:16:09.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:09.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318506+0000", 2024-09-17T18:16:09.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0645999999999998e-05 2024-09-17T18:16:09.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:09.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318522+0000", 2024-09-17T18:16:09.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5495999999999999e-05 2024-09-17T18:16:09.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318651+0000", 2024-09-17T18:16:09.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012904299999999999 2024-09-17T18:16:09.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:09.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318666+0000", 2024-09-17T18:16:09.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4722999999999999e-05 2024-09-17T18:16:09.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:09.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.326903+0000", 2024-09-17T18:16:09.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082379050000000002 2024-09-17T18:16:09.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:09.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:09.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:09.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.326988+0000", 2024-09-17T18:16:09.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4213000000000002e-05 2024-09-17T18:16:10.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.333728+0000", 2024-09-17T18:16:10.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0067408349999999997 2024-09-17T18:16:10.000 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.000 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.000 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.000 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:529 3.9s0 3:9c3858d0:::smithi15432074-4:head [read 0~1327104,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-17T18:16:10.000 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:50.318545+0000", 2024-09-17T18:16:10.001 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.643904222, 2024-09-17T18:16:10.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017043862999999999, 2024-09-17T18:16:10.001 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.001 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.001 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:10.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:10.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:10.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:10.001 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 529 2024-09-17T18:16:10.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.002 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318545+0000", 2024-09-17T18:16:10.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318545+0000", 2024-09-17T18:16:10.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318546+0000", 2024-09-17T18:16:10.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1799999999999999e-06 2024-09-17T18:16:10.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318555+0000", 2024-09-17T18:16:10.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4500000000000004e-06 2024-09-17T18:16:10.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318574+0000", 2024-09-17T18:16:10.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9066e-05 2024-09-17T18:16:10.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318591+0000", 2024-09-17T18:16:10.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7223000000000001e-05 2024-09-17T18:16:10.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318710+0000", 2024-09-17T18:16:10.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119418 2024-09-17T18:16:10.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:10.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318718+0000", 2024-09-17T18:16:10.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7109999999999995e-06 2024-09-17T18:16:10.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.328068+0000", 2024-09-17T18:16:10.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093504609999999991 2024-09-17T18:16:10.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:10.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.328355+0000", 2024-09-17T18:16:10.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028624 2024-09-17T18:16:10.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.335589+0000", 2024-09-17T18:16:10.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072341139999999998 2024-09-17T18:16:10.007 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.007 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.007 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.007 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:679 3.9s0 3:9d124c8a:::smithi15432074-25:head [append 0~458752] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:10.008 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.453487+0000", 2024-09-17T18:16:10.008 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.5089621260000001, 2024-09-17T18:16:10.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020100080999999999, 2024-09-17T18:16:10.008 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.008 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.008 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:10.008 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:10.009 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:10.009 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:10.009 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 679 2024-09-17T18:16:10.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.009 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.453487+0000", 2024-09-17T18:16:10.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.453487+0000", 2024-09-17T18:16:10.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.453490+0000", 2024-09-17T18:16:10.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.056e-06 2024-09-17T18:16:10.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.454020+0000", 2024-09-17T18:16:10.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053003700000000002 2024-09-17T18:16:10.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.454055+0000", 2024-09-17T18:16:10.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5332e-05 2024-09-17T18:16:10.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.454078+0000", 2024-09-17T18:16:10.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2952999999999999e-05 2024-09-17T18:16:10.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.454265+0000", 2024-09-17T18:16:10.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000186405 2024-09-17T18:16:10.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-17T18:16:10.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.454277+0000", 2024-09-17T18:16:10.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2683e-05 2024-09-17T18:16:10.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.458599+0000", 2024-09-17T18:16:10.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043215179999999999 2024-09-17T18:16:10.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:10.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.458804+0000", 2024-09-17T18:16:10.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000205341 2024-09-17T18:16:10.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.460687+0000", 2024-09-17T18:16:10.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0018830369999999999 2024-09-17T18:16:10.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.466403+0000", 2024-09-17T18:16:10.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057153830000000001 2024-09-17T18:16:10.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:10.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.473312+0000", 2024-09-17T18:16:10.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069090030000000004 2024-09-17T18:16:10.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.473587+0000", 2024-09-17T18:16:10.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000275333 2024-09-17T18:16:10.015 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.015 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.015 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.016 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:680 3.9s0 3:9d124c8a:::smithi15432074-25:head [append 0~507904] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:10.016 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.458296+0000", 2024-09-17T18:16:10.016 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.5041526250000001, 2024-09-17T18:16:10.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016091952999999999, 2024-09-17T18:16:10.016 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.016 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.016 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:10.016 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:10.016 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:10.016 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:10.016 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 680 2024-09-17T18:16:10.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.017 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.458296+0000", 2024-09-17T18:16:10.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.458296+0000", 2024-09-17T18:16:10.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.458300+0000", 2024-09-17T18:16:10.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2059999999999999e-06 2024-09-17T18:16:10.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.459103+0000", 2024-09-17T18:16:10.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080317599999999996 2024-09-17T18:16:10.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.459137+0000", 2024-09-17T18:16:10.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4208999999999997e-05 2024-09-17T18:16:10.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.459160+0000", 2024-09-17T18:16:10.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2762999999999999e-05 2024-09-17T18:16:10.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.462905+0000", 2024-09-17T18:16:10.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037447359999999998 2024-09-17T18:16:10.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:10.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.463127+0000", 2024-09-17T18:16:10.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000222563 2024-09-17T18:16:10.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.464744+0000", 2024-09-17T18:16:10.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001617067 2024-09-17T18:16:10.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.473644+0000", 2024-09-17T18:16:10.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088993040000000002 2024-09-17T18:16:10.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:10.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.474219+0000", 2024-09-17T18:16:10.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00057578000000000002 2024-09-17T18:16:10.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.474388+0000", 2024-09-17T18:16:10.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169149 2024-09-17T18:16:10.022 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.022 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.022 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.022 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:682 3.9s0 3:9d124c8a:::smithi15432074-25:head [append 0~458752] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:10.022 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.469190+0000", 2024-09-17T18:16:10.022 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.4932593249999999, 2024-09-17T18:16:10.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019040099000000001, 2024-09-17T18:16:10.022 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.022 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.022 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:10.023 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:10.023 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:10.023 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:10.023 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 682 2024-09-17T18:16:10.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.023 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.469190+0000", 2024-09-17T18:16:10.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.469190+0000", 2024-09-17T18:16:10.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.469254+0000", 2024-09-17T18:16:10.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4513999999999999e-05 2024-09-17T18:16:10.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.469973+0000", 2024-09-17T18:16:10.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00071838499999999999 2024-09-17T18:16:10.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470013+0000", 2024-09-17T18:16:10.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9922000000000002e-05 2024-09-17T18:16:10.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470033+0000", 2024-09-17T18:16:10.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0869e-05 2024-09-17T18:16:10.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.476274+0000", 2024-09-17T18:16:10.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00624057 2024-09-17T18:16:10.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:10.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.476600+0000", 2024-09-17T18:16:10.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032577499999999999 2024-09-17T18:16:10.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.478586+0000", 2024-09-17T18:16:10.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0019858409999999999 2024-09-17T18:16:10.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.484109+0000", 2024-09-17T18:16:10.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055233440000000003 2024-09-17T18:16:10.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:10.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.488013+0000", 2024-09-17T18:16:10.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0039038950000000001 2024-09-17T18:16:10.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.488230+0000", 2024-09-17T18:16:10.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021698400000000001 2024-09-17T18:16:10.028 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.032 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.032 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.032 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:683 3.9s0 3:9d124c8a:::smithi15432074-25:head [append 0~81920] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:10.032 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.470101+0000", 2024-09-17T18:16:10.033 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.4923483590000002, 2024-09-17T18:16:10.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019222164, 2024-09-17T18:16:10.033 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.033 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.033 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:10.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:10.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:10.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:10.033 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 683 2024-09-17T18:16:10.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.033 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470101+0000", 2024-09-17T18:16:10.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470101+0000", 2024-09-17T18:16:10.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470103+0000", 2024-09-17T18:16:10.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0559999999999999e-06 2024-09-17T18:16:10.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470239+0000", 2024-09-17T18:16:10.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013583599999999999 2024-09-17T18:16:10.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470262+0000", 2024-09-17T18:16:10.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.368e-05 2024-09-17T18:16:10.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470282+0000", 2024-09-17T18:16:10.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9335999999999999e-05 2024-09-17T18:16:10.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.479986+0000", 2024-09-17T18:16:10.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097039250000000004 2024-09-17T18:16:10.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:10.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.480255+0000", 2024-09-17T18:16:10.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026984600000000002 2024-09-17T18:16:10.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.481689+0000", 2024-09-17T18:16:10.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001433882 2024-09-17T18:16:10.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.487710+0000", 2024-09-17T18:16:10.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060205620000000001 2024-09-17T18:16:10.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:10.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.489017+0000", 2024-09-17T18:16:10.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001307016 2024-09-17T18:16:10.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.489323+0000", 2024-09-17T18:16:10.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030602500000000003 2024-09-17T18:16:10.038 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.038 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.038 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.038 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:684 3.9s0 3:9d124c8a:::smithi15432074-25:head [setxattr _header (57) in=7b] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:10.038 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.470313+0000", 2024-09-17T18:16:10.038 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.4921359189999999, 2024-09-17T18:16:10.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027914910000000001, 2024-09-17T18:16:10.039 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.039 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.039 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:10.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:10.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:10.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:10.039 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 684 2024-09-17T18:16:10.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.039 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470313+0000", 2024-09-17T18:16:10.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470313+0000", 2024-09-17T18:16:10.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470315+0000", 2024-09-17T18:16:10.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4440000000000001e-06 2024-09-17T18:16:10.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470323+0000", 2024-09-17T18:16:10.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4360000000000002e-06 2024-09-17T18:16:10.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470347+0000", 2024-09-17T18:16:10.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4372999999999999e-05 2024-09-17T18:16:10.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470356+0000", 2024-09-17T18:16:10.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8529999999999998e-06 2024-09-17T18:16:10.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.490506+0000", 2024-09-17T18:16:10.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020149571000000002 2024-09-17T18:16:10.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:10.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.490780+0000", 2024-09-17T18:16:10.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027409299999999999 2024-09-17T18:16:10.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.492119+0000", 2024-09-17T18:16:10.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001339151 2024-09-17T18:16:10.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.494495+0000", 2024-09-17T18:16:10.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023762980000000002 2024-09-17T18:16:10.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:10.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.498058+0000", 2024-09-17T18:16:10.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035630079999999999 2024-09-17T18:16:10.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.498228+0000", 2024-09-17T18:16:10.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016968300000000001 2024-09-17T18:16:10.044 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.044 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.044 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.044 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:685 3.9s0 3:9d124c8a:::smithi15432074-25:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:10.045 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.470375+0000", 2024-09-17T18:16:10.045 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.4920742069999999, 2024-09-17T18:16:10.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030818741, 2024-09-17T18:16:10.045 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.045 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.045 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:10.045 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:10.045 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:10.045 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:10.045 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 685 2024-09-17T18:16:10.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.045 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470375+0000", 2024-09-17T18:16:10.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470375+0000", 2024-09-17T18:16:10.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470376+0000", 2024-09-17T18:16:10.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1999999999999998e-07 2024-09-17T18:16:10.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470382+0000", 2024-09-17T18:16:10.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-09-17T18:16:10.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470395+0000", 2024-09-17T18:16:10.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3427e-05 2024-09-17T18:16:10.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470403+0000", 2024-09-17T18:16:10.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6729999999999992e-06 2024-09-17T18:16:10.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.492783+0000", 2024-09-17T18:16:10.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022380209000000002 2024-09-17T18:16:10.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:10.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.493019+0000", 2024-09-17T18:16:10.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000235367 2024-09-17T18:16:10.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.499040+0000", 2024-09-17T18:16:10.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060217049999999996 2024-09-17T18:16:10.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:10.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.499246+0000", 2024-09-17T18:16:10.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020542600000000001 2024-09-17T18:16:10.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.501194+0000", 2024-09-17T18:16:10.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0019479580000000001 2024-09-17T18:16:10.049 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.050 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.050 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.050 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:712 3.9s0 3:91028b13:::smithi15432074-34:head [append 0~720896] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:10.050 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.606387+0000", 2024-09-17T18:16:10.050 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.3560622389999999, 2024-09-17T18:16:10.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015445688000000001, 2024-09-17T18:16:10.050 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.050 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.050 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:10.050 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:10.050 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:10.051 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:10.051 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 712 2024-09-17T18:16:10.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.051 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.606387+0000", 2024-09-17T18:16:10.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.606387+0000", 2024-09-17T18:16:10.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.606390+0000", 2024-09-17T18:16:10.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.303e-06 2024-09-17T18:16:10.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.606693+0000", 2024-09-17T18:16:10.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030279200000000002 2024-09-17T18:16:10.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.606728+0000", 2024-09-17T18:16:10.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5401999999999997e-05 2024-09-17T18:16:10.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.606749+0000", 2024-09-17T18:16:10.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0343000000000002e-05 2024-09-17T18:16:10.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.606882+0000", 2024-09-17T18:16:10.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000133549 2024-09-17T18:16:10.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:10.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.607129+0000", 2024-09-17T18:16:10.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024668100000000001 2024-09-17T18:16:10.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.608805+0000", 2024-09-17T18:16:10.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016762840000000001 2024-09-17T18:16:10.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.611203+0000", 2024-09-17T18:16:10.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023982090000000001 2024-09-17T18:16:10.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:10.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.621667+0000", 2024-09-17T18:16:10.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010463092 2024-09-17T18:16:10.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.621833+0000", 2024-09-17T18:16:10.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000166033 2024-09-17T18:16:10.056 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.056 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.056 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.056 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:714 3.9s0 3:91028b13:::smithi15432074-34:head [append 0~49152] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:10.056 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.613585+0000", 2024-09-17T18:16:10.056 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.3488639359999999, 2024-09-17T18:16:10.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016857889000000001, 2024-09-17T18:16:10.056 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.056 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.056 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:10.057 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:10.057 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:10.057 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:10.057 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 714 2024-09-17T18:16:10.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.057 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613585+0000", 2024-09-17T18:16:10.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613585+0000", 2024-09-17T18:16:10.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613587+0000", 2024-09-17T18:16:10.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.854e-06 2024-09-17T18:16:10.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613633+0000", 2024-09-17T18:16:10.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5479000000000003e-05 2024-09-17T18:16:10.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613656+0000", 2024-09-17T18:16:10.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3802e-05 2024-09-17T18:16:10.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613668+0000", 2024-09-17T18:16:10.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1620000000000001e-05 2024-09-17T18:16:10.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.617666+0000", 2024-09-17T18:16:10.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0039979070000000002 2024-09-17T18:16:10.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:10.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.617914+0000", 2024-09-17T18:16:10.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024822599999999999 2024-09-17T18:16:10.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.619540+0000", 2024-09-17T18:16:10.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016257470000000001 2024-09-17T18:16:10.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.621153+0000", 2024-09-17T18:16:10.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001613464 2024-09-17T18:16:10.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:10.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.630287+0000", 2024-09-17T18:16:10.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091339539999999997 2024-09-17T18:16:10.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.630443+0000", 2024-09-17T18:16:10.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015583599999999999 2024-09-17T18:16:10.062 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.062 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.062 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.062 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:715 3.9s0 3:91028b13:::smithi15432074-34:head [setxattr _header (57) in=7b] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:10.062 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.613690+0000", 2024-09-17T18:16:10.062 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.3487586949999999, 2024-09-17T18:16:10.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017636019999999999, 2024-09-17T18:16:10.063 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.063 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.063 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:10.063 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:10.063 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:10.063 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:10.063 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 715 2024-09-17T18:16:10.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.063 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613690+0000", 2024-09-17T18:16:10.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613690+0000", 2024-09-17T18:16:10.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613692+0000", 2024-09-17T18:16:10.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9099999999999999e-06 2024-09-17T18:16:10.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613700+0000", 2024-09-17T18:16:10.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9559999999999997e-06 2024-09-17T18:16:10.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613718+0000", 2024-09-17T18:16:10.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7683e-05 2024-09-17T18:16:10.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613729+0000", 2024-09-17T18:16:10.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1306e-05 2024-09-17T18:16:10.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.622011+0000", 2024-09-17T18:16:10.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082821539999999999 2024-09-17T18:16:10.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:10.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.622242+0000", 2024-09-17T18:16:10.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000230325 2024-09-17T18:16:10.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.623331+0000", 2024-09-17T18:16:10.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010896269999999999 2024-09-17T18:16:10.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.624647+0000", 2024-09-17T18:16:10.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0013159199999999999 2024-09-17T18:16:10.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:10.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.631207+0000", 2024-09-17T18:16:10.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065599949999999999 2024-09-17T18:16:10.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.631326+0000", 2024-09-17T18:16:10.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119144 2024-09-17T18:16:10.068 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.068 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.068 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.068 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:716 3.9s0 3:91028b13:::smithi15432074-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:10.068 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.613756+0000", 2024-09-17T18:16:10.068 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.34869306, 2024-09-17T18:16:10.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020731083000000001, 2024-09-17T18:16:10.069 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.069 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.069 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:10.069 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:10.069 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:10.069 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:10.069 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 716 2024-09-17T18:16:10.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.069 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613756+0000", 2024-09-17T18:16:10.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613756+0000", 2024-09-17T18:16:10.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613757+0000", 2024-09-17T18:16:10.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8599999999999996e-07 2024-09-17T18:16:10.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613761+0000", 2024-09-17T18:16:10.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0799999999999999e-06 2024-09-17T18:16:10.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613772+0000", 2024-09-17T18:16:10.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.112e-05 2024-09-17T18:16:10.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613780+0000", 2024-09-17T18:16:10.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-09-17T18:16:10.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.623948+0000", 2024-09-17T18:16:10.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010167206999999999 2024-09-17T18:16:10.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:10.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.624136+0000", 2024-09-17T18:16:10.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000188763 2024-09-17T18:16:10.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.631384+0000", 2024-09-17T18:16:10.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072478159999999998 2024-09-17T18:16:10.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:10.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.631509+0000", 2024-09-17T18:16:10.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000125112 2024-09-17T18:16:10.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.634487+0000", 2024-09-17T18:16:10.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002977876 2024-09-17T18:16:10.076 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.076 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.076 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.077 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:717 3.9s0 3:9634a0c7:::smithi15432074-24:head [append 0~0] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:10.077 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.613793+0000", 2024-09-17T18:16:10.077 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.3486561950000002, 2024-09-17T18:16:10.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018392212000000002, 2024-09-17T18:16:10.077 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.077 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.077 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:10.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:10.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:10.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:10.077 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 717 2024-09-17T18:16:10.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.078 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613793+0000", 2024-09-17T18:16:10.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613793+0000", 2024-09-17T18:16:10.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613794+0000", 2024-09-17T18:16:10.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.44e-07 2024-09-17T18:16:10.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613798+0000", 2024-09-17T18:16:10.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3959999999999999e-06 2024-09-17T18:16:10.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613807+0000", 2024-09-17T18:16:10.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1430000000000004e-06 2024-09-17T18:16:10.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613814+0000", 2024-09-17T18:16:10.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.754e-06 2024-09-17T18:16:10.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.624823+0000", 2024-09-17T18:16:10.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011009579 2024-09-17T18:16:10.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:10.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.625014+0000", 2024-09-17T18:16:10.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019081 2024-09-17T18:16:10.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.626541+0000", 2024-09-17T18:16:10.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001526845 2024-09-17T18:16:10.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.630457+0000", 2024-09-17T18:16:10.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0039160740000000003 2024-09-17T18:16:10.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:10.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.632100+0000", 2024-09-17T18:16:10.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016427989999999999 2024-09-17T18:16:10.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.632185+0000", 2024-09-17T18:16:10.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5167999999999995e-05 2024-09-17T18:16:10.082 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.082 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.082 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.082 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:718 3.9s0 3:9634a0c7:::smithi15432074-24:head [rollback 7] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:10.083 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.613825+0000", 2024-09-17T18:16:10.083 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.348624482, 2024-09-17T18:16:10.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021046438000000001, 2024-09-17T18:16:10.083 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.083 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.083 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:10.083 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:10.083 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:10.083 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:10.083 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 718 2024-09-17T18:16:10.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.083 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613825+0000", 2024-09-17T18:16:10.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613825+0000", 2024-09-17T18:16:10.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613825+0000", 2024-09-17T18:16:10.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-17T18:16:10.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613828+0000", 2024-09-17T18:16:10.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.819e-06 2024-09-17T18:16:10.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613837+0000", 2024-09-17T18:16:10.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1099999999999992e-06 2024-09-17T18:16:10.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613844+0000", 2024-09-17T18:16:10.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7460000000000003e-06 2024-09-17T18:16:10.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.627940+0000", 2024-09-17T18:16:10.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014096042 2024-09-17T18:16:10.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:10.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.628151+0000", 2024-09-17T18:16:10.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021151199999999999 2024-09-17T18:16:10.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.629174+0000", 2024-09-17T18:16:10.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001022797 2024-09-17T18:16:10.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.630561+0000", 2024-09-17T18:16:10.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0013862569999999999 2024-09-17T18:16:10.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:10.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.634729+0000", 2024-09-17T18:16:10.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004168143 2024-09-17T18:16:10.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.634871+0000", 2024-09-17T18:16:10.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014239799999999999 2024-09-17T18:16:10.089 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.089 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.089 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.089 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:719 3.9s0 3:9634a0c7:::smithi15432074-24:head [append 0~0] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:10.090 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.613854+0000", 2024-09-17T18:16:10.090 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.3485949860000002, 2024-09-17T18:16:10.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.024300537000000001, 2024-09-17T18:16:10.090 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.090 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.090 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:10.090 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:10.090 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:10.090 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:10.090 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 719 2024-09-17T18:16:10.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.090 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613854+0000", 2024-09-17T18:16:10.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613854+0000", 2024-09-17T18:16:10.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613855+0000", 2024-09-17T18:16:10.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4000000000000001e-07 2024-09-17T18:16:10.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613858+0000", 2024-09-17T18:16:10.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7930000000000002e-06 2024-09-17T18:16:10.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613866+0000", 2024-09-17T18:16:10.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9199999999999993e-06 2024-09-17T18:16:10.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613873+0000", 2024-09-17T18:16:10.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7530000000000004e-06 2024-09-17T18:16:10.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.632546+0000", 2024-09-17T18:16:10.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018672645000000002 2024-09-17T18:16:10.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:10.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.632660+0000", 2024-09-17T18:16:10.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000113792 2024-09-17T18:16:10.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.633319+0000", 2024-09-17T18:16:10.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00065883499999999998 2024-09-17T18:16:10.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.635158+0000", 2024-09-17T18:16:10.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0018398189999999999 2024-09-17T18:16:10.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:10.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.638035+0000", 2024-09-17T18:16:10.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002876562 2024-09-17T18:16:10.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.638155+0000", 2024-09-17T18:16:10.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119778 2024-09-17T18:16:10.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.095 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.095 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.095 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:10.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T18:16:10.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:16:10.094+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:16:10.198 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:10.193+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:10.224 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:10.224 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:10.224 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T18:16:10.225 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:10.240 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T18:16:10.299 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:10.294+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:10.317 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.13 to 1 (10000) 2024-09-17T18:16:10.327 INFO:tasks.rados.rados.0.smithi154.stdout:292: done (0 left) 2024-09-17T18:16:10.328 INFO:tasks.rados.rados.0.smithi154.stdout:293: setattr oid 32 current snap is 27 2024-09-17T18:16:10.328 INFO:tasks.rados.rados.0.smithi154.stdout:294: rollback oid 33 current snap is 27 2024-09-17T18:16:10.328 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 33 to 26 2024-09-17T18:16:10.328 INFO:tasks.rados.rados.0.smithi154.stdout:295: rmattr oid 47 current snap is 27 2024-09-17T18:16:10.328 INFO:tasks.rados.rados.0.smithi154.stdout:295: done (2 left) 2024-09-17T18:16:10.328 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 30 current snap is 27 2024-09-17T18:16:10.328 INFO:tasks.rados.rados.0.smithi154.stdout:296: seq_num 132 ranges {0=671744,671744=573440,1245184=753664,1998848=229376} 2024-09-17T18:16:10.333 INFO:tasks.rados.rados.0.smithi154.stdout:296: writing smithi15432074-30 from 0 to 671744 tid 1 2024-09-17T18:16:10.337 INFO:tasks.rados.rados.0.smithi154.stdout:296: writing smithi15432074-30 from 671744 to 1245184 tid 2 2024-09-17T18:16:10.342 INFO:tasks.rados.rados.0.smithi154.stdout:296: writing smithi15432074-30 from 1245184 to 1998848 tid 3 2024-09-17T18:16:10.344 INFO:tasks.rados.rados.0.smithi154.stdout:296: writing smithi15432074-30 from 1998848 to 2228224 tid 4 2024-09-17T18:16:10.345 INFO:tasks.rados.rados.0.smithi154.stdout:297: setattr oid 48 current snap is 27 2024-09-17T18:16:10.347 INFO:tasks.rados.rados.0.smithi154.stdout:298: snap_remove snap 25 2024-09-17T18:16:10.358 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 14 1 2024-09-17T18:16:10.400 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:10.398+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:10.430 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T18:16:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T18:16:10.430 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:10.445 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T18:16:10.501 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:10.497+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:10.569 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:10.569 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T18:16:10.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T18:16:10.569 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T18:16:10.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.569 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 39/31 ECSubWrite(tid=69, reqid=client.4565.0:269, at_version=39'18, trim_to=0'0, roll_forward_to=36'15))", 2024-09-17T18:16:10.569 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.765975+0000", 2024-09-17T18:16:10.570 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 35.801362404999999, 2024-09-17T18:16:10.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011777833, 2024-09-17T18:16:10.570 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.570 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.570 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.570 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.765975+0000", 2024-09-17T18:16:10.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.765975+0000", 2024-09-17T18:16:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.765977+0000", 2024-09-17T18:16:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1799999999999999e-06 2024-09-17T18:16:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766243+0000", 2024-09-17T18:16:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026578000000000002 2024-09-17T18:16:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766276+0000", 2024-09-17T18:16:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3646000000000003e-05 2024-09-17T18:16:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766299+0000", 2024-09-17T18:16:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2263e-05 2024-09-17T18:16:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766566+0000", 2024-09-17T18:16:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026779100000000003 2024-09-17T18:16:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.766583+0000", 2024-09-17T18:16:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6521999999999999e-05 2024-09-17T18:16:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.777685+0000", 2024-09-17T18:16:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011102231000000001 2024-09-17T18:16:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.777753+0000", 2024-09-17T18:16:10.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7420000000000002e-05 2024-09-17T18:16:10.574 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.574 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.574 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.574 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 42/31 ECSubWrite(tid=88, reqid=client.4565.0:344, at_version=42'22, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:10.574 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:37.771689+0000", 2024-09-17T18:16:10.574 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.795648651999997, 2024-09-17T18:16:10.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012504325, 2024-09-17T18:16:10.574 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.574 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.771689+0000", 2024-09-17T18:16:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.771689+0000", 2024-09-17T18:16:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.771689+0000", 2024-09-17T18:16:10.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4499999999999997e-07 2024-09-17T18:16:10.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.771715+0000", 2024-09-17T18:16:10.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6347999999999999e-05 2024-09-17T18:16:10.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.771728+0000", 2024-09-17T18:16:10.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2277e-05 2024-09-17T18:16:10.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.771737+0000", 2024-09-17T18:16:10.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4239999999999999e-06 2024-09-17T18:16:10.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.776002+0000", 2024-09-17T18:16:10.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042652000000000002 2024-09-17T18:16:10.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.776014+0000", 2024-09-17T18:16:10.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1533e-05 2024-09-17T18:16:10.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.784130+0000", 2024-09-17T18:16:10.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0081161659999999993 2024-09-17T18:16:10.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.784193+0000", 2024-09-17T18:16:10.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2831999999999997e-05 2024-09-17T18:16:10.579 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.579 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.579 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.579 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.3s4 43/31 ECSubWrite(tid=16, reqid=osd.10.0:16, at_version=43'10, trim_to=0'0, roll_forward_to=35'8))", 2024-09-17T18:16:10.579 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.778541+0000", 2024-09-17T18:16:10.579 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 31.788795826000001, 2024-09-17T18:16:10.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013046759, 2024-09-17T18:16:10.579 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.579 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.579 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.580 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778541+0000", 2024-09-17T18:16:10.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778541+0000", 2024-09-17T18:16:10.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778542+0000", 2024-09-17T18:16:10.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1699999999999998e-07 2024-09-17T18:16:10.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778590+0000", 2024-09-17T18:16:10.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8161999999999997e-05 2024-09-17T18:16:10.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778617+0000", 2024-09-17T18:16:10.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6602999999999999e-05 2024-09-17T18:16:10.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778636+0000", 2024-09-17T18:16:10.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9689000000000001e-05 2024-09-17T18:16:10.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779038+0000", 2024-09-17T18:16:10.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00040146700000000002 2024-09-17T18:16:10.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.779063+0000", 2024-09-17T18:16:10.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4822000000000001e-05 2024-09-17T18:16:10.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791491+0000", 2024-09-17T18:16:10.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012428658 2024-09-17T18:16:10.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791588+0000", 2024-09-17T18:16:10.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6741000000000001e-05 2024-09-17T18:16:10.583 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.583 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.583 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.584 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 43/31 ECSubWrite(tid=106, reqid=osd.4.0:104, at_version=0'0, trim_to=0'0, roll_forward_to=43'33))", 2024-09-17T18:16:10.584 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.781180+0000", 2024-09-17T18:16:10.584 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 31.786157551999999, 2024-09-17T18:16:10.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012022855000000001, 2024-09-17T18:16:10.584 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.584 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.584 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.584 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781180+0000", 2024-09-17T18:16:10.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781180+0000", 2024-09-17T18:16:10.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781182+0000", 2024-09-17T18:16:10.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9700000000000002e-06 2024-09-17T18:16:10.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781210+0000", 2024-09-17T18:16:10.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8419e-05 2024-09-17T18:16:10.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781246+0000", 2024-09-17T18:16:10.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5948999999999998e-05 2024-09-17T18:16:10.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781268+0000", 2024-09-17T18:16:10.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1636000000000001e-05 2024-09-17T18:16:10.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781688+0000", 2024-09-17T18:16:10.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00042073000000000002 2024-09-17T18:16:10.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.781712+0000", 2024-09-17T18:16:10.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3963000000000001e-05 2024-09-17T18:16:10.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793132+0000", 2024-09-17T18:16:10.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011419383 2024-09-17T18:16:10.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793203+0000", 2024-09-17T18:16:10.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0804999999999997e-05 2024-09-17T18:16:10.588 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.588 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.588 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.588 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 43/31 ECSubWrite(tid=107, reqid=osd.4.0:107, at_version=43'35, trim_to=0'0, roll_forward_to=43'33))", 2024-09-17T18:16:10.589 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.785298+0000", 2024-09-17T18:16:10.589 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 31.782038879000002, 2024-09-17T18:16:10.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014982244, 2024-09-17T18:16:10.589 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.589 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.589 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.589 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785298+0000", 2024-09-17T18:16:10.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785298+0000", 2024-09-17T18:16:10.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785299+0000", 2024-09-17T18:16:10.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0470000000000001e-06 2024-09-17T18:16:10.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785355+0000", 2024-09-17T18:16:10.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5831999999999997e-05 2024-09-17T18:16:10.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785380+0000", 2024-09-17T18:16:10.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4533e-05 2024-09-17T18:16:10.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.785399+0000", 2024-09-17T18:16:10.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9182e-05 2024-09-17T18:16:10.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791911+0000", 2024-09-17T18:16:10.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065122569999999996 2024-09-17T18:16:10.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.791935+0000", 2024-09-17T18:16:10.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3536e-05 2024-09-17T18:16:10.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.800195+0000", 2024-09-17T18:16:10.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008260323 2024-09-17T18:16:10.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.800281+0000", 2024-09-17T18:16:10.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5533999999999998e-05 2024-09-17T18:16:10.593 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.593 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.593 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.593 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.fs5 43/31 ECSubWrite(tid=186, reqid=osd.13.0:182, at_version=0'0, trim_to=0'0, roll_forward_to=43'14))", 2024-09-17T18:16:10.593 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.789240+0000", 2024-09-17T18:16:10.593 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 31.778097250999998, 2024-09-17T18:16:10.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015813436, 2024-09-17T18:16:10.593 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.593 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.594 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.594 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789240+0000", 2024-09-17T18:16:10.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789240+0000", 2024-09-17T18:16:10.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789242+0000", 2024-09-17T18:16:10.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7099999999999999e-06 2024-09-17T18:16:10.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789265+0000", 2024-09-17T18:16:10.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3512000000000001e-05 2024-09-17T18:16:10.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789308+0000", 2024-09-17T18:16:10.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3306000000000002e-05 2024-09-17T18:16:10.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789332+0000", 2024-09-17T18:16:10.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.321e-05 2024-09-17T18:16:10.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.792912+0000", 2024-09-17T18:16:10.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035800799999999998 2024-09-17T18:16:10.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.792935+0000", 2024-09-17T18:16:10.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3516e-05 2024-09-17T18:16:10.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.804968+0000", 2024-09-17T18:16:10.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012033090999999999 2024-09-17T18:16:10.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.805053+0000", 2024-09-17T18:16:10.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5011000000000003e-05 2024-09-17T18:16:10.597 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.597 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.597 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.598 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.bs4 43/31 ECSubWrite(tid=109, reqid=osd.4.0:109, at_version=43'40, trim_to=0'0, roll_forward_to=43'38))", 2024-09-17T18:16:10.598 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.793281+0000", 2024-09-17T18:16:10.598 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 31.774055841999999, 2024-09-17T18:16:10.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012141458000000001, 2024-09-17T18:16:10.598 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.598 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.598 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.598 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793281+0000", 2024-09-17T18:16:10.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793281+0000", 2024-09-17T18:16:10.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793283+0000", 2024-09-17T18:16:10.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.739e-06 2024-09-17T18:16:10.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793323+0000", 2024-09-17T18:16:10.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0185999999999998e-05 2024-09-17T18:16:10.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793342+0000", 2024-09-17T18:16:10.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9176000000000001e-05 2024-09-17T18:16:10.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793363+0000", 2024-09-17T18:16:10.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0922999999999999e-05 2024-09-17T18:16:10.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793510+0000", 2024-09-17T18:16:10.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014694299999999999 2024-09-17T18:16:10.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793534+0000", 2024-09-17T18:16:10.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3536e-05 2024-09-17T18:16:10.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.805367+0000", 2024-09-17T18:16:10.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011832723 2024-09-17T18:16:10.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.805423+0000", 2024-09-17T18:16:10.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6232e-05 2024-09-17T18:16:10.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.602 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.603 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s3 43/31 ECSubWrite(tid=47, reqid=osd.7.0:47, at_version=43'34, trim_to=0'0, roll_forward_to=42'32))", 2024-09-17T18:16:10.603 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.793292+0000", 2024-09-17T18:16:10.603 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 31.774044849999999, 2024-09-17T18:16:10.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014048638, 2024-09-17T18:16:10.603 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.603 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.603 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.603 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793292+0000", 2024-09-17T18:16:10.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793292+0000", 2024-09-17T18:16:10.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793293+0000", 2024-09-17T18:16:10.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0499999999999999e-06 2024-09-17T18:16:10.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793348+0000", 2024-09-17T18:16:10.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4339000000000003e-05 2024-09-17T18:16:10.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793381+0000", 2024-09-17T18:16:10.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3015999999999997e-05 2024-09-17T18:16:10.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793403+0000", 2024-09-17T18:16:10.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2152999999999999e-05 2024-09-17T18:16:10.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793546+0000", 2024-09-17T18:16:10.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014272300000000001 2024-09-17T18:16:10.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793566+0000", 2024-09-17T18:16:10.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0843e-05 2024-09-17T18:16:10.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.807251+0000", 2024-09-17T18:16:10.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013684775999999999 2024-09-17T18:16:10.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.807341+0000", 2024-09-17T18:16:10.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9738e-05 2024-09-17T18:16:10.607 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.607 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.607 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.608 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.bs4 43/31 ECSubWrite(tid=110, reqid=osd.4.0:110, at_version=43'42, trim_to=0'0, roll_forward_to=43'38))", 2024-09-17T18:16:10.608 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.793414+0000", 2024-09-17T18:16:10.608 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 31.773922796000001, 2024-09-17T18:16:10.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017191942000000002, 2024-09-17T18:16:10.608 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.608 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.608 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.608 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793414+0000", 2024-09-17T18:16:10.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793414+0000", 2024-09-17T18:16:10.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793416+0000", 2024-09-17T18:16:10.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.68e-06 2024-09-17T18:16:10.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793465+0000", 2024-09-17T18:16:10.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8939e-05 2024-09-17T18:16:10.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793487+0000", 2024-09-17T18:16:10.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1959000000000001e-05 2024-09-17T18:16:10.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793506+0000", 2024-09-17T18:16:10.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8643000000000001e-05 2024-09-17T18:16:10.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794384+0000", 2024-09-17T18:16:10.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00087825200000000005 2024-09-17T18:16:10.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794407+0000", 2024-09-17T18:16:10.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3329e-05 2024-09-17T18:16:10.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810507+0000", 2024-09-17T18:16:10.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016100079 2024-09-17T18:16:10.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810606+0000", 2024-09-17T18:16:10.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9061000000000006e-05 2024-09-17T18:16:10.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.612 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.613 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s3 43/31 ECSubWrite(tid=48, reqid=osd.7.0:48, at_version=43'36, trim_to=0'0, roll_forward_to=42'32))", 2024-09-17T18:16:10.613 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.793451+0000", 2024-09-17T18:16:10.613 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 31.773886517000001, 2024-09-17T18:16:10.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016922466000000001, 2024-09-17T18:16:10.613 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.613 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.613 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.613 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793451+0000", 2024-09-17T18:16:10.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793451+0000", 2024-09-17T18:16:10.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793452+0000", 2024-09-17T18:16:10.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1030000000000001e-06 2024-09-17T18:16:10.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793498+0000", 2024-09-17T18:16:10.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6273000000000002e-05 2024-09-17T18:16:10.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793513+0000", 2024-09-17T18:16:10.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5270000000000001e-05 2024-09-17T18:16:10.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793524+0000", 2024-09-17T18:16:10.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1165999999999999e-05 2024-09-17T18:16:10.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.803042+0000", 2024-09-17T18:16:10.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009517111 2024-09-17T18:16:10.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.803071+0000", 2024-09-17T18:16:10.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9223000000000001e-05 2024-09-17T18:16:10.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810283+0000", 2024-09-17T18:16:10.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072125119999999999 2024-09-17T18:16:10.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810373+0000", 2024-09-17T18:16:10.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9808000000000005e-05 2024-09-17T18:16:10.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.617 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.617 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.5s6 43/31 ECSubWrite(tid=46, reqid=osd.5.0:46, at_version=43'12, trim_to=0'0, roll_forward_to=42'10))", 2024-09-17T18:16:10.617 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.793629+0000", 2024-09-17T18:16:10.618 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 31.773707704, 2024-09-17T18:16:10.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015350447999999999, 2024-09-17T18:16:10.618 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.618 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.618 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.618 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793629+0000", 2024-09-17T18:16:10.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793629+0000", 2024-09-17T18:16:10.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793630+0000", 2024-09-17T18:16:10.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4600000000000004e-07 2024-09-17T18:16:10.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793671+0000", 2024-09-17T18:16:10.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1146000000000002e-05 2024-09-17T18:16:10.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793695+0000", 2024-09-17T18:16:10.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4015999999999998e-05 2024-09-17T18:16:10.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793713+0000", 2024-09-17T18:16:10.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8076000000000001e-05 2024-09-17T18:16:10.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793976+0000", 2024-09-17T18:16:10.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026206999999999999 2024-09-17T18:16:10.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794001+0000", 2024-09-17T18:16:10.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5709000000000001e-05 2024-09-17T18:16:10.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.808902+0000", 2024-09-17T18:16:10.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014900943 2024-09-17T18:16:10.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.808980+0000", 2024-09-17T18:16:10.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7742000000000002e-05 2024-09-17T18:16:10.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.622 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.622 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 43/31 ECSubWrite(tid=187, reqid=client.4565.0:365, at_version=43'83, trim_to=0'0, roll_forward_to=43'79))", 2024-09-17T18:16:10.622 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.796751+0000", 2024-09-17T18:16:10.622 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 31.770585842999999, 2024-09-17T18:16:10.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012299391999999999, 2024-09-17T18:16:10.622 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.622 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.623 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.623 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796751+0000", 2024-09-17T18:16:10.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796751+0000", 2024-09-17T18:16:10.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.796753+0000", 2024-09-17T18:16:10.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0329999999999998e-06 2024-09-17T18:16:10.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797011+0000", 2024-09-17T18:16:10.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025788699999999999 2024-09-17T18:16:10.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797057+0000", 2024-09-17T18:16:10.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5323e-05 2024-09-17T18:16:10.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797080+0000", 2024-09-17T18:16:10.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3642000000000002e-05 2024-09-17T18:16:10.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797329+0000", 2024-09-17T18:16:10.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024893099999999998 2024-09-17T18:16:10.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797355+0000", 2024-09-17T18:16:10.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5612000000000001e-05 2024-09-17T18:16:10.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.808990+0000", 2024-09-17T18:16:10.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011635184999999999 2024-09-17T18:16:10.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809051+0000", 2024-09-17T18:16:10.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0779000000000002e-05 2024-09-17T18:16:10.626 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.626 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.626 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.627 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 43/31 ECSubWrite(tid=191, reqid=osd.13.0:191, at_version=43'87, trim_to=0'0, roll_forward_to=43'81))", 2024-09-17T18:16:10.627 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.809245+0000", 2024-09-17T18:16:10.627 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 31.758091866000001, 2024-09-17T18:16:10.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011584789999999999, 2024-09-17T18:16:10.627 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.627 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.627 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.627 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809245+0000", 2024-09-17T18:16:10.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809245+0000", 2024-09-17T18:16:10.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809247+0000", 2024-09-17T18:16:10.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.683e-06 2024-09-17T18:16:10.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809301+0000", 2024-09-17T18:16:10.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3764999999999998e-05 2024-09-17T18:16:10.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809331+0000", 2024-09-17T18:16:10.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9926000000000001e-05 2024-09-17T18:16:10.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809352+0000", 2024-09-17T18:16:10.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1633000000000001e-05 2024-09-17T18:16:10.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809580+0000", 2024-09-17T18:16:10.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022755099999999999 2024-09-17T18:16:10.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809604+0000", 2024-09-17T18:16:10.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3923000000000001e-05 2024-09-17T18:16:10.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.820715+0000", 2024-09-17T18:16:10.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011110943 2024-09-17T18:16:10.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.820830+0000", 2024-09-17T18:16:10.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011536600000000001 2024-09-17T18:16:10.631 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.631 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.631 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.631 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.3s4 54/31 ECSubWrite(tid=24, reqid=osd.10.0:24, at_version=54'17, trim_to=0'0, roll_forward_to=53'15))", 2024-09-17T18:16:10.631 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.328697+0000", 2024-09-17T18:16:10.631 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.238640651000001, 2024-09-17T18:16:10.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012777594, 2024-09-17T18:16:10.632 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.632 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.632 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.632 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328697+0000", 2024-09-17T18:16:10.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328697+0000", 2024-09-17T18:16:10.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328698+0000", 2024-09-17T18:16:10.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0839999999999999e-06 2024-09-17T18:16:10.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328756+0000", 2024-09-17T18:16:10.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8205000000000003e-05 2024-09-17T18:16:10.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328784+0000", 2024-09-17T18:16:10.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7858999999999999e-05 2024-09-17T18:16:10.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328806+0000", 2024-09-17T18:16:10.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2283e-05 2024-09-17T18:16:10.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328969+0000", 2024-09-17T18:16:10.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016340199999999999 2024-09-17T18:16:10.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328994+0000", 2024-09-17T18:16:10.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4936e-05 2024-09-17T18:16:10.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341350+0000", 2024-09-17T18:16:10.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012355484 2024-09-17T18:16:10.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341474+0000", 2024-09-17T18:16:10.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012434100000000001 2024-09-17T18:16:10.636 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.636 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.636 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.636 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 54/31 ECSubWrite(tid=281, reqid=osd.13.0:281, at_version=54'136, trim_to=0'0, roll_forward_to=53'132))", 2024-09-17T18:16:10.636 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.328882+0000", 2024-09-17T18:16:10.636 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.238455116000001, 2024-09-17T18:16:10.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012618901, 2024-09-17T18:16:10.636 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.636 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.636 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.636 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328882+0000", 2024-09-17T18:16:10.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328882+0000", 2024-09-17T18:16:10.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328883+0000", 2024-09-17T18:16:10.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3239999999999999e-06 2024-09-17T18:16:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328928+0000", 2024-09-17T18:16:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4864999999999998e-05 2024-09-17T18:16:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328951+0000", 2024-09-17T18:16:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2512999999999999e-05 2024-09-17T18:16:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328969+0000", 2024-09-17T18:16:10.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8185999999999998e-05 2024-09-17T18:16:10.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329160+0000", 2024-09-17T18:16:10.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000190815 2024-09-17T18:16:10.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329186+0000", 2024-09-17T18:16:10.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6630000000000001e-05 2024-09-17T18:16:10.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341402+0000", 2024-09-17T18:16:10.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012215561 2024-09-17T18:16:10.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341501+0000", 2024-09-17T18:16:10.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9006999999999996e-05 2024-09-17T18:16:10.640 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.640 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.640 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.641 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 54/31 ECSubWrite(tid=147, reqid=osd.4.0:147, at_version=54'50, trim_to=0'0, roll_forward_to=53'48))", 2024-09-17T18:16:10.641 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.329157+0000", 2024-09-17T18:16:10.641 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.238180656000001, 2024-09-17T18:16:10.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012598588000000001, 2024-09-17T18:16:10.641 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.641 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.641 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.641 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329157+0000", 2024-09-17T18:16:10.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329157+0000", 2024-09-17T18:16:10.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329159+0000", 2024-09-17T18:16:10.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9999999999999999e-06 2024-09-17T18:16:10.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329209+0000", 2024-09-17T18:16:10.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0071999999999998e-05 2024-09-17T18:16:10.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329238+0000", 2024-09-17T18:16:10.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.906e-05 2024-09-17T18:16:10.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329260+0000", 2024-09-17T18:16:10.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2008999999999999e-05 2024-09-17T18:16:10.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329413+0000", 2024-09-17T18:16:10.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153516 2024-09-17T18:16:10.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.329435+0000", 2024-09-17T18:16:10.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2201999999999999e-05 2024-09-17T18:16:10.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341674+0000", 2024-09-17T18:16:10.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012239053999999999 2024-09-17T18:16:10.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.341755+0000", 2024-09-17T18:16:10.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0674999999999996e-05 2024-09-17T18:16:10.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.645 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.645 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s2 54/31 ECSubWrite(tid=146, reqid=client.4565.0:510, at_version=54'29, trim_to=0'0, roll_forward_to=53'28))", 2024-09-17T18:16:10.645 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.332335+0000", 2024-09-17T18:16:10.645 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.235002672, 2024-09-17T18:16:10.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011839348, 2024-09-17T18:16:10.645 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.646 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.646 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.646 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332335+0000", 2024-09-17T18:16:10.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332335+0000", 2024-09-17T18:16:10.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332340+0000", 2024-09-17T18:16:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.434e-06 2024-09-17T18:16:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332464+0000", 2024-09-17T18:16:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012394700000000001 2024-09-17T18:16:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332490+0000", 2024-09-17T18:16:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5809e-05 2024-09-17T18:16:10.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332512+0000", 2024-09-17T18:16:10.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2065999999999998e-05 2024-09-17T18:16:10.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332916+0000", 2024-09-17T18:16:10.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00040443199999999998 2024-09-17T18:16:10.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.332938+0000", 2024-09-17T18:16:10.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1574e-05 2024-09-17T18:16:10.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.344137+0000", 2024-09-17T18:16:10.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011198852 2024-09-17T18:16:10.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.344174+0000", 2024-09-17T18:16:10.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7234000000000003e-05 2024-09-17T18:16:10.649 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.650 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.650 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.650 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 54/31 ECSubWrite(tid=287, reqid=osd.13.0:287, at_version=54'140, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:16:10.650 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.346195+0000", 2024-09-17T18:16:10.650 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.221141811999999, 2024-09-17T18:16:10.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012184449999999999, 2024-09-17T18:16:10.652 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.652 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.652 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.652 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346195+0000", 2024-09-17T18:16:10.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346195+0000", 2024-09-17T18:16:10.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346197+0000", 2024-09-17T18:16:10.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.486e-06 2024-09-17T18:16:10.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346253+0000", 2024-09-17T18:16:10.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5942000000000001e-05 2024-09-17T18:16:10.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346283+0000", 2024-09-17T18:16:10.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9796000000000001e-05 2024-09-17T18:16:10.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346303+0000", 2024-09-17T18:16:10.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0112999999999999e-05 2024-09-17T18:16:10.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.347083+0000", 2024-09-17T18:16:10.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00078017099999999997 2024-09-17T18:16:10.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.347095+0000", 2024-09-17T18:16:10.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1640999999999999e-05 2024-09-17T18:16:10.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.358346+0000", 2024-09-17T18:16:10.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011251116 2024-09-17T18:16:10.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.358380+0000", 2024-09-17T18:16:10.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4184999999999999e-05 2024-09-17T18:16:10.656 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.656 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.656 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.656 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 65/31 ECSubWrite(tid=210, reqid=osd.4.0:210, at_version=65'82, trim_to=0'0, roll_forward_to=62'78))", 2024-09-17T18:16:10.656 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:00.333413+0000", 2024-09-17T18:16:10.656 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 10.233923923000001, 2024-09-17T18:16:10.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013507813, 2024-09-17T18:16:10.656 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.656 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.656 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.656 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.333413+0000", 2024-09-17T18:16:10.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.333413+0000", 2024-09-17T18:16:10.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.333415+0000", 2024-09-17T18:16:10.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.804e-06 2024-09-17T18:16:10.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.333465+0000", 2024-09-17T18:16:10.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0138e-05 2024-09-17T18:16:10.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.333505+0000", 2024-09-17T18:16:10.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9988999999999999e-05 2024-09-17T18:16:10.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.333529+0000", 2024-09-17T18:16:10.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4187000000000001e-05 2024-09-17T18:16:10.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.336945+0000", 2024-09-17T18:16:10.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034154369999999999 2024-09-17T18:16:10.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.336972+0000", 2024-09-17T18:16:10.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6897e-05 2024-09-17T18:16:10.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.346826+0000", 2024-09-17T18:16:10.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098545590000000006 2024-09-17T18:16:10.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:00.346921+0000", 2024-09-17T18:16:10.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4802000000000005e-05 2024-09-17T18:16:10.660 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.660 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.660 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.661 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.5s6 71/31 ECSubWrite(tid=128, reqid=client.4565.0:709, at_version=71'38, trim_to=0'0, roll_forward_to=68'36))", 2024-09-17T18:16:10.661 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.601959+0000", 2024-09-17T18:16:10.661 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.9653782020000001, 2024-09-17T18:16:10.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014015641000000001, 2024-09-17T18:16:10.661 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:10.661 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:10.661 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:10.661 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:10.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:10.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.601959+0000", 2024-09-17T18:16:10.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:10.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.601959+0000", 2024-09-17T18:16:10.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:10.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:10.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.601960+0000", 2024-09-17T18:16:10.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7300000000000005e-07 2024-09-17T18:16:10.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:10.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.606128+0000", 2024-09-17T18:16:10.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041685469999999999 2024-09-17T18:16:10.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:10.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.606165+0000", 2024-09-17T18:16:10.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6782999999999997e-05 2024-09-17T18:16:10.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:10.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.606190+0000", 2024-09-17T18:16:10.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4666000000000001e-05 2024-09-17T18:16:10.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:10.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.607607+0000", 2024-09-17T18:16:10.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001417026 2024-09-17T18:16:10.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:10.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.607627+0000", 2024-09-17T18:16:10.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0216000000000001e-05 2024-09-17T18:16:10.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:10.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.615421+0000", 2024-09-17T18:16:10.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0077938950000000003 2024-09-17T18:16:10.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:10.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:10.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:10.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.615975+0000", 2024-09-17T18:16:10.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055373499999999997 2024-09-17T18:16:10.665 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.665 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.665 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.665 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:10.665 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:10.665 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:10.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T18:16:10.667 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:10.661+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:10.768 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:10.765+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:10.794 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:10.794 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:10.794 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T18:16:10.794 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:10.809 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T18:16:10.869 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:10.866+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:10.932 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T18:16:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T18:16:10.932 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:10.946 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T18:16:10.970 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:10.965+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:11.070 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:11.070 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T18:16:11.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T18:16:11.070 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T18:16:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:90 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'64, mlcod=24'60)", 2024-09-17T18:16:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.281166+0000", 2024-09-17T18:16:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.784703337000003, 2024-09-17T18:16:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095065170000000008, 2024-09-17T18:16:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281166+0000", 2024-09-17T18:16:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281166+0000", 2024-09-17T18:16:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281167+0000", 2024-09-17T18:16:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0899999999999999e-06 2024-09-17T18:16:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281237+0000", 2024-09-17T18:16:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9974999999999993e-05 2024-09-17T18:16:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281258+0000", 2024-09-17T18:16:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0948999999999999e-05 2024-09-17T18:16:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281273+0000", 2024-09-17T18:16:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4844000000000001e-05 2024-09-17T18:16:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281378+0000", 2024-09-17T18:16:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104987 2024-09-17T18:16:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281407+0000", 2024-09-17T18:16:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8841999999999999e-05 2024-09-17T18:16:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290614+0000", 2024-09-17T18:16:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092069390000000008 2024-09-17T18:16:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290672+0000", 2024-09-17T18:16:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8891000000000002e-05 2024-09-17T18:16:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:91 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'65, mlcod=24'60)", 2024-09-17T18:16:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.281625+0000", 2024-09-17T18:16:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.784244712000003, 2024-09-17T18:16:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090883079999999998, 2024-09-17T18:16:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281625+0000", 2024-09-17T18:16:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281625+0000", 2024-09-17T18:16:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281626+0000", 2024-09-17T18:16:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.184e-06 2024-09-17T18:16:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281637+0000", 2024-09-17T18:16:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1153e-05 2024-09-17T18:16:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281657+0000", 2024-09-17T18:16:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0446e-05 2024-09-17T18:16:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.281673+0000", 2024-09-17T18:16:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6042999999999999e-05 2024-09-17T18:16:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284250+0000", 2024-09-17T18:16:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002576212 2024-09-17T18:16:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284279+0000", 2024-09-17T18:16:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9788999999999999e-05 2024-09-17T18:16:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290678+0000", 2024-09-17T18:16:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006399035 2024-09-17T18:16:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290713+0000", 2024-09-17T18:16:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4446000000000002e-05 2024-09-17T18:16:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:92 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'66, mlcod=24'60)", 2024-09-17T18:16:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.282093+0000", 2024-09-17T18:16:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.783776099999997, 2024-09-17T18:16:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086526520000000003, 2024-09-17T18:16:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282093+0000", 2024-09-17T18:16:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282093+0000", 2024-09-17T18:16:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282094+0000", 2024-09-17T18:16:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7300000000000004e-07 2024-09-17T18:16:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282102+0000", 2024-09-17T18:16:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9869999999999999e-06 2024-09-17T18:16:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282120+0000", 2024-09-17T18:16:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7753000000000001e-05 2024-09-17T18:16:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.282135+0000", 2024-09-17T18:16:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5216e-05 2024-09-17T18:16:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284810+0000", 2024-09-17T18:16:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026748789999999998 2024-09-17T18:16:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284862+0000", 2024-09-17T18:16:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1668000000000001e-05 2024-09-17T18:16:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290715+0000", 2024-09-17T18:16:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058529369999999999 2024-09-17T18:16:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.290746+0000", 2024-09-17T18:16:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1238999999999997e-05 2024-09-17T18:16:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:95 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'69, mlcod=24'60)", 2024-09-17T18:16:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.283758+0000", 2024-09-17T18:16:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.782111569000001, 2024-09-17T18:16:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090648919999999997, 2024-09-17T18:16:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283758+0000", 2024-09-17T18:16:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283758+0000", 2024-09-17T18:16:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283760+0000", 2024-09-17T18:16:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9599999999999999e-06 2024-09-17T18:16:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283771+0000", 2024-09-17T18:16:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1487e-05 2024-09-17T18:16:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283800+0000", 2024-09-17T18:16:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9164999999999999e-05 2024-09-17T18:16:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.283818+0000", 2024-09-17T18:16:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8067000000000002e-05 2024-09-17T18:16:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286791+0000", 2024-09-17T18:16:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029726010000000001 2024-09-17T18:16:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.286832+0000", 2024-09-17T18:16:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0723000000000003e-05 2024-09-17T18:16:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292715+0000", 2024-09-17T18:16:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058835650000000003 2024-09-17T18:16:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292823+0000", 2024-09-17T18:16:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000107324 2024-09-17T18:16:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4257.0:96 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'70, mlcod=24'60)", 2024-09-17T18:16:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:14.284198+0000", 2024-09-17T18:16:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.781671326999998, 2024-09-17T18:16:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086761919999999992, 2024-09-17T18:16:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284198+0000", 2024-09-17T18:16:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284198+0000", 2024-09-17T18:16:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284205+0000", 2024-09-17T18:16:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7039999999999997e-06 2024-09-17T18:16:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284273+0000", 2024-09-17T18:16:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8454000000000006e-05 2024-09-17T18:16:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284297+0000", 2024-09-17T18:16:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3847000000000001e-05 2024-09-17T18:16:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.284310+0000", 2024-09-17T18:16:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2826000000000001e-05 2024-09-17T18:16:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.287308+0000", 2024-09-17T18:16:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029979109999999998 2024-09-17T18:16:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.287336+0000", 2024-09-17T18:16:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8073e-05 2024-09-17T18:16:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292826+0000", 2024-09-17T18:16:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054905249999999996 2024-09-17T18:16:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:14.292874+0000", 2024-09-17T18:16:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7852000000000002e-05 2024-09-17T18:16:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 39/31 ECSubWrite(tid=113, reqid=client.4565.0:283, at_version=0'0, trim_to=0'0, roll_forward_to=39'42))", 2024-09-17T18:16:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:34.784542+0000", 2024-09-17T18:16:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.281327101999999, 2024-09-17T18:16:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084139260000000004, 2024-09-17T18:16:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784542+0000", 2024-09-17T18:16:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784542+0000", 2024-09-17T18:16:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784545+0000", 2024-09-17T18:16:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0340000000000001e-06 2024-09-17T18:16:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784583+0000", 2024-09-17T18:16:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7394999999999997e-05 2024-09-17T18:16:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784763+0000", 2024-09-17T18:16:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018085599999999999 2024-09-17T18:16:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.784791+0000", 2024-09-17T18:16:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7152999999999999e-05 2024-09-17T18:16:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785281+0000", 2024-09-17T18:16:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049054100000000005 2024-09-17T18:16:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.785602+0000", 2024-09-17T18:16:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032048500000000002 2024-09-17T18:16:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.792898+0000", 2024-09-17T18:16:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072960669999999998 2024-09-17T18:16:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:34.792956+0000", 2024-09-17T18:16:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8394999999999999e-05 2024-09-17T18:16:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 43/31 ECSubWrite(tid=184, reqid=osd.13.0:184, at_version=43'81, trim_to=0'0, roll_forward_to=42'77))", 2024-09-17T18:16:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.777979+0000", 2024-09-17T18:16:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.287890591999997, 2024-09-17T18:16:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011903690999999999, 2024-09-17T18:16:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777979+0000", 2024-09-17T18:16:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777979+0000", 2024-09-17T18:16:11.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.777981+0000", 2024-09-17T18:16:11.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9230000000000001e-06 2024-09-17T18:16:11.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778028+0000", 2024-09-17T18:16:11.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7624999999999999e-05 2024-09-17T18:16:11.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778061+0000", 2024-09-17T18:16:11.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2329000000000002e-05 2024-09-17T18:16:11.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778084+0000", 2024-09-17T18:16:11.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3597000000000001e-05 2024-09-17T18:16:11.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778224+0000", 2024-09-17T18:16:11.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000139596 2024-09-17T18:16:11.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.778247+0000", 2024-09-17T18:16:11.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3456e-05 2024-09-17T18:16:11.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789790+0000", 2024-09-17T18:16:11.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011542943999999999 2024-09-17T18:16:11.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789882+0000", 2024-09-17T18:16:11.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2220999999999997e-05 2024-09-17T18:16:11.112 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.112 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.112 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.112 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 43/31 ECSubWrite(tid=187, reqid=client.4565.0:365, at_version=43'83, trim_to=0'0, roll_forward_to=43'79))", 2024-09-17T18:16:11.112 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.797287+0000", 2024-09-17T18:16:11.113 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.2685824, 2024-09-17T18:16:11.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011900196, 2024-09-17T18:16:11.113 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.113 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.113 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.113 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797287+0000", 2024-09-17T18:16:11.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797287+0000", 2024-09-17T18:16:11.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797289+0000", 2024-09-17T18:16:11.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1100000000000001e-06 2024-09-17T18:16:11.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797415+0000", 2024-09-17T18:16:11.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012599 2024-09-17T18:16:11.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797448+0000", 2024-09-17T18:16:11.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2866e-05 2024-09-17T18:16:11.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797470+0000", 2024-09-17T18:16:11.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1722e-05 2024-09-17T18:16:11.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797684+0000", 2024-09-17T18:16:11.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021480800000000001 2024-09-17T18:16:11.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.797708+0000", 2024-09-17T18:16:11.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4063e-05 2024-09-17T18:16:11.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809114+0000", 2024-09-17T18:16:11.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011405279000000001 2024-09-17T18:16:11.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809187+0000", 2024-09-17T18:16:11.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3357999999999998e-05 2024-09-17T18:16:11.117 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.117 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.117 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.118 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 43/31 ECSubWrite(tid=191, reqid=osd.13.0:191, at_version=43'87, trim_to=0'0, roll_forward_to=43'81))", 2024-09-17T18:16:11.118 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.809389+0000", 2024-09-17T18:16:11.118 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.256479880999997, 2024-09-17T18:16:11.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082897890000000005, 2024-09-17T18:16:11.118 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.118 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.118 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.118 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809389+0000", 2024-09-17T18:16:11.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809389+0000", 2024-09-17T18:16:11.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809391+0000", 2024-09-17T18:16:11.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7570000000000001e-06 2024-09-17T18:16:11.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809469+0000", 2024-09-17T18:16:11.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8164000000000006e-05 2024-09-17T18:16:11.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809527+0000", 2024-09-17T18:16:11.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7843000000000002e-05 2024-09-17T18:16:11.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809549+0000", 2024-09-17T18:16:11.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1951999999999999e-05 2024-09-17T18:16:11.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809765+0000", 2024-09-17T18:16:11.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021605800000000001 2024-09-17T18:16:11.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.809796+0000", 2024-09-17T18:16:11.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0565000000000003e-05 2024-09-17T18:16:11.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.817599+0000", 2024-09-17T18:16:11.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0078028849999999999 2024-09-17T18:16:11.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.817679+0000", 2024-09-17T18:16:11.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0564999999999999e-05 2024-09-17T18:16:11.122 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.122 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.122 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.123 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.as5 54/31 ECSubWrite(tid=278, reqid=client.4565.0:503, at_version=54'72, trim_to=0'0, roll_forward_to=52'68))", 2024-09-17T18:16:11.123 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.319767+0000", 2024-09-17T18:16:11.123 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.746102641, 2024-09-17T18:16:11.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092036860000000009, 2024-09-17T18:16:11.123 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.123 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.123 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.123 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319767+0000", 2024-09-17T18:16:11.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319767+0000", 2024-09-17T18:16:11.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319769+0000", 2024-09-17T18:16:11.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9970000000000001e-06 2024-09-17T18:16:11.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319816+0000", 2024-09-17T18:16:11.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7802000000000001e-05 2024-09-17T18:16:11.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319850+0000", 2024-09-17T18:16:11.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3958999999999998e-05 2024-09-17T18:16:11.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.319873+0000", 2024-09-17T18:16:11.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2133e-05 2024-09-17T18:16:11.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.323357+0000", 2024-09-17T18:16:11.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003484872 2024-09-17T18:16:11.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.323384+0000", 2024-09-17T18:16:11.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7067999999999999e-05 2024-09-17T18:16:11.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328876+0000", 2024-09-17T18:16:11.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054916069999999999 2024-09-17T18:16:11.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.328970+0000", 2024-09-17T18:16:11.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4247999999999996e-05 2024-09-17T18:16:11.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.128 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.128 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s4 54/31 ECSubWrite(tid=147, reqid=osd.6.0:147, at_version=54'31, trim_to=0'0, roll_forward_to=53'28))", 2024-09-17T18:16:11.128 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.339770+0000", 2024-09-17T18:16:11.128 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.726099368, 2024-09-17T18:16:11.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020146240999999999, 2024-09-17T18:16:11.129 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.129 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.129 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.129 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339770+0000", 2024-09-17T18:16:11.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339770+0000", 2024-09-17T18:16:11.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339772+0000", 2024-09-17T18:16:11.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4200000000000001e-06 2024-09-17T18:16:11.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339846+0000", 2024-09-17T18:16:11.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3957999999999999e-05 2024-09-17T18:16:11.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339891+0000", 2024-09-17T18:16:11.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5132000000000001e-05 2024-09-17T18:16:11.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.339916+0000", 2024-09-17T18:16:11.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4542e-05 2024-09-17T18:16:11.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.340222+0000", 2024-09-17T18:16:11.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030566300000000002 2024-09-17T18:16:11.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.340249+0000", 2024-09-17T18:16:11.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6996e-05 2024-09-17T18:16:11.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.359838+0000", 2024-09-17T18:16:11.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019589558 2024-09-17T18:16:11.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.359916+0000", 2024-09-17T18:16:11.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7972000000000005e-05 2024-09-17T18:16:11.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.133 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.133 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 54/31 ECSubWrite(tid=285, reqid=osd.13.0:281, at_version=0'0, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:16:11.133 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.342575+0000", 2024-09-17T18:16:11.134 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.723294715000002, 2024-09-17T18:16:11.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019330185, 2024-09-17T18:16:11.134 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.134 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.134 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.134 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342575+0000", 2024-09-17T18:16:11.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342575+0000", 2024-09-17T18:16:11.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342576+0000", 2024-09-17T18:16:11.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8160000000000001e-06 2024-09-17T18:16:11.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342605+0000", 2024-09-17T18:16:11.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8683e-05 2024-09-17T18:16:11.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342639+0000", 2024-09-17T18:16:11.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4279000000000002e-05 2024-09-17T18:16:11.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342663+0000", 2024-09-17T18:16:11.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3672e-05 2024-09-17T18:16:11.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342819+0000", 2024-09-17T18:16:11.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015606300000000001 2024-09-17T18:16:11.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.342843+0000", 2024-09-17T18:16:11.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3643e-05 2024-09-17T18:16:11.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.361867+0000", 2024-09-17T18:16:11.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019024627999999998 2024-09-17T18:16:11.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.361905+0000", 2024-09-17T18:16:11.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7401000000000003e-05 2024-09-17T18:16:11.138 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.138 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.138 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.138 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s4 54/31 ECSubWrite(tid=148, reqid=client.4565.0:511, at_version=54'32, trim_to=0'0, roll_forward_to=53'28))", 2024-09-17T18:16:11.138 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.344921+0000", 2024-09-17T18:16:11.138 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.720948593999999, 2024-09-17T18:16:11.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015237298, 2024-09-17T18:16:11.138 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.138 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.139 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.139 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.344921+0000", 2024-09-17T18:16:11.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.344921+0000", 2024-09-17T18:16:11.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.344922+0000", 2024-09-17T18:16:11.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.773e-06 2024-09-17T18:16:11.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345818+0000", 2024-09-17T18:16:11.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000895457 2024-09-17T18:16:11.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345844+0000", 2024-09-17T18:16:11.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5653e-05 2024-09-17T18:16:11.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345862+0000", 2024-09-17T18:16:11.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8159999999999999e-05 2024-09-17T18:16:11.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346476+0000", 2024-09-17T18:16:11.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00061441800000000004 2024-09-17T18:16:11.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.346503+0000", 2024-09-17T18:16:11.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6395999999999999e-05 2024-09-17T18:16:11.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.360103+0000", 2024-09-17T18:16:11.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013600259999999999 2024-09-17T18:16:11.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.360158+0000", 2024-09-17T18:16:11.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5180999999999999e-05 2024-09-17T18:16:11.143 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.143 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.143 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.143 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 54/31 ECSubWrite(tid=286, reqid=osd.13.0:286, at_version=54'138, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:16:11.143 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.345075+0000", 2024-09-17T18:16:11.143 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.720794094999999, 2024-09-17T18:16:11.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020430077000000001, 2024-09-17T18:16:11.143 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.143 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.143 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.144 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345075+0000", 2024-09-17T18:16:11.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345075+0000", 2024-09-17T18:16:11.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345077+0000", 2024-09-17T18:16:11.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3570000000000001e-06 2024-09-17T18:16:11.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345167+0000", 2024-09-17T18:16:11.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0760999999999994e-05 2024-09-17T18:16:11.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345213+0000", 2024-09-17T18:16:11.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5595e-05 2024-09-17T18:16:11.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345235+0000", 2024-09-17T18:16:11.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2416999999999999e-05 2024-09-17T18:16:11.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345649+0000", 2024-09-17T18:16:11.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041404899999999999 2024-09-17T18:16:11.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345674+0000", 2024-09-17T18:16:11.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4746e-05 2024-09-17T18:16:11.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.365456+0000", 2024-09-17T18:16:11.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019782401000000002 2024-09-17T18:16:11.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.365505+0000", 2024-09-17T18:16:11.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8751000000000001e-05 2024-09-17T18:16:11.147 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.148 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.148 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.148 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.as5 54/31 ECSubWrite(tid=284, reqid=osd.13.0:284, at_version=54'79, trim_to=0'0, roll_forward_to=54'77))", 2024-09-17T18:16:11.148 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.345312+0000", 2024-09-17T18:16:11.148 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.720557470999999, 2024-09-17T18:16:11.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018630066000000001, 2024-09-17T18:16:11.148 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.148 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.148 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.148 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345312+0000", 2024-09-17T18:16:11.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345312+0000", 2024-09-17T18:16:11.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345313+0000", 2024-09-17T18:16:11.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4300000000000001e-06 2024-09-17T18:16:11.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345375+0000", 2024-09-17T18:16:11.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1838e-05 2024-09-17T18:16:11.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345402+0000", 2024-09-17T18:16:11.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7022999999999999e-05 2024-09-17T18:16:11.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345423+0000", 2024-09-17T18:16:11.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0426000000000001e-05 2024-09-17T18:16:11.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345535+0000", 2024-09-17T18:16:11.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112342 2024-09-17T18:16:11.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345549+0000", 2024-09-17T18:16:11.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3961000000000001e-05 2024-09-17T18:16:11.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.363902+0000", 2024-09-17T18:16:11.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018353103999999999 2024-09-17T18:16:11.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.363942+0000", 2024-09-17T18:16:11.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9941999999999998e-05 2024-09-17T18:16:11.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.152 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.153 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 54/31 ECSubWrite(tid=287, reqid=osd.13.0:287, at_version=54'140, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:16:11.153 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.345481+0000", 2024-09-17T18:16:11.153 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.720388695, 2024-09-17T18:16:11.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020077805000000001, 2024-09-17T18:16:11.153 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.153 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.153 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.153 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345481+0000", 2024-09-17T18:16:11.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345481+0000", 2024-09-17T18:16:11.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345482+0000", 2024-09-17T18:16:11.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7000000000000003e-07 2024-09-17T18:16:11.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345555+0000", 2024-09-17T18:16:11.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3407999999999999e-05 2024-09-17T18:16:11.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345577+0000", 2024-09-17T18:16:11.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2255999999999998e-05 2024-09-17T18:16:11.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.345595+0000", 2024-09-17T18:16:11.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7957000000000001e-05 2024-09-17T18:16:11.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.358768+0000", 2024-09-17T18:16:11.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013172690000000001 2024-09-17T18:16:11.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.358795+0000", 2024-09-17T18:16:11.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7268999999999999e-05 2024-09-17T18:16:11.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.365526+0000", 2024-09-17T18:16:11.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0067310099999999999 2024-09-17T18:16:11.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.365558+0000", 2024-09-17T18:16:11.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2245e-05 2024-09-17T18:16:11.157 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.157 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.157 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.157 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.6s6 54/31 ECSubWrite(tid=49, reqid=osd.0.0:48, at_version=0'0, trim_to=0'0, roll_forward_to=54'34))", 2024-09-17T18:16:11.158 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.351224+0000", 2024-09-17T18:16:11.158 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.714645182000002, 2024-09-17T18:16:11.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088463369999999993, 2024-09-17T18:16:11.158 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.158 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.158 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.158 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351224+0000", 2024-09-17T18:16:11.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351224+0000", 2024-09-17T18:16:11.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351226+0000", 2024-09-17T18:16:11.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3769999999999999e-06 2024-09-17T18:16:11.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351255+0000", 2024-09-17T18:16:11.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8138999999999999e-05 2024-09-17T18:16:11.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351297+0000", 2024-09-17T18:16:11.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2611999999999998e-05 2024-09-17T18:16:11.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351324+0000", 2024-09-17T18:16:11.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6463000000000001e-05 2024-09-17T18:16:11.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351493+0000", 2024-09-17T18:16:11.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169226 2024-09-17T18:16:11.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.351519+0000", 2024-09-17T18:16:11.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6023000000000001e-05 2024-09-17T18:16:11.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.360000+0000", 2024-09-17T18:16:11.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084808360000000003 2024-09-17T18:16:11.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.360070+0000", 2024-09-17T18:16:11.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0661000000000007e-05 2024-09-17T18:16:11.162 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.162 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.162 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.162 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s4 54/31 ECSubWrite(tid=149, reqid=client.4565.0:512, at_version=54'33, trim_to=0'0, roll_forward_to=54'29))", 2024-09-17T18:16:11.162 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.352853+0000", 2024-09-17T18:16:11.162 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.713016508999999, 2024-09-17T18:16:11.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011039973999999999, 2024-09-17T18:16:11.163 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.163 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.163 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.163 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.352853+0000", 2024-09-17T18:16:11.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.352853+0000", 2024-09-17T18:16:11.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.352855+0000", 2024-09-17T18:16:11.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.046e-06 2024-09-17T18:16:11.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.353203+0000", 2024-09-17T18:16:11.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034835200000000001 2024-09-17T18:16:11.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.353236+0000", 2024-09-17T18:16:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2699e-05 2024-09-17T18:16:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.353259+0000", 2024-09-17T18:16:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3091999999999998e-05 2024-09-17T18:16:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.354551+0000", 2024-09-17T18:16:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0012925219999999999 2024-09-17T18:16:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.354578+0000", 2024-09-17T18:16:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6122000000000002e-05 2024-09-17T18:16:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.363806+0000", 2024-09-17T18:16:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092280060000000004 2024-09-17T18:16:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.363893+0000", 2024-09-17T18:16:11.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7134999999999998e-05 2024-09-17T18:16:11.167 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.167 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.167 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.167 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 54/31 ECSubWrite(tid=288, reqid=client.4565.0:517, at_version=54'142, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:16:11.167 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.355522+0000", 2024-09-17T18:16:11.167 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.710346827999999, 2024-09-17T18:16:11.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014893826000000001, 2024-09-17T18:16:11.167 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.167 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.168 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.168 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.355522+0000", 2024-09-17T18:16:11.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.355522+0000", 2024-09-17T18:16:11.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.355525+0000", 2024-09-17T18:16:11.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1720000000000001e-06 2024-09-17T18:16:11.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.355716+0000", 2024-09-17T18:16:11.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019125199999999999 2024-09-17T18:16:11.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.355743+0000", 2024-09-17T18:16:11.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7625000000000001e-05 2024-09-17T18:16:11.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.355762+0000", 2024-09-17T18:16:11.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8688000000000001e-05 2024-09-17T18:16:11.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.363075+0000", 2024-09-17T18:16:11.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073125309999999997 2024-09-17T18:16:11.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.363091+0000", 2024-09-17T18:16:11.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6223999999999999e-05 2024-09-17T18:16:11.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.370340+0000", 2024-09-17T18:16:11.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072494159999999998 2024-09-17T18:16:11.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.370416+0000", 2024-09-17T18:16:11.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5918000000000001e-05 2024-09-17T18:16:11.171 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.171 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.172 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.172 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds3 71/31 ECSubWrite(tid=468, reqid=client.4565.0:705, at_version=71'237, trim_to=0'0, roll_forward_to=71'234))", 2024-09-17T18:16:11.172 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.538794+0000", 2024-09-17T18:16:11.172 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.5270755180000002, 2024-09-17T18:16:11.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086808149999999997, 2024-09-17T18:16:11.172 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:11.172 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:11.172 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.172 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:11.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:11.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.538794+0000", 2024-09-17T18:16:11.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:11.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.538794+0000", 2024-09-17T18:16:11.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:11.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:11.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.538795+0000", 2024-09-17T18:16:11.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.043e-06 2024-09-17T18:16:11.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:11.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.538855+0000", 2024-09-17T18:16:11.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0495000000000003e-05 2024-09-17T18:16:11.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:11.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.538877+0000", 2024-09-17T18:16:11.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.139e-05 2024-09-17T18:16:11.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.538895+0000", 2024-09-17T18:16:11.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8379000000000001e-05 2024-09-17T18:16:11.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:11.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.539288+0000", 2024-09-17T18:16:11.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039312199999999998 2024-09-17T18:16:11.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.539300+0000", 2024-09-17T18:16:11.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2187999999999999e-05 2024-09-17T18:16:11.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.547421+0000", 2024-09-17T18:16:11.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0081202989999999992 2024-09-17T18:16:11.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:11.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:11.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:11.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.547475+0000", 2024-09-17T18:16:11.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3899e-05 2024-09-17T18:16:11.176 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.176 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.176 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.176 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:11.176 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:11.176 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:11.178 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T18:16:11.178 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:11.174+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:11.279 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:11.277+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:11.306 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:11.307 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:16:11.307 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-17T18:16:11.307 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:11.319 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.14 to 1 (10000) 2024-09-17T18:16:11.320 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T18:16:11.324 INFO:tasks.rados.rados.0.smithi154.stdout:298: done (4 left) 2024-09-17T18:16:11.324 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 29 current snap is 27 2024-09-17T18:16:11.324 INFO:tasks.rados.rados.0.smithi154.stdout:299: seq_num 133 ranges {2605056=688128,3293184=720896,4014080=475136,4489216=360448} 2024-09-17T18:16:11.336 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T18:16:11.348 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 15 1 2024-09-17T18:16:11.365 INFO:tasks.rados.rados.0.smithi154.stdout:299: writing smithi15432074-29 from 2605056 to 3293184 tid 1 2024-09-17T18:16:11.374 INFO:tasks.rados.rados.0.smithi154.stdout:299: writing smithi15432074-29 from 3293184 to 4014080 tid 2 2024-09-17T18:16:11.379 INFO:tasks.rados.rados.0.smithi154.stdout:299: writing smithi15432074-29 from 4014080 to 4489216 tid 3 2024-09-17T18:16:11.380 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:11.378+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:11.384 INFO:tasks.rados.rados.0.smithi154.stdout:299: writing smithi15432074-29 from 4489216 to 4849664 tid 4 2024-09-17T18:16:11.384 INFO:tasks.rados.rados.0.smithi154.stdout:300: copy_from oid 38 from oid 13 current snap is 27 2024-09-17T18:16:11.384 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 32 v 94 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-09-17T18:16:11.384 INFO:tasks.rados.rados.0.smithi154.stdout:294: finishing rollback tid 0 to smithi15432074-33 2024-09-17T18:16:11.384 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 48 v 96 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-09-17T18:16:11.384 INFO:tasks.rados.rados.0.smithi154.stdout:294: finishing rollback tid 1 to smithi15432074-33 2024-09-17T18:16:11.385 INFO:tasks.rados.rados.0.smithi154.stdout:293: done (5 left) 2024-09-17T18:16:11.385 INFO:tasks.rados.rados.0.smithi154.stdout:297: done (4 left) 2024-09-17T18:16:11.385 INFO:tasks.rados.rados.0.smithi154.stdout:301: rmattr oid 8 current snap is 27 2024-09-17T18:16:11.385 INFO:tasks.rados.rados.0.smithi154.stdout:301: done (4 left) 2024-09-17T18:16:11.385 INFO:tasks.rados.rados.0.smithi154.stdout:302: read oid 5 snap -1 2024-09-17T18:16:11.385 INFO:tasks.rados.rados.0.smithi154.stdout:302: expect deleted 2024-09-17T18:16:11.385 INFO:tasks.rados.rados.0.smithi154.stdout:303: rollback oid 1 current snap is 27 2024-09-17T18:16:11.385 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 1 to 14 2024-09-17T18:16:11.385 INFO:tasks.rados.rados.0.smithi154.stdout:294: finishing rollback tid 2 to smithi15432074-33 2024-09-17T18:16:11.385 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 33 v 125 (ObjNum 87 snap 14 seq_num 87) dirty exists 2024-09-17T18:16:11.385 INFO:tasks.rados.rados.0.smithi154.stdout:296: finishing write tid 1 to smithi15432074-30 2024-09-17T18:16:11.385 INFO:tasks.rados.rados.0.smithi154.stdout:296: finishing write tid 2 to smithi15432074-30 2024-09-17T18:16:11.385 INFO:tasks.rados.rados.0.smithi154.stdout:296: finishing write tid 3 to smithi15432074-30 2024-09-17T18:16:11.386 INFO:tasks.rados.rados.0.smithi154.stdout:296: finishing write tid 4 to smithi15432074-30 2024-09-17T18:16:11.386 INFO:tasks.rados.rados.0.smithi154.stdout:294: done (5 left) 2024-09-17T18:16:11.386 INFO:tasks.rados.rados.0.smithi154.stdout:304: read oid 37 snap -1 2024-09-17T18:16:11.386 INFO:tasks.rados.rados.0.smithi154.stdout:304: expect (ObjNum 37 snap 0 seq_num 37) 2024-09-17T18:16:11.386 INFO:tasks.rados.rados.0.smithi154.stdout:305: read oid 45 snap -1 2024-09-17T18:16:11.386 INFO:tasks.rados.rados.0.smithi154.stdout:305: expect (ObjNum 111 snap 24 seq_num 111) 2024-09-17T18:16:11.386 INFO:tasks.rados.rados.0.smithi154.stdout:306: snap_remove snap 17 2024-09-17T18:16:11.481 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:11.477+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:11.504 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:11.505 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:16:11.505 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-17T18:16:11.505 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-17T18:16:11.505 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:11.519 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T18:16:11.582 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:11.578+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:11.635 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:11.635 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-17T18:16:11.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-17T18:16:11.636 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-17T18:16:11.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.636 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 42/31 ECSubWrite(tid=87, reqid=client.4565.0:358, at_version=42'26, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:11.636 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.771519+0000", 2024-09-17T18:16:11.636 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.860605788000001, 2024-09-17T18:16:11.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090010019999999993, 2024-09-17T18:16:11.636 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.636 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.636 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.636 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771519+0000", 2024-09-17T18:16:11.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771519+0000", 2024-09-17T18:16:11.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771521+0000", 2024-09-17T18:16:11.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.528e-06 2024-09-17T18:16:11.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771559+0000", 2024-09-17T18:16:11.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7567000000000001e-05 2024-09-17T18:16:11.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771587+0000", 2024-09-17T18:16:11.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8561e-05 2024-09-17T18:16:11.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771603+0000", 2024-09-17T18:16:11.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5654e-05 2024-09-17T18:16:11.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771678+0000", 2024-09-17T18:16:11.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630999999999995e-05 2024-09-17T18:16:11.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771687+0000", 2024-09-17T18:16:11.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9809999999999992e-06 2024-09-17T18:16:11.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780476+0000", 2024-09-17T18:16:11.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087883019999999996 2024-09-17T18:16:11.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780520+0000", 2024-09-17T18:16:11.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4777999999999997e-05 2024-09-17T18:16:11.641 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.641 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.641 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.642 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.7s3 42/31 ECSubWrite(tid=88, reqid=client.4565.0:344, at_version=42'22, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:11.642 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.771639+0000", 2024-09-17T18:16:11.642 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.860485855, 2024-09-17T18:16:11.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0089162240000000004, 2024-09-17T18:16:11.642 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.642 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.642 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.642 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771639+0000", 2024-09-17T18:16:11.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771639+0000", 2024-09-17T18:16:11.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771640+0000", 2024-09-17T18:16:11.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.68e-07 2024-09-17T18:16:11.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771697+0000", 2024-09-17T18:16:11.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6586000000000003e-05 2024-09-17T18:16:11.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771714+0000", 2024-09-17T18:16:11.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7269e-05 2024-09-17T18:16:11.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771728+0000", 2024-09-17T18:16:11.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3777999999999999e-05 2024-09-17T18:16:11.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771858+0000", 2024-09-17T18:16:11.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013013400000000001 2024-09-17T18:16:11.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771871+0000", 2024-09-17T18:16:11.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3609e-05 2024-09-17T18:16:11.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780540+0000", 2024-09-17T18:16:11.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086685059999999994 2024-09-17T18:16:11.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780556+0000", 2024-09-17T18:16:11.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5673999999999999e-05 2024-09-17T18:16:11.646 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.646 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.647 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.647 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.8s1 42/31 ECSubWrite(tid=134, reqid=osd.6.0:133, at_version=0'0, trim_to=0'0, roll_forward_to=42'17))", 2024-09-17T18:16:11.647 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.773401+0000", 2024-09-17T18:16:11.647 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.858723998999999, 2024-09-17T18:16:11.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0098034449999999992, 2024-09-17T18:16:11.647 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.647 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.647 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.647 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773401+0000", 2024-09-17T18:16:11.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773401+0000", 2024-09-17T18:16:11.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773403+0000", 2024-09-17T18:16:11.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.75e-06 2024-09-17T18:16:11.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773424+0000", 2024-09-17T18:16:11.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1339e-05 2024-09-17T18:16:11.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773455+0000", 2024-09-17T18:16:11.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0539e-05 2024-09-17T18:16:11.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773471+0000", 2024-09-17T18:16:11.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6453e-05 2024-09-17T18:16:11.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773629+0000", 2024-09-17T18:16:11.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015783099999999999 2024-09-17T18:16:11.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773645+0000", 2024-09-17T18:16:11.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5882000000000001e-05 2024-09-17T18:16:11.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783144+0000", 2024-09-17T18:16:11.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094992210000000004 2024-09-17T18:16:11.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783205+0000", 2024-09-17T18:16:11.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0430000000000002e-05 2024-09-17T18:16:11.651 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.652 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.652 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.652 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:369 3.6s0 3:66d3fbbd:::smithi15432074-29:head [append 0~0] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:16:11.652 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:38.990317+0000", 2024-09-17T18:16:11.652 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.641808492999999, 2024-09-17T18:16:11.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0088636789999999993, 2024-09-17T18:16:11.652 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.652 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.652 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:11.652 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:11.653 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:11.653 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:11.653 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 369 2024-09-17T18:16:11.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.653 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990317+0000", 2024-09-17T18:16:11.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990317+0000", 2024-09-17T18:16:11.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990317+0000", 2024-09-17T18:16:11.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9100000000000004e-07 2024-09-17T18:16:11.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990320+0000", 2024-09-17T18:16:11.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3819999999999998e-06 2024-09-17T18:16:11.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990325+0000", 2024-09-17T18:16:11.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4040000000000003e-06 2024-09-17T18:16:11.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.990333+0000", 2024-09-17T18:16:11.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4740000000000005e-06 2024-09-17T18:16:11.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.992744+0000", 2024-09-17T18:16:11.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002410223 2024-09-17T18:16:11.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:11.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.992844+0000", 2024-09-17T18:16:11.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100203 2024-09-17T18:16:11.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.993311+0000", 2024-09-17T18:16:11.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00046744199999999999 2024-09-17T18:16:11.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.994001+0000", 2024-09-17T18:16:11.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00068924700000000004 2024-09-17T18:16:11.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:11.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.999149+0000", 2024-09-17T18:16:11.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051487219999999997 2024-09-17T18:16:11.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.999180+0000", 2024-09-17T18:16:11.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1090999999999998e-05 2024-09-17T18:16:11.658 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.658 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.658 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.658 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:376 3.6s0 3:6126409b:::smithi15432074-43:head [append 0~671744] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:16:11.658 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.069257+0000", 2024-09-17T18:16:11.658 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.562868258999998, 2024-09-17T18:16:11.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0097659919999999994, 2024-09-17T18:16:11.658 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.658 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.659 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:11.659 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:11.659 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:11.659 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:11.659 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 376 2024-09-17T18:16:11.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.659 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.069257+0000", 2024-09-17T18:16:11.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.069257+0000", 2024-09-17T18:16:11.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.069258+0000", 2024-09-17T18:16:11.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.347e-06 2024-09-17T18:16:11.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070218+0000", 2024-09-17T18:16:11.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00095974999999999999 2024-09-17T18:16:11.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070230+0000", 2024-09-17T18:16:11.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1867e-05 2024-09-17T18:16:11.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070237+0000", 2024-09-17T18:16:11.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630000000000003e-06 2024-09-17T18:16:11.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.071273+0000", 2024-09-17T18:16:11.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010355329999999999 2024-09-17T18:16:11.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:11.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.071421+0000", 2024-09-17T18:16:11.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000147596 2024-09-17T18:16:11.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.073068+0000", 2024-09-17T18:16:11.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016475859999999999 2024-09-17T18:16:11.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.076443+0000", 2024-09-17T18:16:11.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033753059999999998 2024-09-17T18:16:11.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:11.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.078917+0000", 2024-09-17T18:16:11.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002473931 2024-09-17T18:16:11.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.079023+0000", 2024-09-17T18:16:11.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105513 2024-09-17T18:16:11.664 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.664 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.664 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.664 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:377 3.6s0 3:6126409b:::smithi15432074-43:head [append 0~98304] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:16:11.665 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.070254+0000", 2024-09-17T18:16:11.665 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.561871345, 2024-09-17T18:16:11.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011803045, 2024-09-17T18:16:11.665 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.665 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.665 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:11.665 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:11.665 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:11.665 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:11.665 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 377 2024-09-17T18:16:11.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.665 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070254+0000", 2024-09-17T18:16:11.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070254+0000", 2024-09-17T18:16:11.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070255+0000", 2024-09-17T18:16:11.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.23e-07 2024-09-17T18:16:11.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070295+0000", 2024-09-17T18:16:11.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0540999999999997e-05 2024-09-17T18:16:11.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070306+0000", 2024-09-17T18:16:11.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0564000000000001e-05 2024-09-17T18:16:11.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070313+0000", 2024-09-17T18:16:11.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8979999999999999e-06 2024-09-17T18:16:11.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.074474+0000", 2024-09-17T18:16:11.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004161718 2024-09-17T18:16:11.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:11.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.074608+0000", 2024-09-17T18:16:11.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013348599999999999 2024-09-17T18:16:11.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.075463+0000", 2024-09-17T18:16:11.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085558400000000005 2024-09-17T18:16:11.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.076770+0000", 2024-09-17T18:16:11.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013061839999999999 2024-09-17T18:16:11.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:11.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.081960+0000", 2024-09-17T18:16:11.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005190643 2024-09-17T18:16:11.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.082057+0000", 2024-09-17T18:16:11.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6603999999999999e-05 2024-09-17T18:16:11.672 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.672 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.672 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.672 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:378 3.6s0 3:6126409b:::smithi15432074-43:head [setxattr _header (56) in=7b] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:16:11.672 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.070324+0000", 2024-09-17T18:16:11.672 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.561801649000003, 2024-09-17T18:16:11.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013464016000000001, 2024-09-17T18:16:11.672 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.673 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.673 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:11.673 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:11.673 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:11.673 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:11.673 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 378 2024-09-17T18:16:11.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.673 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070324+0000", 2024-09-17T18:16:11.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070324+0000", 2024-09-17T18:16:11.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070324+0000", 2024-09-17T18:16:11.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.82e-07 2024-09-17T18:16:11.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070327+0000", 2024-09-17T18:16:11.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.101e-06 2024-09-17T18:16:11.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070334+0000", 2024-09-17T18:16:11.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.922e-06 2024-09-17T18:16:11.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070340+0000", 2024-09-17T18:16:11.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4750000000000001e-06 2024-09-17T18:16:11.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.076926+0000", 2024-09-17T18:16:11.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065863370000000003 2024-09-17T18:16:11.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:11.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.077071+0000", 2024-09-17T18:16:11.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014542799999999999 2024-09-17T18:16:11.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.077737+0000", 2024-09-17T18:16:11.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00066590699999999998 2024-09-17T18:16:11.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.078436+0000", 2024-09-17T18:16:11.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00069889500000000005 2024-09-17T18:16:11.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:11.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.083638+0000", 2024-09-17T18:16:11.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052022270000000002 2024-09-17T18:16:11.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.083788+0000", 2024-09-17T18:16:11.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000149142 2024-09-17T18:16:11.678 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.679 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.679 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.679 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:379 3.6s0 3:6126409b:::smithi15432074-43:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:16:11.679 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.070348+0000", 2024-09-17T18:16:11.679 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.561777485999997, 2024-09-17T18:16:11.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015030777, 2024-09-17T18:16:11.679 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.679 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.679 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:16:11.679 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:11.680 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:11.680 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:11.680 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 379 2024-09-17T18:16:11.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.680 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070348+0000", 2024-09-17T18:16:11.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070348+0000", 2024-09-17T18:16:11.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070348+0000", 2024-09-17T18:16:11.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3799999999999997e-07 2024-09-17T18:16:11.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070351+0000", 2024-09-17T18:16:11.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0170000000000001e-06 2024-09-17T18:16:11.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070359+0000", 2024-09-17T18:16:11.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2160000000000006e-06 2024-09-17T18:16:11.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070366+0000", 2024-09-17T18:16:11.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8129999999999998e-06 2024-09-17T18:16:11.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.078205+0000", 2024-09-17T18:16:11.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007839047 2024-09-17T18:16:11.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:11.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.078327+0000", 2024-09-17T18:16:11.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012210000000000001 2024-09-17T18:16:11.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.084385+0000", 2024-09-17T18:16:11.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060574699999999997 2024-09-17T18:16:11.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:11.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.084512+0000", 2024-09-17T18:16:11.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000127086 2024-09-17T18:16:11.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.085378+0000", 2024-09-17T18:16:11.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086649000000000003 2024-09-17T18:16:11.684 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.684 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.684 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.685 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:505 3.6s0 3:6f149d43:::smithi15432074-47:head [read 0~2244608,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:11.685 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310195+0000", 2024-09-17T18:16:11.685 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.321930486999999, 2024-09-17T18:16:11.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024697646, 2024-09-17T18:16:11.685 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.685 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.685 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:16:11.685 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:11.685 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:11.685 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:11.685 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 505 2024-09-17T18:16:11.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.686 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310195+0000", 2024-09-17T18:16:11.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310195+0000", 2024-09-17T18:16:11.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310199+0000", 2024-09-17T18:16:11.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0600000000000001e-06 2024-09-17T18:16:11.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310216+0000", 2024-09-17T18:16:11.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6728999999999999e-05 2024-09-17T18:16:11.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310259+0000", 2024-09-17T18:16:11.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3915999999999998e-05 2024-09-17T18:16:11.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310286+0000", 2024-09-17T18:16:11.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6990000000000001e-05 2024-09-17T18:16:11.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310531+0000", 2024-09-17T18:16:11.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024485099999999998 2024-09-17T18:16:11.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-17T18:16:11.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310552+0000", 2024-09-17T18:16:11.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0954999999999998e-05 2024-09-17T18:16:11.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.316293+0000", 2024-09-17T18:16:11.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057404810000000004 2024-09-17T18:16:11.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:11.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.316555+0000", 2024-09-17T18:16:11.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026257100000000002 2024-09-17T18:16:11.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.334892+0000", 2024-09-17T18:16:11.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018337092999999999 2024-09-17T18:16:11.691 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.691 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.691 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.691 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:506 3.6s0 3:6f149d43:::smithi15432074-47:head [read 970914~1273694,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:11.691 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310344+0000", 2024-09-17T18:16:11.691 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.321781544, 2024-09-17T18:16:11.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025596168999999998, 2024-09-17T18:16:11.691 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.691 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.692 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:16:11.692 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:11.692 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:11.692 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:11.692 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 506 2024-09-17T18:16:11.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.692 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310344+0000", 2024-09-17T18:16:11.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310344+0000", 2024-09-17T18:16:11.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310345+0000", 2024-09-17T18:16:11.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.443e-06 2024-09-17T18:16:11.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310354+0000", 2024-09-17T18:16:11.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5799999999999992e-06 2024-09-17T18:16:11.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310380+0000", 2024-09-17T18:16:11.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6556000000000001e-05 2024-09-17T18:16:11.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310401+0000", 2024-09-17T18:16:11.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0667000000000001e-05 2024-09-17T18:16:11.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310820+0000", 2024-09-17T18:16:11.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00041894300000000002 2024-09-17T18:16:11.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:11.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310838+0000", 2024-09-17T18:16:11.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8156e-05 2024-09-17T18:16:11.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.317663+0000", 2024-09-17T18:16:11.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068248120000000004 2024-09-17T18:16:11.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:11.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.317905+0000", 2024-09-17T18:16:11.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024252400000000001 2024-09-17T18:16:11.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.335940+0000", 2024-09-17T18:16:11.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018034488000000001 2024-09-17T18:16:11.696 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.697 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.697 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.697 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:507 3.6s0 3:6f149d43:::smithi15432074-47:head [read 0~2244608,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:11.697 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310509+0000", 2024-09-17T18:16:11.697 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.321615917999999, 2024-09-17T18:16:11.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028949084999999999, 2024-09-17T18:16:11.697 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.697 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.697 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:16:11.697 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:11.697 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:11.698 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:11.698 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 507 2024-09-17T18:16:11.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.698 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310509+0000", 2024-09-17T18:16:11.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310509+0000", 2024-09-17T18:16:11.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310511+0000", 2024-09-17T18:16:11.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5629999999999999e-06 2024-09-17T18:16:11.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310520+0000", 2024-09-17T18:16:11.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3940000000000002e-06 2024-09-17T18:16:11.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310545+0000", 2024-09-17T18:16:11.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4892000000000002e-05 2024-09-17T18:16:11.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310561+0000", 2024-09-17T18:16:11.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6157000000000001e-05 2024-09-17T18:16:11.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310936+0000", 2024-09-17T18:16:11.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00037458400000000002 2024-09-17T18:16:11.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:11.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310952+0000", 2024-09-17T18:16:11.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.592e-05 2024-09-17T18:16:11.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.318680+0000", 2024-09-17T18:16:11.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077277200000000004 2024-09-17T18:16:11.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:11.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.318909+0000", 2024-09-17T18:16:11.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000229714 2024-09-17T18:16:11.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339458+0000", 2024-09-17T18:16:11.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020549141 2024-09-17T18:16:11.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.704 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.705 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpReadReply(3.6s0 53/31 ECSubReadReply(tid=44, attrs_read=0))", 2024-09-17T18:16:11.705 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.322520+0000", 2024-09-17T18:16:11.705 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.309605585, 2024-09-17T18:16:11.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01243506, 2024-09-17T18:16:11.706 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.706 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.706 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.706 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.322520+0000", 2024-09-17T18:16:11.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.322520+0000", 2024-09-17T18:16:11.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.322521+0000", 2024-09-17T18:16:11.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2529999999999999e-06 2024-09-17T18:16:11.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.331725+0000", 2024-09-17T18:16:11.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092041380000000006 2024-09-17T18:16:11.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.331750+0000", 2024-09-17T18:16:11.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5086e-05 2024-09-17T18:16:11.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.331767+0000", 2024-09-17T18:16:11.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6736e-05 2024-09-17T18:16:11.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.332185+0000", 2024-09-17T18:16:11.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00041827699999999999 2024-09-17T18:16:11.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.334955+0000", 2024-09-17T18:16:11.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0027695699999999998 2024-09-17T18:16:11.712 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.712 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.712 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.713 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 75/31 ECSubWrite(tid=247, reqid=client.4565.0:762, at_version=75'124, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:11.713 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.337519+0000", 2024-09-17T18:16:11.714 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.2946066860000001, 2024-09-17T18:16:11.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010234076999999999, 2024-09-17T18:16:11.714 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.714 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.715 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.715 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337519+0000", 2024-09-17T18:16:11.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337519+0000", 2024-09-17T18:16:11.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337519+0000", 2024-09-17T18:16:11.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8299999999999997e-07 2024-09-17T18:16:11.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337545+0000", 2024-09-17T18:16:11.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6203999999999998e-05 2024-09-17T18:16:11.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337561+0000", 2024-09-17T18:16:11.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5483000000000001e-05 2024-09-17T18:16:11.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337570+0000", 2024-09-17T18:16:11.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7499999999999998e-06 2024-09-17T18:16:11.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.338890+0000", 2024-09-17T18:16:11.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001319333 2024-09-17T18:16:11.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.338902+0000", 2024-09-17T18:16:11.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2629999999999999e-05 2024-09-17T18:16:11.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.347685+0000", 2024-09-17T18:16:11.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087828660000000003 2024-09-17T18:16:11.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.347753+0000", 2024-09-17T18:16:11.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7328000000000003e-05 2024-09-17T18:16:11.722 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.722 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.722 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.722 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 75/31 ECSubWrite(tid=248, reqid=client.4565.0:763, at_version=75'125, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:11.723 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.337586+0000", 2024-09-17T18:16:11.723 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.2945387740000001, 2024-09-17T18:16:11.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010196818, 2024-09-17T18:16:11.723 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.723 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.723 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.723 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337586+0000", 2024-09-17T18:16:11.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337586+0000", 2024-09-17T18:16:11.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337587+0000", 2024-09-17T18:16:11.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.51e-07 2024-09-17T18:16:11.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337629+0000", 2024-09-17T18:16:11.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2330999999999998e-05 2024-09-17T18:16:11.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337641+0000", 2024-09-17T18:16:11.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1742e-05 2024-09-17T18:16:11.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337650+0000", 2024-09-17T18:16:11.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0219999999999993e-06 2024-09-17T18:16:11.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.341046+0000", 2024-09-17T18:16:11.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003395936 2024-09-17T18:16:11.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.341090+0000", 2024-09-17T18:16:11.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3826999999999999e-05 2024-09-17T18:16:11.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.347758+0000", 2024-09-17T18:16:11.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006667872 2024-09-17T18:16:11.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.347783+0000", 2024-09-17T18:16:11.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5537e-05 2024-09-17T18:16:11.729 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.729 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.729 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.730 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.8s1 75/31 ECSubWrite(tid=180, reqid=osd.6.0:180, at_version=75'64, trim_to=0'0, roll_forward_to=73'60))", 2024-09-17T18:16:11.730 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.339285+0000", 2024-09-17T18:16:11.730 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.292840209, 2024-09-17T18:16:11.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099829429999999993, 2024-09-17T18:16:11.730 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.730 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.730 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.730 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.339285+0000", 2024-09-17T18:16:11.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.339285+0000", 2024-09-17T18:16:11.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.339286+0000", 2024-09-17T18:16:11.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5000000000000003e-07 2024-09-17T18:16:11.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.339307+0000", 2024-09-17T18:16:11.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1233000000000002e-05 2024-09-17T18:16:11.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.339317+0000", 2024-09-17T18:16:11.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0271e-05 2024-09-17T18:16:11.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.339325+0000", 2024-09-17T18:16:11.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6860000000000006e-06 2024-09-17T18:16:11.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.340205+0000", 2024-09-17T18:16:11.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00088022600000000001 2024-09-17T18:16:11.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.340219+0000", 2024-09-17T18:16:11.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3942e-05 2024-09-17T18:16:11.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.349237+0000", 2024-09-17T18:16:11.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090176149999999997 2024-09-17T18:16:11.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.349268+0000", 2024-09-17T18:16:11.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1420000000000001e-05 2024-09-17T18:16:11.736 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.736 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.736 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.736 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 75/31 ECSubWrite(tid=249, reqid=client.4565.0:764, at_version=75'126, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:11.737 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.340536+0000", 2024-09-17T18:16:11.737 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.291589044, 2024-09-17T18:16:11.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0089143050000000008, 2024-09-17T18:16:11.737 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.737 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.737 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:11.737 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.340536+0000", 2024-09-17T18:16:11.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.340536+0000", 2024-09-17T18:16:11.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.340537+0000", 2024-09-17T18:16:11.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1230000000000001e-06 2024-09-17T18:16:11.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.340652+0000", 2024-09-17T18:16:11.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114806 2024-09-17T18:16:11.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.340667+0000", 2024-09-17T18:16:11.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4894e-05 2024-09-17T18:16:11.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.340678+0000", 2024-09-17T18:16:11.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1425e-05 2024-09-17T18:16:11.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.341837+0000", 2024-09-17T18:16:11.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001159048 2024-09-17T18:16:11.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.341848+0000", 2024-09-17T18:16:11.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0587999999999999e-05 2024-09-17T18:16:11.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.349319+0000", 2024-09-17T18:16:11.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074711320000000001 2024-09-17T18:16:11.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.349450+0000", 2024-09-17T18:16:11.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013128900000000001 2024-09-17T18:16:11.741 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.741 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.741 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.742 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:772 3.6s0 3:66d3fbbd:::smithi15432074-29:head [append 0~688128] snapc 1c=[1c,19,18,17,16,15,13,11,10,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T18:16:11.742 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:11.365678+0000", 2024-09-17T18:16:11.742 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.26644674400000001, 2024-09-17T18:16:11.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094427820000000003, 2024-09-17T18:16:11.742 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.742 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.742 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:11.742 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:11.743 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:11.743 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:11.743 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 772 2024-09-17T18:16:11.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.743 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.365678+0000", 2024-09-17T18:16:11.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.365678+0000", 2024-09-17T18:16:11.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.365680+0000", 2024-09-17T18:16:11.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.517e-06 2024-09-17T18:16:11.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.366836+0000", 2024-09-17T18:16:11.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011555370000000001 2024-09-17T18:16:11.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.366848+0000", 2024-09-17T18:16:11.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2359e-05 2024-09-17T18:16:11.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.366856+0000", 2024-09-17T18:16:11.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5599999999999994e-06 2024-09-17T18:16:11.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.366916+0000", 2024-09-17T18:16:11.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9624999999999999e-05 2024-09-17T18:16:11.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:11.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.367008+0000", 2024-09-17T18:16:11.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2008000000000004e-05 2024-09-17T18:16:11.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.368127+0000", 2024-09-17T18:16:11.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011192660000000001 2024-09-17T18:16:11.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.370416+0000", 2024-09-17T18:16:11.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022884279999999999 2024-09-17T18:16:11.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:11.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.375009+0000", 2024-09-17T18:16:11.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045928380000000001 2024-09-17T18:16:11.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.375121+0000", 2024-09-17T18:16:11.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000112644 2024-09-17T18:16:11.748 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.748 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.748 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.748 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:775 3.6s0 3:66d3fbbd:::smithi15432074-29:head [append 0~360448] snapc 1c=[1c,19,18,17,16,15,13,11,10,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T18:16:11.748 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:11.383607+0000", 2024-09-17T18:16:11.748 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.248517775, 2024-09-17T18:16:11.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014587482000000001, 2024-09-17T18:16:11.749 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.749 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.749 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:11.749 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:11.749 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:11.749 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:11.749 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 775 2024-09-17T18:16:11.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.749 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.383607+0000", 2024-09-17T18:16:11.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.383607+0000", 2024-09-17T18:16:11.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.383608+0000", 2024-09-17T18:16:11.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1600000000000001e-07 2024-09-17T18:16:11.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.383994+0000", 2024-09-17T18:16:11.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000385666 2024-09-17T18:16:11.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384002+0000", 2024-09-17T18:16:11.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1030000000000002e-06 2024-09-17T18:16:11.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384010+0000", 2024-09-17T18:16:11.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.644e-06 2024-09-17T18:16:11.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384057+0000", 2024-09-17T18:16:11.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7253999999999999e-05 2024-09-17T18:16:11.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:11.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384150+0000", 2024-09-17T18:16:11.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3200000000000002e-05 2024-09-17T18:16:11.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384894+0000", 2024-09-17T18:16:11.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00074393699999999996 2024-09-17T18:16:11.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.386347+0000", 2024-09-17T18:16:11.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001452781 2024-09-17T18:16:11.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:11.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.398089+0000", 2024-09-17T18:16:11.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011742107999999999 2024-09-17T18:16:11.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.398195+0000", 2024-09-17T18:16:11.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000106073 2024-09-17T18:16:11.757 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.757 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.757 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.758 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:776 3.6s0 3:66d3fbbd:::smithi15432074-29:head [setxattr _header (57) in=7b] snapc 1c=[1c,19,18,17,16,15,13,11,10,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T18:16:11.758 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:11.384022+0000", 2024-09-17T18:16:11.758 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.24810295800000001, 2024-09-17T18:16:11.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014671544, 2024-09-17T18:16:11.758 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.758 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.759 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:11.759 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:11.759 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:11.759 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:11.759 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 776 2024-09-17T18:16:11.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.759 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384022+0000", 2024-09-17T18:16:11.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384022+0000", 2024-09-17T18:16:11.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384023+0000", 2024-09-17T18:16:11.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-17T18:16:11.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384028+0000", 2024-09-17T18:16:11.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9509999999999997e-06 2024-09-17T18:16:11.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384032+0000", 2024-09-17T18:16:11.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.51e-06 2024-09-17T18:16:11.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384044+0000", 2024-09-17T18:16:11.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2118e-05 2024-09-17T18:16:11.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.385459+0000", 2024-09-17T18:16:11.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001415026 2024-09-17T18:16:11.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:11.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.385558+0000", 2024-09-17T18:16:11.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8709000000000006e-05 2024-09-17T18:16:11.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:11.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.386038+0000", 2024-09-17T18:16:11.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00047938899999999999 2024-09-17T18:16:11.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:11.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.387057+0000", 2024-09-17T18:16:11.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010196269999999999 2024-09-17T18:16:11.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:11.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.398420+0000", 2024-09-17T18:16:11.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011362993 2024-09-17T18:16:11.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.398694+0000", 2024-09-17T18:16:11.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000273632 2024-09-17T18:16:11.764 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.764 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.764 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.765 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:777 3.6s0 3:66d3fbbd:::smithi15432074-29:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-09-17T18:16:11.765 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:11.384054+0000", 2024-09-17T18:16:11.765 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.24807161699999999, 2024-09-17T18:16:11.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016440097000000001, 2024-09-17T18:16:11.766 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:11.766 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:11.766 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:16:11.766 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:11.767 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:11.767 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:11.767 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 777 2024-09-17T18:16:11.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.767 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:11.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:11.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384054+0000", 2024-09-17T18:16:11.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:11.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384054+0000", 2024-09-17T18:16:11.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:11.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:11.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384054+0000", 2024-09-17T18:16:11.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4899999999999995e-07 2024-09-17T18:16:11.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:11.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384057+0000", 2024-09-17T18:16:11.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4449999999999999e-06 2024-09-17T18:16:11.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:11.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384063+0000", 2024-09-17T18:16:11.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7549999999999997e-06 2024-09-17T18:16:11.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:11.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384067+0000", 2024-09-17T18:16:11.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.585e-06 2024-09-17T18:16:11.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.386523+0000", 2024-09-17T18:16:11.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0024560110000000001 2024-09-17T18:16:11.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:11.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.386588+0000", 2024-09-17T18:16:11.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5017000000000004e-05 2024-09-17T18:16:11.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:11.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.399539+0000", 2024-09-17T18:16:11.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012951335 2024-09-17T18:16:11.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:11.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.399632+0000", 2024-09-17T18:16:11.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2893000000000007e-05 2024-09-17T18:16:11.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:11.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:11.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:11.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.400494+0000", 2024-09-17T18:16:11.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086140700000000001 2024-09-17T18:16:11.771 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.772 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:11.772 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:11.772 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:11.772 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T18:16:11.774 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:11.770+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:11.775 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T18:16:11.874 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:11.869+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:11.938 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:11.938 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:16:11.938 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-17T18:16:11.939 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:11.954 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T18:16:11.964 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:16:11.964 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:16:11.985 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:16:11.985 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:16:11.985 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:11.981+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:12.006 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:16:12.006 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:16:12.026 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:16:12.027 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:16:12.043 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:16:12.043 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:16:12.063 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:16:12.063 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:16:12.073 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:12.073 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:12.077 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:12.074+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:12.084 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:16:12.084 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:16:12.086 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T18:16:12.105 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:16:12.105 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:16:12.123 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:16:12.123 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:16:12.143 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:16:12.143 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:16:12.164 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:16:12.164 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:16:12.177 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:12.174+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:12.184 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:16:12.185 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:16:12.201 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:16:12.201 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:16:12.214 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:12.214 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:12.221 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:16:12.222 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:16:12.226 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T18:16:12.242 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:16:12.243 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:16:12.263 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:16:12.263 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:16:12.279 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:12.277+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:12.321 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.15 to 1 (10000) 2024-09-17T18:16:12.322 INFO:teuthology.orchestra.run.smithi087.stderr:noscrub is set 2024-09-17T18:16:12.325 INFO:tasks.rados.rados.0.smithi154.stdout:306: done (7 left) 2024-09-17T18:16:12.325 INFO:tasks.rados.rados.0.smithi154.stdout:307: read oid 35 snap -1 2024-09-17T18:16:12.325 INFO:tasks.rados.rados.0.smithi154.stdout:307: expect (ObjNum 28 snap 0 seq_num 28) 2024-09-17T18:16:12.326 INFO:tasks.rados.rados.0.smithi154.stdout:308: read oid 39 snap -1 2024-09-17T18:16:12.326 INFO:tasks.rados.rados.0.smithi154.stdout:308: expect deleted 2024-09-17T18:16:12.326 INFO:tasks.rados.rados.0.smithi154.stdout:309: read oid 2 snap -1 2024-09-17T18:16:12.326 INFO:tasks.rados.rados.0.smithi154.stdout:309: expect (ObjNum 100 snap 19 seq_num 100) 2024-09-17T18:16:12.326 INFO:tasks.rados.rados.0.smithi154.stdout:296: finishing write tid 5 to smithi15432074-30 2024-09-17T18:16:12.326 INFO:tasks.rados.rados.0.smithi154.stdout:296: finishing write tid 6 to smithi15432074-30 2024-09-17T18:16:12.326 INFO:tasks.rados.rados.0.smithi154.stdout:296: oid 30 updating version 0 to 126 2024-09-17T18:16:12.326 INFO:tasks.rados.rados.0.smithi154.stdout:296: oid 30 updating version 126 to 128 2024-09-17T18:16:12.326 INFO:tasks.rados.rados.0.smithi154.stdout:296: oid 30 version 128 is already newer than 127 2024-09-17T18:16:12.327 INFO:tasks.rados.rados.0.smithi154.stdout:296: oid 30 updating version 128 to 129 2024-09-17T18:16:12.327 INFO:tasks.rados.rados.0.smithi154.stdout:296: oid 30 updating version 129 to 130 2024-09-17T18:16:12.327 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 30 v 130 (ObjNum 132 snap 27 seq_num 132) dirty exists 2024-09-17T18:16:12.327 INFO:tasks.rados.rados.0.smithi154.stdout:296: left oid 30 (ObjNum 132 snap 27 seq_num 132) 2024-09-17T18:16:12.327 INFO:tasks.rados.rados.0.smithi154.stdout:299: finishing write tid 1 to smithi15432074-29 2024-09-17T18:16:12.327 INFO:tasks.rados.rados.0.smithi154.stdout:299: finishing write tid 2 to smithi15432074-29 2024-09-17T18:16:12.327 INFO:tasks.rados.rados.0.smithi154.stdout:299: finishing write tid 3 to smithi15432074-29 2024-09-17T18:16:12.327 INFO:tasks.rados.rados.0.smithi154.stdout:303: finishing rollback tid 1 to smithi15432074-1 2024-09-17T18:16:12.327 INFO:tasks.rados.rados.0.smithi154.stdout:303: finishing rollback tid 2 to smithi15432074-1 2024-09-17T18:16:12.327 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 1 v 72 (ObjNum 0 snap 0 seq_num 0) dirty exists 2024-09-17T18:16:12.327 INFO:tasks.rados.rados.0.smithi154.stdout:299: finishing write tid 4 to smithi15432074-29 2024-09-17T18:16:12.327 INFO:tasks.rados.rados.0.smithi154.stdout:299: finishing write tid 5 to smithi15432074-29 2024-09-17T18:16:12.327 INFO:tasks.rados.rados.0.smithi154.stdout:299: finishing write tid 6 to smithi15432074-29 2024-09-17T18:16:12.328 INFO:tasks.rados.rados.0.smithi154.stdout:299: oid 29 updating version 0 to 78 2024-09-17T18:16:12.328 INFO:tasks.rados.rados.0.smithi154.stdout:299: oid 29 version 78 is already newer than 77 2024-09-17T18:16:12.328 INFO:tasks.rados.rados.0.smithi154.stdout:299: oid 29 updating version 78 to 79 2024-09-17T18:16:12.328 INFO:tasks.rados.rados.0.smithi154.stdout:299: oid 29 version 79 is already newer than 76 2024-09-17T18:16:12.328 INFO:tasks.rados.rados.0.smithi154.stdout:299: oid 29 updating version 79 to 80 2024-09-17T18:16:12.328 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 29 v 80 (ObjNum 133 snap 27 seq_num 133) dirty exists 2024-09-17T18:16:12.328 INFO:tasks.rados.rados.0.smithi154.stdout:299: left oid 29 (ObjNum 133 snap 27 seq_num 133) 2024-09-17T18:16:12.328 INFO:tasks.rados.rados.0.smithi154.stdout:304: expect (ObjNum 37 snap 0 seq_num 37) 2024-09-17T18:16:12.328 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:12.342 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 313806 2024-09-17T18:16:12.350 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:12.357 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-17T18:16:12.357 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:16:12.366 INFO:tasks.rados.rados.0.smithi154.stdout:305: expect (ObjNum 111 snap 24 seq_num 111) 2024-09-17T18:16:12.375 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:12.375 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:12.380 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:12.378+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:12.391 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 2528588 2024-09-17T18:16:12.392 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T18:16:12.393 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:12.433 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1758211 2024-09-17T18:16:12.440 INFO:tasks.rados.rados.0.smithi154.stdout:300: finishing copy_from racing read to smithi15432074-38 2024-09-17T18:16:12.441 INFO:tasks.rados.rados.0.smithi154.stdout:300: finishing copy_from to smithi15432074-38 2024-09-17T18:16:12.441 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 38 v 27 (ObjNum 109 snap 23 seq_num 109) dirty exists 2024-09-17T18:16:12.441 INFO:tasks.rados.rados.0.smithi154.stdout:307: expect (ObjNum 28 snap 0 seq_num 28) 2024-09-17T18:16:12.441 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 75435 2024-09-17T18:16:12.444 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:12.449 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 178628 2024-09-17T18:16:12.452 INFO:tasks.rados.rados.0.smithi154.stdout:309: expect (ObjNum 100 snap 19 seq_num 100) 2024-09-17T18:16:12.452 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:12.481 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:12.478+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:12.504 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 2396907 2024-09-17T18:16:12.522 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1700901 2024-09-17T18:16:12.538 INFO:tasks.rados.rados.0.smithi154.stdout:296: done (9 left) 2024-09-17T18:16:12.538 INFO:tasks.rados.rados.0.smithi154.stdout:299: done (8 left) 2024-09-17T18:16:12.538 INFO:tasks.rados.rados.0.smithi154.stdout:300: done (7 left) 2024-09-17T18:16:12.538 INFO:tasks.rados.rados.0.smithi154.stdout:302: done (6 left) 2024-09-17T18:16:12.538 INFO:tasks.rados.rados.0.smithi154.stdout:303: done (5 left) 2024-09-17T18:16:12.538 INFO:tasks.rados.rados.0.smithi154.stdout:304: done (4 left) 2024-09-17T18:16:12.538 INFO:tasks.rados.rados.0.smithi154.stdout:305: done (3 left) 2024-09-17T18:16:12.539 INFO:tasks.rados.rados.0.smithi154.stdout:307: done (2 left) 2024-09-17T18:16:12.539 INFO:tasks.rados.rados.0.smithi154.stdout:308: done (1 left) 2024-09-17T18:16:12.539 INFO:tasks.rados.rados.0.smithi154.stdout:309: done (0 left) 2024-09-17T18:16:12.539 INFO:tasks.rados.rados.0.smithi154.stdout:310: rollback oid 34 current snap is 27 2024-09-17T18:16:12.539 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 34 to 6 2024-09-17T18:16:12.539 INFO:tasks.rados.rados.0.smithi154.stdout:311: delete oid 33 current snap is 27 2024-09-17T18:16:12.550 INFO:tasks.rados.rados.0.smithi154.stdout:311: done (1 left) 2024-09-17T18:16:12.551 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 16 current snap is 27 2024-09-17T18:16:12.551 INFO:tasks.rados.rados.0.smithi154.stdout:312: seq_num 135 ranges {0=720896,720896=622592,1343488=688128,2031616=245760} 2024-09-17T18:16:12.554 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:12.554 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:12.557 INFO:tasks.rados.rados.0.smithi154.stdout:312: writing smithi15432074-16 from 0 to 720896 tid 1 2024-09-17T18:16:12.569 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T18:16:12.570 INFO:tasks.rados.rados.0.smithi154.stdout:312: writing smithi15432074-16 from 720896 to 1343488 tid 2 2024-09-17T18:16:12.581 INFO:tasks.rados.rados.0.smithi154.stdout:312: writing smithi15432074-16 from 1343488 to 2031616 tid 3 2024-09-17T18:16:12.582 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:12.577+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:12.586 INFO:tasks.rados.rados.0.smithi154.stdout:312: writing smithi15432074-16 from 2031616 to 2277376 tid 4 2024-09-17T18:16:12.586 INFO:tasks.rados.rados.0.smithi154.stdout:313: snap_remove snap 23 2024-09-17T18:16:12.586 INFO:tasks.rados.rados.0.smithi154.stdout:310: finishing rollback tid 0 to smithi15432074-34 2024-09-17T18:16:12.586 INFO:tasks.rados.rados.0.smithi154.stdout:310: finishing rollback tid 1 to smithi15432074-34 2024-09-17T18:16:12.586 INFO:tasks.rados.rados.0.smithi154.stdout:310: finishing rollback tid 2 to smithi15432074-34 2024-09-17T18:16:12.586 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 34 v 155 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-09-17T18:16:12.586 INFO:tasks.rados.rados.0.smithi154.stdout:312: finishing write tid 1 to smithi15432074-16 2024-09-17T18:16:12.587 INFO:tasks.rados.rados.0.smithi154.stdout:312: finishing write tid 2 to smithi15432074-16 2024-09-17T18:16:12.674 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:16:12.674 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:16:12.682 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:12.682 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:12.682 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:16:12.678+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:16:12.692 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-09-17T18:16:12.321651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129303091,"num_objects":143,"num_object_clones":90,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":11,"num_read":416,"num_read_kb":91769,"num_write":802,"num_write_kb":134418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1313,"ondisk_log_size":1313,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":696936,"kb_used_data":227004,"kb_used_omap":24,"kb_used_meta":469543,"kb_avail":1509252504,"statfs":{"total":1546188226560,"available":1545474564096,"internally_reserved":0,"allocated":232452096,"data_stored":342895631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":480812113},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17301504,"num_objects":11,"num_object_clones":11,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":3,"num_read":18,"num_read_kb":1294,"num_write":41,"num_write_kb":17392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.009615"},"pg_stats":[{"pgid":"3.f","version":"72'29","reported_seq":218,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.473001+0000","last_change":"2024-09-17T18:16:07.477092+0000","last_active":"2024-09-17T18:16:07.473001+0000","last_peered":"2024-09-17T18:16:07.473001+0000","last_clean":"2024-09-17T18:16:07.473001+0000","last_became_active":"2024-09-17T18:15:28.090920+0000","last_became_peered":"2024-09-17T18:15:28.090920+0000","last_unstale":"2024-09-17T18:16:07.473001+0000","last_undegraded":"2024-09-17T18:16:07.473001+0000","last_fullsized":"2024-09-17T18:16:07.473001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:45.854830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038844610000000002,"stat_sum":{"num_bytes":4882432,"num_objects":5,"num_object_clones":3,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":16,"num_read_kb":12189,"num_write":17,"num_write_kb":4848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3,15,14,2,11,0],"acting":[13,3,15,14,2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.e","version":"72'17","reported_seq":207,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.450459+0000","last_change":"2024-09-17T18:16:07.453130+0000","last_active":"2024-09-17T18:16:07.450459+0000","last_peered":"2024-09-17T18:16:07.450459+0000","last_clean":"2024-09-17T18:16:07.450459+0000","last_became_active":"2024-09-17T18:15:28.110648+0000","last_became_peered":"2024-09-17T18:15:28.110648+0000","last_unstale":"2024-09-17T18:16:07.450459+0000","last_undegraded":"2024-09-17T18:16:07.450459+0000","last_fullsized":"2024-09-17T18:16:07.450459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:51.064067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020508648000000001,"stat_sum":{"num_bytes":1982464,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":14,"num_read_kb":946,"num_write":30,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14,6,13,8,3,12],"acting":[11,14,6,13,8,3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.d","version":"72'260","reported_seq":439,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.519904+0000","last_change":"2024-09-17T18:16:07.521340+0000","last_active":"2024-09-17T18:16:07.519904+0000","last_peered":"2024-09-17T18:16:07.519904+0000","last_clean":"2024-09-17T18:16:07.519904+0000","last_became_active":"2024-09-17T18:15:28.273848+0000","last_became_peered":"2024-09-17T18:15:28.273848+0000","last_unstale":"2024-09-17T18:16:07.519904+0000","last_undegraded":"2024-09-17T18:16:07.519904+0000","last_fullsized":"2024-09-17T18:16:07.519904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:27.471759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.082982156000000001,"stat_sum":{"num_bytes":29212672,"num_objects":30,"num_object_clones":21,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":1,"num_read":67,"num_read_kb":10904,"num_write":171,"num_write_kb":29008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,11,15,9,8,4],"acting":[13,1,11,15,9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.c","version":"72'84","reported_seq":261,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.484144+0000","last_change":"2024-09-17T18:16:07.485476+0000","last_active":"2024-09-17T18:16:07.484144+0000","last_peered":"2024-09-17T18:16:07.484144+0000","last_clean":"2024-09-17T18:16:07.484144+0000","last_became_active":"2024-09-17T18:15:28.112093+0000","last_became_peered":"2024-09-17T18:15:28.112093+0000","last_unstale":"2024-09-17T18:16:07.484144+0000","last_undegraded":"2024-09-17T18:16:07.484144+0000","last_fullsized":"2024-09-17T18:16:07.484144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:31.422779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045114102000000003,"stat_sum":{"num_bytes":7045120,"num_objects":9,"num_object_clones":5,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":16,"num_read_kb":4471,"num_write":29,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,3,7,12,14],"acting":[5,8,13,3,7,12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.b","version":"73'119","reported_seq":294,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.327580+0000","last_change":"2024-09-17T18:16:08.327580+0000","last_active":"2024-09-17T18:16:08.327580+0000","last_peered":"2024-09-17T18:16:08.327580+0000","last_clean":"2024-09-17T18:16:08.327580+0000","last_became_active":"2024-09-17T18:15:28.111526+0000","last_became_peered":"2024-09-17T18:15:28.111526+0000","last_unstale":"2024-09-17T18:16:08.327580+0000","last_undegraded":"2024-09-17T18:16:08.327580+0000","last_fullsized":"2024-09-17T18:16:08.327580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:27.346346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011359917000000001,"stat_sum":{"num_bytes":12337152,"num_objects":13,"num_object_clones":9,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":1,"num_read":18,"num_read_kb":10,"num_write":82,"num_write_kb":12800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,10,12,11,1,14],"acting":[4,0,10,12,11,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.a","version":"72'160","reported_seq":342,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.497756+0000","last_change":"2024-09-17T18:16:07.499383+0000","last_active":"2024-09-17T18:16:07.497756+0000","last_peered":"2024-09-17T18:16:07.497756+0000","last_clean":"2024-09-17T18:16:07.497756+0000","last_became_active":"2024-09-17T18:15:28.089449+0000","last_became_peered":"2024-09-17T18:15:28.089449+0000","last_unstale":"2024-09-17T18:16:07.497756+0000","last_undegraded":"2024-09-17T18:16:07.497756+0000","last_fullsized":"2024-09-17T18:16:07.497756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:41.039584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061304109000000002,"stat_sum":{"num_bytes":12615680,"num_objects":16,"num_object_clones":11,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":2,"num_read":49,"num_read_kb":24860,"num_write":53,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,6,5,3,15,4],"acting":[13,1,6,5,3,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.9","version":"73'137","reported_seq":320,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.374553+0000","last_change":"2024-09-17T18:16:08.375883+0000","last_active":"2024-09-17T18:16:08.374553+0000","last_peered":"2024-09-17T18:16:08.374553+0000","last_clean":"2024-09-17T18:16:08.374553+0000","last_became_active":"2024-09-17T18:15:28.095114+0000","last_became_peered":"2024-09-17T18:15:28.095114+0000","last_unstale":"2024-09-17T18:16:08.374553+0000","last_undegraded":"2024-09-17T18:16:08.374553+0000","last_fullsized":"2024-09-17T18:16:08.374553+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:55.553530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036000785,"stat_sum":{"num_bytes":12615680,"num_objects":13,"num_object_clones":9,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":26,"num_read_kb":5061,"num_write":71,"num_write_kb":14144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,10,11,5,8,3],"acting":[7,2,10,11,5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.8","version":"73'60","reported_seq":245,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.362425+0000","last_change":"2024-09-17T18:16:08.363074+0000","last_active":"2024-09-17T18:16:08.362425+0000","last_peered":"2024-09-17T18:16:08.362425+0000","last_clean":"2024-09-17T18:16:08.362425+0000","last_became_active":"2024-09-17T18:15:28.088066+0000","last_became_peered":"2024-09-17T18:15:28.088066+0000","last_unstale":"2024-09-17T18:16:08.362425+0000","last_undegraded":"2024-09-17T18:16:08.362425+0000","last_fullsized":"2024-09-17T18:16:08.362425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:46.465979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029649089,"stat_sum":{"num_bytes":7143424,"num_objects":7,"num_object_clones":4,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":10,"num_read_kb":7,"num_write":26,"num_write_kb":7664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,11,3,15,1,7],"acting":[6,0,11,3,15,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"1.0","version":"25'112","reported_seq":243,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.333690+0000","last_change":"2024-09-17T18:15:13.924291+0000","last_active":"2024-09-17T18:16:08.333690+0000","last_peered":"2024-09-17T18:16:08.333690+0000","last_clean":"2024-09-17T18:16:08.333690+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:16:08.333690+0000","last_undegraded":"2024-09-17T18:16:08.333690+0000","last_fullsized":"2024-09-17T18:16:08.333690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:15:12.533086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.379235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":112,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.327974+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:16:08.327974+0000","last_peered":"2024-09-17T18:16:08.327974+0000","last_clean":"2024-09-17T18:16:08.327974+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:16:08.327974+0000","last_undegraded":"2024-09-17T18:16:08.327974+0000","last_fullsized":"2024-09-17T18:16:08.327974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"73'46","reported_seq":235,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.348733+0000","last_change":"2024-09-17T18:16:08.349593+0000","last_active":"2024-09-17T18:16:08.348733+0000","last_peered":"2024-09-17T18:16:08.348733+0000","last_clean":"2024-09-17T18:16:08.348733+0000","last_became_active":"2024-09-17T18:15:28.089102+0000","last_became_peered":"2024-09-17T18:15:28.089102+0000","last_unstale":"2024-09-17T18:16:08.348733+0000","last_undegraded":"2024-09-17T18:16:08.348733+0000","last_fullsized":"2024-09-17T18:16:08.348733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.017378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021483182,"stat_sum":{"num_bytes":1015808,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":11,"num_read_kb":114,"num_write":30,"num_write_kb":1488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3,13,1,5,10,7],"acting":[14,3,13,1,5,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":117,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T18:16:11.329902+0000","last_change":"2024-09-17T18:15:16.990099+0000","last_active":"2024-09-17T18:16:11.329902+0000","last_peered":"2024-09-17T18:16:11.329902+0000","last_clean":"2024-09-17T18:16:11.329902+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:16:11.329902+0000","last_undegraded":"2024-09-17T18:16:11.329902+0000","last_fullsized":"2024-09-17T18:16:11.329902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.933228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":184,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.316178+0000","last_change":"2024-09-17T18:16:08.316532+0000","last_active":"2024-09-17T18:16:08.316178+0000","last_peered":"2024-09-17T18:16:08.316178+0000","last_clean":"2024-09-17T18:16:08.316178+0000","last_became_active":"2024-09-17T18:15:28.094455+0000","last_became_peered":"2024-09-17T18:15:28.094455+0000","last_unstale":"2024-09-17T18:16:08.316178+0000","last_undegraded":"2024-09-17T18:16:08.316178+0000","last_fullsized":"2024-09-17T18:16:08.316178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:54.162098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084907400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,14,10,7,3,2],"acting":[4,13,14,10,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":111,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.327833+0000","last_change":"2024-09-17T18:15:17.499886+0000","last_active":"2024-09-17T18:16:08.327833+0000","last_peered":"2024-09-17T18:16:08.327833+0000","last_clean":"2024-09-17T18:16:08.327833+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:16:08.327833+0000","last_undegraded":"2024-09-17T18:16:08.327833+0000","last_fullsized":"2024-09-17T18:16:08.327833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.366017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"73'37","reported_seq":230,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.369470+0000","last_change":"2024-09-17T18:16:08.329798+0000","last_active":"2024-09-17T18:16:08.369470+0000","last_peered":"2024-09-17T18:16:08.369470+0000","last_clean":"2024-09-17T18:16:08.369470+0000","last_became_active":"2024-09-17T18:15:28.273637+0000","last_became_peered":"2024-09-17T18:15:28.273637+0000","last_unstale":"2024-09-17T18:16:08.369470+0000","last_undegraded":"2024-09-17T18:16:08.369470+0000","last_fullsized":"2024-09-17T18:16:08.369470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:29.336818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027687699999999998,"stat_sum":{"num_bytes":9404416,"num_objects":6,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":6254,"num_write":19,"num_write_kb":9184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,9,2,6,15,4],"acting":[3,7,9,2,6,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":111,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.437951+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:16:07.437951+0000","last_peered":"2024-09-17T18:16:07.437951+0000","last_clean":"2024-09-17T18:16:07.437951+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:16:07.437951+0000","last_undegraded":"2024-09-17T18:16:07.437951+0000","last_fullsized":"2024-09-17T18:16:07.437951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:19.851941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"72'37","reported_seq":230,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.449287+0000","last_change":"2024-09-17T18:16:07.454779+0000","last_active":"2024-09-17T18:16:07.449287+0000","last_peered":"2024-09-17T18:16:07.449287+0000","last_clean":"2024-09-17T18:16:07.449287+0000","last_became_active":"2024-09-17T18:15:28.272974+0000","last_became_peered":"2024-09-17T18:15:28.272974+0000","last_unstale":"2024-09-17T18:16:07.449287+0000","last_undegraded":"2024-09-17T18:16:07.449287+0000","last_fullsized":"2024-09-17T18:16:07.449287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:29.867609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023068154,"stat_sum":{"num_bytes":5111808,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":9399,"num_write":16,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4,13,11,2,5],"acting":[10,9,4,13,11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.5","version":"72'40","reported_seq":225,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.457947+0000","last_change":"2024-09-17T18:16:07.461328+0000","last_active":"2024-09-17T18:16:07.457947+0000","last_peered":"2024-09-17T18:16:07.457947+0000","last_clean":"2024-09-17T18:16:07.457947+0000","last_became_active":"2024-09-17T18:15:28.275306+0000","last_became_peered":"2024-09-17T18:15:28.275306+0000","last_unstale":"2024-09-17T18:16:07.457947+0000","last_undegraded":"2024-09-17T18:16:07.457947+0000","last_fullsized":"2024-09-17T18:16:07.457947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:27.764346+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.020781956000000001,"stat_sum":{"num_bytes":8765440,"num_objects":4,"num_object_clones":3,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":9,"num_read_kb":488,"num_write":33,"num_write_kb":8560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,11],"acting":[5,8,4,9,12,0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.315708+0000","last_change":"2024-09-17T18:15:16.605178+0000","last_active":"2024-09-17T18:16:08.315708+0000","last_peered":"2024-09-17T18:16:08.315708+0000","last_clean":"2024-09-17T18:16:08.315708+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:16:08.315708+0000","last_undegraded":"2024-09-17T18:16:08.315708+0000","last_fullsized":"2024-09-17T18:16:08.315708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.438554+0000","last_change":"2024-09-17T18:16:07.439472+0000","last_active":"2024-09-17T18:16:07.438554+0000","last_peered":"2024-09-17T18:16:07.438554+0000","last_clean":"2024-09-17T18:16:07.438554+0000","last_became_active":"2024-09-17T18:15:28.090551+0000","last_became_peered":"2024-09-17T18:15:28.090551+0000","last_unstale":"2024-09-17T18:16:07.438554+0000","last_undegraded":"2024-09-17T18:16:07.438554+0000","last_fullsized":"2024-09-17T18:16:07.438554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:50.614888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016630639999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15,4,2,6,10,7],"acting":[8,15,4,2,6,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.338725+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:16:08.338725+0000","last_peered":"2024-09-17T18:16:08.338725+0000","last_clean":"2024-09-17T18:16:08.338725+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:16:08.338725+0000","last_undegraded":"2024-09-17T18:16:08.338725+0000","last_fullsized":"2024-09-17T18:16:08.338725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:14.501281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"72'92","reported_seq":293,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.316499+0000","last_change":"2024-09-17T18:16:08.316961+0000","last_active":"2024-09-17T18:16:08.316499+0000","last_peered":"2024-09-17T18:16:08.316499+0000","last_clean":"2024-09-17T18:16:08.316499+0000","last_became_active":"2024-09-17T18:15:27.692814+0000","last_became_peered":"2024-09-17T18:15:27.692814+0000","last_unstale":"2024-09-17T18:16:08.316499+0000","last_undegraded":"2024-09-17T18:16:08.316499+0000","last_fullsized":"2024-09-17T18:16:08.316499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:49.942613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010722209999999999,"stat_sum":{"num_bytes":7438336,"num_objects":12,"num_object_clones":7,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":42,"num_read_kb":9833,"num_write":47,"num_write_kb":7264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,0,14,10,13],"acting":[4,11,6,0,14,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.437237+0000","last_change":"2024-09-17T18:15:17.502621+0000","last_active":"2024-09-17T18:16:07.437237+0000","last_peered":"2024-09-17T18:16:07.437237+0000","last_clean":"2024-09-17T18:16:07.437237+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:16:07.437237+0000","last_undegraded":"2024-09-17T18:16:07.437237+0000","last_fullsized":"2024-09-17T18:16:07.437237+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.990534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"76'80","reported_seq":286,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T18:16:11.398424+0000","last_change":"2024-09-17T18:16:11.354450+0000","last_active":"2024-09-17T18:16:11.398424+0000","last_peered":"2024-09-17T18:16:11.398424+0000","last_clean":"2024-09-17T18:16:11.398424+0000","last_became_active":"2024-09-17T18:15:28.272963+0000","last_became_peered":"2024-09-17T18:15:28.272963+0000","last_unstale":"2024-09-17T18:16:11.398424+0000","last_undegraded":"2024-09-17T18:16:11.398424+0000","last_fullsized":"2024-09-17T18:16:11.398424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.745132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021937525999999999,"stat_sum":{"num_bytes":9142272,"num_objects":10,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":20,"num_read_kb":7160,"num_write":31,"num_write_kb":8928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14,6,2,5,9,15],"acting":[0,14,6,2,5,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"5","length":"1"},{"start":"14","length":"1"},{"start":"1a","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.438355+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:16:07.438355+0000","last_peered":"2024-09-17T18:16:07.438355+0000","last_clean":"2024-09-17T18:16:07.438355+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:16:07.438355+0000","last_undegraded":"2024-09-17T18:16:07.438355+0000","last_fullsized":"2024-09-17T18:16:07.438355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:17.193575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":128712704,"num_objects":139,"num_object_clones":90,"num_object_copies":973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":11,"num_read":330,"num_read_kb":91696,"num_write":655,"num_write_kb":131744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":220127232,"data_stored":338046976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1198,"ondisk_log_size":1198,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247823,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49012,"kb_used_data":17820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322828,"statfs":{"total":96636764160,"available":96586575872,"internally_reserved":0,"allocated":18247680,"data_stored":26834701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247823,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42344,"kb_used_data":11148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329496,"statfs":{"total":96636764160,"available":96593403904,"internally_reserved":0,"allocated":11415552,"data_stored":16774381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280527,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35364,"kb_used_data":8336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336476,"statfs":{"total":96636764160,"available":96600551424,"internally_reserved":0,"allocated":8536064,"data_stored":11803727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313232,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44924,"kb_used_data":13736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326916,"statfs":{"total":96636764160,"available":96590761984,"internally_reserved":0,"allocated":14065664,"data_stored":22390673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280527,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44352,"kb_used_data":17324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94327488,"statfs":{"total":96636764160,"available":96591347712,"internally_reserved":0,"allocated":17739776,"data_stored":25975887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313232,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42220,"kb_used_data":15188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94329620,"statfs":{"total":96636764160,"available":96593530880,"internally_reserved":0,"allocated":15552512,"data_stored":21561072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280525,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41312,"kb_used_data":14284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330528,"statfs":{"total":96636764160,"available":96594460672,"internally_reserved":0,"allocated":14626816,"data_stored":20257852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280526,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37516,"kb_used_data":10488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334324,"statfs":{"total":96636764160,"available":96598347776,"internally_reserved":0,"allocated":10739712,"data_stored":16485436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,4,5,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313230,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54000,"kb_used_data":22808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94317840,"statfs":{"total":96636764160,"available":96581468160,"internally_reserved":0,"allocated":23355392,"data_stored":36203580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280526,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47400,"kb_used_data":16208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324440,"statfs":{"total":96636764160,"available":96588226560,"internally_reserved":0,"allocated":16596992,"data_stored":25855213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280526,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36668,"kb_used_data":9640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335172,"statfs":{"total":96636764160,"available":96599216128,"internally_reserved":0,"allocated":9871360,"data_stored":13909052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247821,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45192,"kb_used_data":14000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326648,"statfs":{"total":96636764160,"available":96590487552,"internally_reserved":0,"allocated":14336000,"data_stored":20559085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247823,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52092,"kb_used_data":20896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94319748,"statfs":{"total":96636764160,"available":96583421952,"internally_reserved":0,"allocated":21397504,"data_stored":32322797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247823,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43824,"kb_used_data":12632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328016,"statfs":{"total":96636764160,"available":96591888384,"internally_reserved":0,"allocated":12935168,"data_stored":18165782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247822,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40436,"kb_used_data":9244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331404,"statfs":{"total":96636764160,"available":96595357696,"internally_reserved":0,"allocated":9465856,"data_stored":13853933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280525,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40280,"kb_used_data":13252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331560,"statfs":{"total":96636764160,"available":96595517440,"internally_reserved":0,"allocated":13570048,"data_stored":19942460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12984320,"data_stored":21774336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15220736,"data_stored":24469504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8871936,"data_stored":13344768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14159872,"data_stored":20824064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20860928,"data_stored":31776768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13500416,"data_stored":19472384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11370496,"data_stored":17051648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9289728,"data_stored":14118912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":14888960,"data_stored":22638592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":14573568,"data_stored":21692416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":9613312,"data_stored":16175104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":22355968,"data_stored":35545088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":7532544,"data_stored":11145216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":17326080,"data_stored":26058752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":10399744,"data_stored":16199680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":17178624,"data_stored":25759744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:16:12.697 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:16:12.699 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T18:16:12.784 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:16:12.782+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:16:12.853 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:12.853 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:12.868 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T18:16:12.884 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:12.881+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:12.972 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:12.972 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:12.985 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T18:16:12.985 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:12.981+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:13.038 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:16:13.038 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:16:13.055 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-09-17T18:16:12.321651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129303091,"num_objects":143,"num_object_clones":90,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":11,"num_read":416,"num_read_kb":91769,"num_write":802,"num_write_kb":134418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1313,"ondisk_log_size":1313,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":696936,"kb_used_data":227004,"kb_used_omap":24,"kb_used_meta":469543,"kb_avail":1509252504,"statfs":{"total":1546188226560,"available":1545474564096,"internally_reserved":0,"allocated":232452096,"data_stored":342895631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":480812113},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17301504,"num_objects":11,"num_object_clones":11,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":3,"num_read":18,"num_read_kb":1294,"num_write":41,"num_write_kb":17392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.009615"},"pg_stats":[{"pgid":"3.f","version":"72'29","reported_seq":218,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.473001+0000","last_change":"2024-09-17T18:16:07.477092+0000","last_active":"2024-09-17T18:16:07.473001+0000","last_peered":"2024-09-17T18:16:07.473001+0000","last_clean":"2024-09-17T18:16:07.473001+0000","last_became_active":"2024-09-17T18:15:28.090920+0000","last_became_peered":"2024-09-17T18:15:28.090920+0000","last_unstale":"2024-09-17T18:16:07.473001+0000","last_undegraded":"2024-09-17T18:16:07.473001+0000","last_fullsized":"2024-09-17T18:16:07.473001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:45.854830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038844610000000002,"stat_sum":{"num_bytes":4882432,"num_objects":5,"num_object_clones":3,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":16,"num_read_kb":12189,"num_write":17,"num_write_kb":4848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3,15,14,2,11,0],"acting":[13,3,15,14,2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.e","version":"72'17","reported_seq":207,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.450459+0000","last_change":"2024-09-17T18:16:07.453130+0000","last_active":"2024-09-17T18:16:07.450459+0000","last_peered":"2024-09-17T18:16:07.450459+0000","last_clean":"2024-09-17T18:16:07.450459+0000","last_became_active":"2024-09-17T18:15:28.110648+0000","last_became_peered":"2024-09-17T18:15:28.110648+0000","last_unstale":"2024-09-17T18:16:07.450459+0000","last_undegraded":"2024-09-17T18:16:07.450459+0000","last_fullsized":"2024-09-17T18:16:07.450459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:51.064067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020508648000000001,"stat_sum":{"num_bytes":1982464,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":14,"num_read_kb":946,"num_write":30,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14,6,13,8,3,12],"acting":[11,14,6,13,8,3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.d","version":"72'260","reported_seq":439,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.519904+0000","last_change":"2024-09-17T18:16:07.521340+0000","last_active":"2024-09-17T18:16:07.519904+0000","last_peered":"2024-09-17T18:16:07.519904+0000","last_clean":"2024-09-17T18:16:07.519904+0000","last_became_active":"2024-09-17T18:15:28.273848+0000","last_became_peered":"2024-09-17T18:15:28.273848+0000","last_unstale":"2024-09-17T18:16:07.519904+0000","last_undegraded":"2024-09-17T18:16:07.519904+0000","last_fullsized":"2024-09-17T18:16:07.519904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:27.471759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.082982156000000001,"stat_sum":{"num_bytes":29212672,"num_objects":30,"num_object_clones":21,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":1,"num_read":67,"num_read_kb":10904,"num_write":171,"num_write_kb":29008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,11,15,9,8,4],"acting":[13,1,11,15,9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.c","version":"72'84","reported_seq":261,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.484144+0000","last_change":"2024-09-17T18:16:07.485476+0000","last_active":"2024-09-17T18:16:07.484144+0000","last_peered":"2024-09-17T18:16:07.484144+0000","last_clean":"2024-09-17T18:16:07.484144+0000","last_became_active":"2024-09-17T18:15:28.112093+0000","last_became_peered":"2024-09-17T18:15:28.112093+0000","last_unstale":"2024-09-17T18:16:07.484144+0000","last_undegraded":"2024-09-17T18:16:07.484144+0000","last_fullsized":"2024-09-17T18:16:07.484144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:31.422779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045114102000000003,"stat_sum":{"num_bytes":7045120,"num_objects":9,"num_object_clones":5,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":16,"num_read_kb":4471,"num_write":29,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,3,7,12,14],"acting":[5,8,13,3,7,12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.b","version":"73'119","reported_seq":294,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.327580+0000","last_change":"2024-09-17T18:16:08.327580+0000","last_active":"2024-09-17T18:16:08.327580+0000","last_peered":"2024-09-17T18:16:08.327580+0000","last_clean":"2024-09-17T18:16:08.327580+0000","last_became_active":"2024-09-17T18:15:28.111526+0000","last_became_peered":"2024-09-17T18:15:28.111526+0000","last_unstale":"2024-09-17T18:16:08.327580+0000","last_undegraded":"2024-09-17T18:16:08.327580+0000","last_fullsized":"2024-09-17T18:16:08.327580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:27.346346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011359917000000001,"stat_sum":{"num_bytes":12337152,"num_objects":13,"num_object_clones":9,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":1,"num_read":18,"num_read_kb":10,"num_write":82,"num_write_kb":12800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,10,12,11,1,14],"acting":[4,0,10,12,11,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.a","version":"72'160","reported_seq":342,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.497756+0000","last_change":"2024-09-17T18:16:07.499383+0000","last_active":"2024-09-17T18:16:07.497756+0000","last_peered":"2024-09-17T18:16:07.497756+0000","last_clean":"2024-09-17T18:16:07.497756+0000","last_became_active":"2024-09-17T18:15:28.089449+0000","last_became_peered":"2024-09-17T18:15:28.089449+0000","last_unstale":"2024-09-17T18:16:07.497756+0000","last_undegraded":"2024-09-17T18:16:07.497756+0000","last_fullsized":"2024-09-17T18:16:07.497756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:41.039584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061304109000000002,"stat_sum":{"num_bytes":12615680,"num_objects":16,"num_object_clones":11,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":2,"num_read":49,"num_read_kb":24860,"num_write":53,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,6,5,3,15,4],"acting":[13,1,6,5,3,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.9","version":"73'137","reported_seq":320,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.374553+0000","last_change":"2024-09-17T18:16:08.375883+0000","last_active":"2024-09-17T18:16:08.374553+0000","last_peered":"2024-09-17T18:16:08.374553+0000","last_clean":"2024-09-17T18:16:08.374553+0000","last_became_active":"2024-09-17T18:15:28.095114+0000","last_became_peered":"2024-09-17T18:15:28.095114+0000","last_unstale":"2024-09-17T18:16:08.374553+0000","last_undegraded":"2024-09-17T18:16:08.374553+0000","last_fullsized":"2024-09-17T18:16:08.374553+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:55.553530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036000785,"stat_sum":{"num_bytes":12615680,"num_objects":13,"num_object_clones":9,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":26,"num_read_kb":5061,"num_write":71,"num_write_kb":14144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,10,11,5,8,3],"acting":[7,2,10,11,5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.8","version":"73'60","reported_seq":245,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.362425+0000","last_change":"2024-09-17T18:16:08.363074+0000","last_active":"2024-09-17T18:16:08.362425+0000","last_peered":"2024-09-17T18:16:08.362425+0000","last_clean":"2024-09-17T18:16:08.362425+0000","last_became_active":"2024-09-17T18:15:28.088066+0000","last_became_peered":"2024-09-17T18:15:28.088066+0000","last_unstale":"2024-09-17T18:16:08.362425+0000","last_undegraded":"2024-09-17T18:16:08.362425+0000","last_fullsized":"2024-09-17T18:16:08.362425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:46.465979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029649089,"stat_sum":{"num_bytes":7143424,"num_objects":7,"num_object_clones":4,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":10,"num_read_kb":7,"num_write":26,"num_write_kb":7664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,11,3,15,1,7],"acting":[6,0,11,3,15,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"1.0","version":"25'112","reported_seq":243,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.333690+0000","last_change":"2024-09-17T18:15:13.924291+0000","last_active":"2024-09-17T18:16:08.333690+0000","last_peered":"2024-09-17T18:16:08.333690+0000","last_clean":"2024-09-17T18:16:08.333690+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:16:08.333690+0000","last_undegraded":"2024-09-17T18:16:08.333690+0000","last_fullsized":"2024-09-17T18:16:08.333690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:15:12.533086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.379235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":112,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.327974+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:16:08.327974+0000","last_peered":"2024-09-17T18:16:08.327974+0000","last_clean":"2024-09-17T18:16:08.327974+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:16:08.327974+0000","last_undegraded":"2024-09-17T18:16:08.327974+0000","last_fullsized":"2024-09-17T18:16:08.327974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"73'46","reported_seq":235,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.348733+0000","last_change":"2024-09-17T18:16:08.349593+0000","last_active":"2024-09-17T18:16:08.348733+0000","last_peered":"2024-09-17T18:16:08.348733+0000","last_clean":"2024-09-17T18:16:08.348733+0000","last_became_active":"2024-09-17T18:15:28.089102+0000","last_became_peered":"2024-09-17T18:15:28.089102+0000","last_unstale":"2024-09-17T18:16:08.348733+0000","last_undegraded":"2024-09-17T18:16:08.348733+0000","last_fullsized":"2024-09-17T18:16:08.348733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.017378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021483182,"stat_sum":{"num_bytes":1015808,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":11,"num_read_kb":114,"num_write":30,"num_write_kb":1488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3,13,1,5,10,7],"acting":[14,3,13,1,5,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":117,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T18:16:11.329902+0000","last_change":"2024-09-17T18:15:16.990099+0000","last_active":"2024-09-17T18:16:11.329902+0000","last_peered":"2024-09-17T18:16:11.329902+0000","last_clean":"2024-09-17T18:16:11.329902+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:16:11.329902+0000","last_undegraded":"2024-09-17T18:16:11.329902+0000","last_fullsized":"2024-09-17T18:16:11.329902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.933228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":184,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.316178+0000","last_change":"2024-09-17T18:16:08.316532+0000","last_active":"2024-09-17T18:16:08.316178+0000","last_peered":"2024-09-17T18:16:08.316178+0000","last_clean":"2024-09-17T18:16:08.316178+0000","last_became_active":"2024-09-17T18:15:28.094455+0000","last_became_peered":"2024-09-17T18:15:28.094455+0000","last_unstale":"2024-09-17T18:16:08.316178+0000","last_undegraded":"2024-09-17T18:16:08.316178+0000","last_fullsized":"2024-09-17T18:16:08.316178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:54.162098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084907400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,14,10,7,3,2],"acting":[4,13,14,10,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":111,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.327833+0000","last_change":"2024-09-17T18:15:17.499886+0000","last_active":"2024-09-17T18:16:08.327833+0000","last_peered":"2024-09-17T18:16:08.327833+0000","last_clean":"2024-09-17T18:16:08.327833+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:16:08.327833+0000","last_undegraded":"2024-09-17T18:16:08.327833+0000","last_fullsized":"2024-09-17T18:16:08.327833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.366017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"73'37","reported_seq":230,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.369470+0000","last_change":"2024-09-17T18:16:08.329798+0000","last_active":"2024-09-17T18:16:08.369470+0000","last_peered":"2024-09-17T18:16:08.369470+0000","last_clean":"2024-09-17T18:16:08.369470+0000","last_became_active":"2024-09-17T18:15:28.273637+0000","last_became_peered":"2024-09-17T18:15:28.273637+0000","last_unstale":"2024-09-17T18:16:08.369470+0000","last_undegraded":"2024-09-17T18:16:08.369470+0000","last_fullsized":"2024-09-17T18:16:08.369470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:29.336818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027687699999999998,"stat_sum":{"num_bytes":9404416,"num_objects":6,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":6254,"num_write":19,"num_write_kb":9184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,9,2,6,15,4],"acting":[3,7,9,2,6,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":111,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.437951+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:16:07.437951+0000","last_peered":"2024-09-17T18:16:07.437951+0000","last_clean":"2024-09-17T18:16:07.437951+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:16:07.437951+0000","last_undegraded":"2024-09-17T18:16:07.437951+0000","last_fullsized":"2024-09-17T18:16:07.437951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:19.851941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"72'37","reported_seq":230,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.449287+0000","last_change":"2024-09-17T18:16:07.454779+0000","last_active":"2024-09-17T18:16:07.449287+0000","last_peered":"2024-09-17T18:16:07.449287+0000","last_clean":"2024-09-17T18:16:07.449287+0000","last_became_active":"2024-09-17T18:15:28.272974+0000","last_became_peered":"2024-09-17T18:15:28.272974+0000","last_unstale":"2024-09-17T18:16:07.449287+0000","last_undegraded":"2024-09-17T18:16:07.449287+0000","last_fullsized":"2024-09-17T18:16:07.449287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:29.867609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023068154,"stat_sum":{"num_bytes":5111808,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":9399,"num_write":16,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4,13,11,2,5],"acting":[10,9,4,13,11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"3.5","version":"72'40","reported_seq":225,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.457947+0000","last_change":"2024-09-17T18:16:07.461328+0000","last_active":"2024-09-17T18:16:07.457947+0000","last_peered":"2024-09-17T18:16:07.457947+0000","last_clean":"2024-09-17T18:16:07.457947+0000","last_became_active":"2024-09-17T18:15:28.275306+0000","last_became_peered":"2024-09-17T18:15:28.275306+0000","last_unstale":"2024-09-17T18:16:07.457947+0000","last_undegraded":"2024-09-17T18:16:07.457947+0000","last_fullsized":"2024-09-17T18:16:07.457947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:27.764346+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.020781956000000001,"stat_sum":{"num_bytes":8765440,"num_objects":4,"num_object_clones":3,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":9,"num_read_kb":488,"num_write":33,"num_write_kb":8560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,11],"acting":[5,8,4,9,12,0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.315708+0000","last_change":"2024-09-17T18:15:16.605178+0000","last_active":"2024-09-17T18:16:08.315708+0000","last_peered":"2024-09-17T18:16:08.315708+0000","last_clean":"2024-09-17T18:16:08.315708+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:16:08.315708+0000","last_undegraded":"2024-09-17T18:16:08.315708+0000","last_fullsized":"2024-09-17T18:16:08.315708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.438554+0000","last_change":"2024-09-17T18:16:07.439472+0000","last_active":"2024-09-17T18:16:07.438554+0000","last_peered":"2024-09-17T18:16:07.438554+0000","last_clean":"2024-09-17T18:16:07.438554+0000","last_became_active":"2024-09-17T18:15:28.090551+0000","last_became_peered":"2024-09-17T18:15:28.090551+0000","last_unstale":"2024-09-17T18:16:07.438554+0000","last_undegraded":"2024-09-17T18:16:07.438554+0000","last_fullsized":"2024-09-17T18:16:07.438554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:50.614888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016630639999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15,4,2,6,10,7],"acting":[8,15,4,2,6,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"5","length":"1"},{"start":"a","length":"1"},{"start":"d","length":"1"},{"start":"12","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.338725+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:16:08.338725+0000","last_peered":"2024-09-17T18:16:08.338725+0000","last_clean":"2024-09-17T18:16:08.338725+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:16:08.338725+0000","last_undegraded":"2024-09-17T18:16:08.338725+0000","last_fullsized":"2024-09-17T18:16:08.338725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:14.501281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"72'92","reported_seq":293,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.316499+0000","last_change":"2024-09-17T18:16:08.316961+0000","last_active":"2024-09-17T18:16:08.316499+0000","last_peered":"2024-09-17T18:16:08.316499+0000","last_clean":"2024-09-17T18:16:08.316499+0000","last_became_active":"2024-09-17T18:15:27.692814+0000","last_became_peered":"2024-09-17T18:15:27.692814+0000","last_unstale":"2024-09-17T18:16:08.316499+0000","last_undegraded":"2024-09-17T18:16:08.316499+0000","last_fullsized":"2024-09-17T18:16:08.316499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:49.942613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010722209999999999,"stat_sum":{"num_bytes":7438336,"num_objects":12,"num_object_clones":7,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":42,"num_read_kb":9833,"num_write":47,"num_write_kb":7264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,0,14,10,13],"acting":[4,11,6,0,14,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.437237+0000","last_change":"2024-09-17T18:15:17.502621+0000","last_active":"2024-09-17T18:16:07.437237+0000","last_peered":"2024-09-17T18:16:07.437237+0000","last_clean":"2024-09-17T18:16:07.437237+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:16:07.437237+0000","last_undegraded":"2024-09-17T18:16:07.437237+0000","last_fullsized":"2024-09-17T18:16:07.437237+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.990534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"76'80","reported_seq":286,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T18:16:11.398424+0000","last_change":"2024-09-17T18:16:11.354450+0000","last_active":"2024-09-17T18:16:11.398424+0000","last_peered":"2024-09-17T18:16:11.398424+0000","last_clean":"2024-09-17T18:16:11.398424+0000","last_became_active":"2024-09-17T18:15:28.272963+0000","last_became_peered":"2024-09-17T18:15:28.272963+0000","last_unstale":"2024-09-17T18:16:11.398424+0000","last_undegraded":"2024-09-17T18:16:11.398424+0000","last_fullsized":"2024-09-17T18:16:11.398424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.745132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021937525999999999,"stat_sum":{"num_bytes":9142272,"num_objects":10,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":20,"num_read_kb":7160,"num_write":31,"num_write_kb":8928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14,6,2,5,9,15],"acting":[0,14,6,2,5,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"5","length":"1"},{"start":"14","length":"1"},{"start":"1a","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T18:16:07.438355+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:16:07.438355+0000","last_peered":"2024-09-17T18:16:07.438355+0000","last_clean":"2024-09-17T18:16:07.438355+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:16:07.438355+0000","last_undegraded":"2024-09-17T18:16:07.438355+0000","last_fullsized":"2024-09-17T18:16:07.438355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:17.193575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":128712704,"num_objects":139,"num_object_clones":90,"num_object_copies":973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":11,"num_read":330,"num_read_kb":91696,"num_write":655,"num_write_kb":131744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":220127232,"data_stored":338046976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1198,"ondisk_log_size":1198,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247823,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49012,"kb_used_data":17820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322828,"statfs":{"total":96636764160,"available":96586575872,"internally_reserved":0,"allocated":18247680,"data_stored":26834701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247823,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42344,"kb_used_data":11148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329496,"statfs":{"total":96636764160,"available":96593403904,"internally_reserved":0,"allocated":11415552,"data_stored":16774381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280527,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35364,"kb_used_data":8336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336476,"statfs":{"total":96636764160,"available":96600551424,"internally_reserved":0,"allocated":8536064,"data_stored":11803727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313232,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44924,"kb_used_data":13736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326916,"statfs":{"total":96636764160,"available":96590761984,"internally_reserved":0,"allocated":14065664,"data_stored":22390673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280527,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44352,"kb_used_data":17324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94327488,"statfs":{"total":96636764160,"available":96591347712,"internally_reserved":0,"allocated":17739776,"data_stored":25975887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313232,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42220,"kb_used_data":15188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94329620,"statfs":{"total":96636764160,"available":96593530880,"internally_reserved":0,"allocated":15552512,"data_stored":21561072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280525,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41312,"kb_used_data":14284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330528,"statfs":{"total":96636764160,"available":96594460672,"internally_reserved":0,"allocated":14626816,"data_stored":20257852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280526,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37516,"kb_used_data":10488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334324,"statfs":{"total":96636764160,"available":96598347776,"internally_reserved":0,"allocated":10739712,"data_stored":16485436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,4,5,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313230,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54000,"kb_used_data":22808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94317840,"statfs":{"total":96636764160,"available":96581468160,"internally_reserved":0,"allocated":23355392,"data_stored":36203580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280526,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47400,"kb_used_data":16208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324440,"statfs":{"total":96636764160,"available":96588226560,"internally_reserved":0,"allocated":16596992,"data_stored":25855213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280526,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36668,"kb_used_data":9640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335172,"statfs":{"total":96636764160,"available":96599216128,"internally_reserved":0,"allocated":9871360,"data_stored":13909052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247821,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45192,"kb_used_data":14000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326648,"statfs":{"total":96636764160,"available":96590487552,"internally_reserved":0,"allocated":14336000,"data_stored":20559085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247823,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52092,"kb_used_data":20896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94319748,"statfs":{"total":96636764160,"available":96583421952,"internally_reserved":0,"allocated":21397504,"data_stored":32322797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247823,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43824,"kb_used_data":12632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328016,"statfs":{"total":96636764160,"available":96591888384,"internally_reserved":0,"allocated":12935168,"data_stored":18165782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247822,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40436,"kb_used_data":9244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331404,"statfs":{"total":96636764160,"available":96595357696,"internally_reserved":0,"allocated":9465856,"data_stored":13853933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280525,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40280,"kb_used_data":13252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331560,"statfs":{"total":96636764160,"available":96595517440,"internally_reserved":0,"allocated":13570048,"data_stored":19942460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12984320,"data_stored":21774336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15220736,"data_stored":24469504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8871936,"data_stored":13344768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14159872,"data_stored":20824064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20860928,"data_stored":31776768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13500416,"data_stored":19472384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11370496,"data_stored":17051648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9289728,"data_stored":14118912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":14888960,"data_stored":22638592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":14573568,"data_stored":21692416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":9613312,"data_stored":16175104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":22355968,"data_stored":35545088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":7532544,"data_stored":11145216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":17326080,"data_stored":26058752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":10399744,"data_stored":16199680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":17178624,"data_stored":25759744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:16:13.057 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-17T18:16:13.057 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T18:16:13.058 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-17T18:16:13.058 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T18:16:13.085 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:13.082+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:13.136 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:13.136 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:13.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T18:16:13.186 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:13.181+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:13.282 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:13.283 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:13.287 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:13.285+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:13.296 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T18:16:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:16:13.384 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: "epoch": 77, 2024-09-17T18:16:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "fsid": "61bbf164-0ac7-4613-95ea-b1c3bf551ccb", 2024-09-17T18:16:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "created": "2024-09-17T18:14:58.620399+0000", 2024-09-17T18:16:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "modified": "2024-09-17T18:16:12.319109+0000", 2024-09-17T18:16:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "last_up_change": "2024-09-17T18:15:12.533086+0000", 2024-09-17T18:16:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "last_in_change": "2024-09-17T18:15:03.053866+0000", 2024-09-17T18:16:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T18:16:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "flags_num": 5801984, 2024-09-17T18:16:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "flags_set": [ 2024-09-17T18:16:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "noscrub", 2024-09-17T18:16:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "pglog_hardlimit", 2024-09-17T18:16:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "purged_snapdirs", 2024-09-17T18:16:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "recovery_deletes", 2024-09-17T18:16:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "sortbitwise" 2024-09-17T18:16:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T18:16:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_version": 6, 2024-09-17T18:16:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T18:16:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T18:16:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T18:16:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_snapshot": "", 2024-09-17T18:16:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_max": 3, 2024-09-17T18:16:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "max_osd": 16, 2024-09-17T18:16:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "require_min_compat_client": "luminous", 2024-09-17T18:16:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "min_compat_client": "jewel", 2024-09-17T18:16:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "require_osd_release": "squid", 2024-09-17T18:16:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_crimson": false, 2024-09-17T18:16:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "pools": [ 2024-09-17T18:16:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "pool": 1, 2024-09-17T18:16:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_name": ".mgr", 2024-09-17T18:16:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "create_time": "2024-09-17T18:15:11.543279+0000", 2024-09-17T18:16:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-17T18:16:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "flags_names": "hashpspool", 2024-09-17T18:16:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "type": 1, 2024-09-17T18:16:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 2, 2024-09-17T18:16:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "min_size": 1, 2024-09-17T18:16:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_rule": 0, 2024-09-17T18:16:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_count": 0, 2024-09-17T18:16:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_target": 0, 2024-09-17T18:16:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T18:16:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T18:16:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "is_stretch_pool": false, 2024-09-17T18:16:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "object_hash": 2, 2024-09-17T18:16:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscale_mode": "off", 2024-09-17T18:16:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num": 1, 2024-09-17T18:16:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_placement_num": 1, 2024-09-17T18:16:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_placement_num_target": 1, 2024-09-17T18:16:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_target": 1, 2024-09-17T18:16:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_pending": 1, 2024-09-17T18:16:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "last_pg_merge_meta": { 2024-09-17T18:16:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "source_pgid": "0.0", 2024-09-17T18:16:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "ready_epoch": 0, 2024-09-17T18:16:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "last_epoch_started": 0, 2024-09-17T18:16:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "last_epoch_clean": 0, 2024-09-17T18:16:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "source_version": "0'0", 2024-09-17T18:16:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "target_version": "0'0" 2024-09-17T18:16:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "last_change": "25", 2024-09-17T18:16:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend": "0", 2024-09-17T18:16:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T18:16:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T18:16:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "auid": 0, 2024-09-17T18:16:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_mode": "selfmanaged", 2024-09-17T18:16:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_seq": 0, 2024-09-17T18:16:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_epoch": 0, 2024-09-17T18:16:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_snaps": [], 2024-09-17T18:16:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "removed_snaps": "[]", 2024-09-17T18:16:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "quota_max_bytes": 0, 2024-09-17T18:16:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "quota_max_objects": 0, 2024-09-17T18:16:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "tiers": [], 2024-09-17T18:16:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "tier_of": -1, 2024-09-17T18:16:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "read_tier": -1, 2024-09-17T18:16:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "write_tier": -1, 2024-09-17T18:16:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_mode": "none", 2024-09-17T18:16:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "target_max_bytes": 0, 2024-09-17T18:16:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "target_max_objects": 0, 2024-09-17T18:16:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T18:16:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T18:16:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T18:16:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_min_flush_age": 0, 2024-09-17T18:16:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_min_evict_age": 0, 2024-09-17T18:16:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "erasure_code_profile": "", 2024-09-17T18:16:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_params": { 2024-09-17T18:16:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "none" 2024-09-17T18:16:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_period": 0, 2024-09-17T18:16:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_count": 0, 2024-09-17T18:16:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "use_gmt_hitset": true, 2024-09-17T18:16:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "min_read_recency_for_promote": 0, 2024-09-17T18:16:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "min_write_recency_for_promote": 0, 2024-09-17T18:16:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T18:16:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_search_last_n": 0, 2024-09-17T18:16:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "grade_table": [], 2024-09-17T18:16:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "stripe_width": 0, 2024-09-17T18:16:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "expected_num_objects": 0, 2024-09-17T18:16:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "fast_read": false, 2024-09-17T18:16:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "options": { 2024-09-17T18:16:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_max": 32, 2024-09-17T18:16:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_min": 1 2024-09-17T18:16:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "application_metadata": { 2024-09-17T18:16:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": {} 2024-09-17T18:16:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "read_balance": { 2024-09-17T18:16:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "score_type": "Fair distribution", 2024-09-17T18:16:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "score_acting": 15.380000114440918, 2024-09-17T18:16:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "score_stable": 15.380000114440918, 2024-09-17T18:16:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "optimal_score": 0.12999999523162842, 2024-09-17T18:16:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "raw_score_acting": 2, 2024-09-17T18:16:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "raw_score_stable": 2, 2024-09-17T18:16:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity_weighted": 1, 2024-09-17T18:16:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "average_primary_affinity": 1, 2024-09-17T18:16:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "average_primary_affinity_weighted": 1 2024-09-17T18:16:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "pool": 2, 2024-09-17T18:16:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_name": "rbd", 2024-09-17T18:16:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "create_time": "2024-09-17T18:15:13.520321+0000", 2024-09-17T18:16:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 8193, 2024-09-17T18:16:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T18:16:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "type": 1, 2024-09-17T18:16:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 2, 2024-09-17T18:16:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "min_size": 1, 2024-09-17T18:16:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_rule": 0, 2024-09-17T18:16:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_count": 0, 2024-09-17T18:16:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_target": 0, 2024-09-17T18:16:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T18:16:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T18:16:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "is_stretch_pool": false, 2024-09-17T18:16:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "object_hash": 2, 2024-09-17T18:16:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscale_mode": "off", 2024-09-17T18:16:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num": 8, 2024-09-17T18:16:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_placement_num": 8, 2024-09-17T18:16:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_placement_num_target": 8, 2024-09-17T18:16:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_target": 8, 2024-09-17T18:16:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_pending": 8, 2024-09-17T18:16:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "last_pg_merge_meta": { 2024-09-17T18:16:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "source_pgid": "0.0", 2024-09-17T18:16:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "ready_epoch": 0, 2024-09-17T18:16:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "last_epoch_started": 0, 2024-09-17T18:16:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "last_epoch_clean": 0, 2024-09-17T18:16:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "source_version": "0'0", 2024-09-17T18:16:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "target_version": "0'0" 2024-09-17T18:16:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "last_change": "27", 2024-09-17T18:16:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend": "0", 2024-09-17T18:16:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T18:16:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T18:16:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "auid": 0, 2024-09-17T18:16:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_mode": "selfmanaged", 2024-09-17T18:16:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_seq": 2, 2024-09-17T18:16:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_epoch": 27, 2024-09-17T18:16:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_snaps": [], 2024-09-17T18:16:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "removed_snaps": "[]", 2024-09-17T18:16:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "quota_max_bytes": 0, 2024-09-17T18:16:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "quota_max_objects": 0, 2024-09-17T18:16:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "tiers": [], 2024-09-17T18:16:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "tier_of": -1, 2024-09-17T18:16:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "read_tier": -1, 2024-09-17T18:16:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "write_tier": -1, 2024-09-17T18:16:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_mode": "none", 2024-09-17T18:16:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "target_max_bytes": 0, 2024-09-17T18:16:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "target_max_objects": 0, 2024-09-17T18:16:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T18:16:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T18:16:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T18:16:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_min_flush_age": 0, 2024-09-17T18:16:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_min_evict_age": 0, 2024-09-17T18:16:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "erasure_code_profile": "", 2024-09-17T18:16:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_params": { 2024-09-17T18:16:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "none" 2024-09-17T18:16:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_period": 0, 2024-09-17T18:16:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_count": 0, 2024-09-17T18:16:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "use_gmt_hitset": true, 2024-09-17T18:16:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "min_read_recency_for_promote": 0, 2024-09-17T18:16:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "min_write_recency_for_promote": 0, 2024-09-17T18:16:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T18:16:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_search_last_n": 0, 2024-09-17T18:16:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "grade_table": [], 2024-09-17T18:16:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "stripe_width": 0, 2024-09-17T18:16:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "expected_num_objects": 0, 2024-09-17T18:16:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "fast_read": false, 2024-09-17T18:16:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "options": {}, 2024-09-17T18:16:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "application_metadata": { 2024-09-17T18:16:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd": {} 2024-09-17T18:16:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "read_balance": { 2024-09-17T18:16:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "score_type": "Fair distribution", 2024-09-17T18:16:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "score_acting": 4, 2024-09-17T18:16:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "score_stable": 4, 2024-09-17T18:16:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "optimal_score": 0.75, 2024-09-17T18:16:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "raw_score_acting": 3, 2024-09-17T18:16:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "raw_score_stable": 3, 2024-09-17T18:16:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity_weighted": 1, 2024-09-17T18:16:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "average_primary_affinity": 1, 2024-09-17T18:16:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "average_primary_affinity_weighted": 1 2024-09-17T18:16:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "pool": 3, 2024-09-17T18:16:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_name": "unique_pool_0", 2024-09-17T18:16:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "create_time": "2024-09-17T18:15:25.661590+0000", 2024-09-17T18:16:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 8193, 2024-09-17T18:16:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T18:16:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "type": 3, 2024-09-17T18:16:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 7, 2024-09-17T18:16:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "min_size": 5, 2024-09-17T18:16:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_rule": 1, 2024-09-17T18:16:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_count": 0, 2024-09-17T18:16:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_target": 0, 2024-09-17T18:16:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T18:16:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T18:16:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "is_stretch_pool": false, 2024-09-17T18:16:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "object_hash": 2, 2024-09-17T18:16:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscale_mode": "off", 2024-09-17T18:16:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num": 16, 2024-09-17T18:16:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_placement_num": 16, 2024-09-17T18:16:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_placement_num_target": 16, 2024-09-17T18:16:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_target": 16, 2024-09-17T18:16:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_pending": 16, 2024-09-17T18:16:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "last_pg_merge_meta": { 2024-09-17T18:16:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "source_pgid": "0.0", 2024-09-17T18:16:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "ready_epoch": 0, 2024-09-17T18:16:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "last_epoch_started": 0, 2024-09-17T18:16:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "last_epoch_clean": 0, 2024-09-17T18:16:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "source_version": "0'0", 2024-09-17T18:16:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "target_version": "0'0" 2024-09-17T18:16:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "last_change": "77", 2024-09-17T18:16:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend": "0", 2024-09-17T18:16:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T18:16:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T18:16:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "auid": 0, 2024-09-17T18:16:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_mode": "selfmanaged", 2024-09-17T18:16:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_seq": 28, 2024-09-17T18:16:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_epoch": 77, 2024-09-17T18:16:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_snaps": [], 2024-09-17T18:16:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "removed_snaps": "[]", 2024-09-17T18:16:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "quota_max_bytes": 0, 2024-09-17T18:16:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "quota_max_objects": 0, 2024-09-17T18:16:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "tiers": [], 2024-09-17T18:16:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "tier_of": -1, 2024-09-17T18:16:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "read_tier": -1, 2024-09-17T18:16:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "write_tier": -1, 2024-09-17T18:16:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_mode": "none", 2024-09-17T18:16:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "target_max_bytes": 0, 2024-09-17T18:16:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "target_max_objects": 0, 2024-09-17T18:16:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T18:16:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T18:16:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T18:16:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_min_flush_age": 0, 2024-09-17T18:16:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_min_evict_age": 0, 2024-09-17T18:16:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "erasure_code_profile": "shecprofile", 2024-09-17T18:16:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_params": { 2024-09-17T18:16:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "none" 2024-09-17T18:16:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_period": 0, 2024-09-17T18:16:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_count": 0, 2024-09-17T18:16:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "use_gmt_hitset": true, 2024-09-17T18:16:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "min_read_recency_for_promote": 0, 2024-09-17T18:16:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "min_write_recency_for_promote": 0, 2024-09-17T18:16:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T18:16:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_search_last_n": 0, 2024-09-17T18:16:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "grade_table": [], 2024-09-17T18:16:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "stripe_width": 16384, 2024-09-17T18:16:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "expected_num_objects": 0, 2024-09-17T18:16:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "fast_read": false, 2024-09-17T18:16:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "options": {}, 2024-09-17T18:16:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "application_metadata": { 2024-09-17T18:16:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "rados": {} 2024-09-17T18:16:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T18:16:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "osds": [ 2024-09-17T18:16:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 0, 2024-09-17T18:16:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "15f80e97-3ed0-4557-b1f4-7ffa88c188dd", 2024-09-17T18:16:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 21, 2024-09-17T18:16:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6802", 2024-09-17T18:16:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6803", 2024-09-17T18:16:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6804", 2024-09-17T18:16:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6805", 2024-09-17T18:16:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6808", 2024-09-17T18:16:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6809", 2024-09-17T18:16:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6806", 2024-09-17T18:16:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6807", 2024-09-17T18:16:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.87:6803/2391985960", 2024-09-17T18:16:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.87:6805/2391985960", 2024-09-17T18:16:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.87:6809/2391985960", 2024-09-17T18:16:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.87:6807/2391985960", 2024-09-17T18:16:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 1, 2024-09-17T18:16:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "a9b255d0-e8d9-4d9a-9118-742dc2ac013f", 2024-09-17T18:16:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 22, 2024-09-17T18:16:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 0, 2024-09-17T18:16:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6816", 2024-09-17T18:16:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6817", 2024-09-17T18:16:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6818", 2024-09-17T18:16:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6819", 2024-09-17T18:16:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6822", 2024-09-17T18:16:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6823", 2024-09-17T18:16:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6820", 2024-09-17T18:16:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6821", 2024-09-17T18:16:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.134:6817/692679878", 2024-09-17T18:16:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.134:6819/692679878", 2024-09-17T18:16:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.134:6823/692679878", 2024-09-17T18:16:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.134:6821/692679878", 2024-09-17T18:16:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 2, 2024-09-17T18:16:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "76ad6be0-c351-4265-893f-cec4a82ecd76", 2024-09-17T18:16:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 22, 2024-09-17T18:16:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 0, 2024-09-17T18:16:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6824", 2024-09-17T18:16:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6825", 2024-09-17T18:16:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6826", 2024-09-17T18:16:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6827", 2024-09-17T18:16:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6830", 2024-09-17T18:16:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6831", 2024-09-17T18:16:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6828", 2024-09-17T18:16:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6829", 2024-09-17T18:16:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.146:6825/197002546", 2024-09-17T18:16:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.146:6827/197002546", 2024-09-17T18:16:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.146:6831/197002546", 2024-09-17T18:16:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.146:6829/197002546", 2024-09-17T18:16:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 3, 2024-09-17T18:16:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "325d4c94-b21d-48cd-8f47-446e6a8bcbcb", 2024-09-17T18:16:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 23, 2024-09-17T18:16:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6816", 2024-09-17T18:16:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6817", 2024-09-17T18:16:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6818", 2024-09-17T18:16:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6819", 2024-09-17T18:16:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6822", 2024-09-17T18:16:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6823", 2024-09-17T18:16:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6820", 2024-09-17T18:16:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6821", 2024-09-17T18:16:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.154:6817/450535216", 2024-09-17T18:16:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.154:6819/450535216", 2024-09-17T18:16:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.154:6823/450535216", 2024-09-17T18:16:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.154:6821/450535216", 2024-09-17T18:16:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 4, 2024-09-17T18:16:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "58b12ec9-29f5-4fea-a835-594fe03cd376", 2024-09-17T18:16:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 23, 2024-09-17T18:16:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6826", 2024-09-17T18:16:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6827", 2024-09-17T18:16:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6828", 2024-09-17T18:16:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6829", 2024-09-17T18:16:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6832", 2024-09-17T18:16:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6833", 2024-09-17T18:16:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6830", 2024-09-17T18:16:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6831", 2024-09-17T18:16:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.87:6827/1911207814", 2024-09-17T18:16:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.87:6829/1911207814", 2024-09-17T18:16:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.87:6833/1911207814", 2024-09-17T18:16:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.87:6831/1911207814", 2024-09-17T18:16:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 5, 2024-09-17T18:16:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "27d3075f-32f4-4032-b0d4-fb7604c8bfda", 2024-09-17T18:16:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 22, 2024-09-17T18:16:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6824", 2024-09-17T18:16:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6825", 2024-09-17T18:16:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6826", 2024-09-17T18:16:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6827", 2024-09-17T18:16:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6830", 2024-09-17T18:16:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6831", 2024-09-17T18:16:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6828", 2024-09-17T18:16:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6829", 2024-09-17T18:16:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.134:6825/391215769", 2024-09-17T18:16:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.134:6827/391215769", 2024-09-17T18:16:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.134:6831/391215769", 2024-09-17T18:16:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.134:6829/391215769", 2024-09-17T18:16:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 6, 2024-09-17T18:16:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "4326073e-338d-47f1-9860-5e44455f49ff", 2024-09-17T18:16:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 23, 2024-09-17T18:16:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6800", 2024-09-17T18:16:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6801", 2024-09-17T18:16:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6802", 2024-09-17T18:16:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6803", 2024-09-17T18:16:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6806", 2024-09-17T18:16:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6807", 2024-09-17T18:16:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6804", 2024-09-17T18:16:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6805", 2024-09-17T18:16:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.146:6801/1495925642", 2024-09-17T18:16:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.146:6803/1495925642", 2024-09-17T18:16:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.146:6807/1495925642", 2024-09-17T18:16:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.146:6805/1495925642", 2024-09-17T18:16:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 7, 2024-09-17T18:16:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "455a2636-b754-4e1f-8933-16cd3fc126fd", 2024-09-17T18:16:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 23, 2024-09-17T18:16:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6808", 2024-09-17T18:16:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6809", 2024-09-17T18:16:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6810", 2024-09-17T18:16:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6811", 2024-09-17T18:16:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6814", 2024-09-17T18:16:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6815", 2024-09-17T18:16:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6812", 2024-09-17T18:16:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6813", 2024-09-17T18:16:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.154:6809/3979156181", 2024-09-17T18:16:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.154:6811/3979156181", 2024-09-17T18:16:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.154:6815/3979156181", 2024-09-17T18:16:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.154:6813/3979156181", 2024-09-17T18:16:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 8, 2024-09-17T18:16:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "e64c05c6-2dce-4abc-8693-3e06b69723b6", 2024-09-17T18:16:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 22, 2024-09-17T18:16:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6818", 2024-09-17T18:16:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6819", 2024-09-17T18:16:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6820", 2024-09-17T18:16:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6821", 2024-09-17T18:16:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6824", 2024-09-17T18:16:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6825", 2024-09-17T18:16:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6822", 2024-09-17T18:16:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6823", 2024-09-17T18:16:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.87:6819/740946583", 2024-09-17T18:16:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.87:6821/740946583", 2024-09-17T18:16:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.87:6825/740946583", 2024-09-17T18:16:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.87:6823/740946583", 2024-09-17T18:16:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 9, 2024-09-17T18:16:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "10bcf7b0-b22d-4a33-b090-b3c8083b6445", 2024-09-17T18:16:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 21, 2024-09-17T18:16:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 24, 2024-09-17T18:16:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6808", 2024-09-17T18:16:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6809", 2024-09-17T18:16:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6810", 2024-09-17T18:16:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6811", 2024-09-17T18:16:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6814", 2024-09-17T18:16:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6815", 2024-09-17T18:16:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6812", 2024-09-17T18:16:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6813", 2024-09-17T18:16:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.134:6809/2811218890", 2024-09-17T18:16:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.134:6811/2811218890", 2024-09-17T18:16:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.134:6815/2811218890", 2024-09-17T18:16:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.134:6813/2811218890", 2024-09-17T18:16:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 10, 2024-09-17T18:16:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "a69d3d5e-353a-41aa-8b1c-fe7b0a68865f", 2024-09-17T18:16:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 22, 2024-09-17T18:16:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6816", 2024-09-17T18:16:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6817", 2024-09-17T18:16:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6818", 2024-09-17T18:16:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6819", 2024-09-17T18:16:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6822", 2024-09-17T18:16:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6823", 2024-09-17T18:16:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6820", 2024-09-17T18:16:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6821", 2024-09-17T18:16:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.146:6817/1660646458", 2024-09-17T18:16:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.146:6819/1660646458", 2024-09-17T18:16:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.146:6823/1660646458", 2024-09-17T18:16:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.146:6821/1660646458", 2024-09-17T18:16:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 11, 2024-09-17T18:16:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "0a0e715b-1804-4e14-87e1-8c5de231b01d", 2024-09-17T18:16:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 21, 2024-09-17T18:16:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6800", 2024-09-17T18:16:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6801", 2024-09-17T18:16:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6802", 2024-09-17T18:16:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6803", 2024-09-17T18:16:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6806", 2024-09-17T18:16:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6807", 2024-09-17T18:16:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6804", 2024-09-17T18:16:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6805", 2024-09-17T18:16:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.154:6801/2080834051", 2024-09-17T18:16:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.154:6803/2080834051", 2024-09-17T18:16:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.154:6807/2080834051", 2024-09-17T18:16:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.154:6805/2080834051", 2024-09-17T18:16:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 12, 2024-09-17T18:16:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "bdb1a692-4d6e-4a0c-a21f-db10b3af5025", 2024-09-17T18:16:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 22, 2024-09-17T18:16:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 0, 2024-09-17T18:16:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6810", 2024-09-17T18:16:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6811", 2024-09-17T18:16:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6812", 2024-09-17T18:16:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6813", 2024-09-17T18:16:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6816", 2024-09-17T18:16:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6817", 2024-09-17T18:16:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6814", 2024-09-17T18:16:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6815", 2024-09-17T18:16:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.87:6811/249183944", 2024-09-17T18:16:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.87:6813/249183944", 2024-09-17T18:16:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.87:6817/249183944", 2024-09-17T18:16:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.87:6815/249183944", 2024-09-17T18:16:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 13, 2024-09-17T18:16:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "225fb253-25c2-4a10-a169-97971cb06e6c", 2024-09-17T18:16:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 22, 2024-09-17T18:16:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6800", 2024-09-17T18:16:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6801", 2024-09-17T18:16:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6802", 2024-09-17T18:16:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6803", 2024-09-17T18:16:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6806", 2024-09-17T18:16:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6807", 2024-09-17T18:16:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6804", 2024-09-17T18:16:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6805", 2024-09-17T18:16:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.134:6801/3397465529", 2024-09-17T18:16:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.134:6803/3397465529", 2024-09-17T18:16:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.134:6807/3397465529", 2024-09-17T18:16:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.134:6805/3397465529", 2024-09-17T18:16:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 14, 2024-09-17T18:16:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "43d0e878-9725-4208-ab75-04407b592477", 2024-09-17T18:16:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 23, 2024-09-17T18:16:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6808", 2024-09-17T18:16:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6809", 2024-09-17T18:16:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6810", 2024-09-17T18:16:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6811", 2024-09-17T18:16:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6814", 2024-09-17T18:16:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6815", 2024-09-17T18:16:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6812", 2024-09-17T18:16:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6813", 2024-09-17T18:16:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.146:6809/950976813", 2024-09-17T18:16:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.146:6811/950976813", 2024-09-17T18:16:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.146:6815/950976813", 2024-09-17T18:16:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.146:6813/950976813", 2024-09-17T18:16:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 15, 2024-09-17T18:16:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "1c97e00d-ee0d-4bed-953c-c99a67afe33e", 2024-09-17T18:16:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 23, 2024-09-17T18:16:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 0, 2024-09-17T18:16:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6824", 2024-09-17T18:16:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6825", 2024-09-17T18:16:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6826", 2024-09-17T18:16:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6827", 2024-09-17T18:16:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6830", 2024-09-17T18:16:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6831", 2024-09-17T18:16:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6828", 2024-09-17T18:16:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6829", 2024-09-17T18:16:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.154:6825/3670919160", 2024-09-17T18:16:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.154:6827/3670919160", 2024-09-17T18:16:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.154:6831/3670919160", 2024-09-17T18:16:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.154:6829/3670919160", 2024-09-17T18:16:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T18:16:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_xinfo": [ 2024-09-17T18:16:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 0, 2024-09-17T18:16:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.473183+0000", 2024-09-17T18:16:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 1, 2024-09-17T18:16:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:16:11.844633+0000", 2024-09-17T18:16:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 2, 2024-09-17T18:16:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.988470+0000", 2024-09-17T18:16:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 3, 2024-09-17T18:16:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.802332+0000", 2024-09-17T18:16:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 4, 2024-09-17T18:16:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:10.166944+0000", 2024-09-17T18:16:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 5, 2024-09-17T18:16:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.996537+0000", 2024-09-17T18:16:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 6, 2024-09-17T18:16:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.773040+0000", 2024-09-17T18:16:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 7, 2024-09-17T18:16:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.794981+0000", 2024-09-17T18:16:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 8, 2024-09-17T18:16:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.785738+0000", 2024-09-17T18:16:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 9, 2024-09-17T18:16:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.445477+0000", 2024-09-17T18:16:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 10, 2024-09-17T18:16:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:16:11.740729+0000", 2024-09-17T18:16:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 11, 2024-09-17T18:16:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.296968+0000", 2024-09-17T18:16:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 12, 2024-09-17T18:16:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.903544+0000", 2024-09-17T18:16:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 13, 2024-09-17T18:16:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.548371+0000", 2024-09-17T18:16:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 14, 2024-09-17T18:16:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:10.280958+0000", 2024-09-17T18:16:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 15, 2024-09-17T18:16:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:10.079389+0000", 2024-09-17T18:16:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T18:16:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_upmap": [], 2024-09-17T18:16:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_upmap_items": [], 2024-09-17T18:16:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_upmap_primaries": [], 2024-09-17T18:16:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_temp": [], 2024-09-17T18:16:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_temp": [], 2024-09-17T18:16:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklist": {}, 2024-09-17T18:16:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "range_blocklist": {}, 2024-09-17T18:16:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "erasure_code_profiles": { 2024-09-17T18:16:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "default": { 2024-09-17T18:16:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-failure-domain": "osd", 2024-09-17T18:16:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "k": "2", 2024-09-17T18:16:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "m": "1", 2024-09-17T18:16:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "plugin": "jerasure", 2024-09-17T18:16:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "technique": "reed_sol_van" 2024-09-17T18:16:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "shecprofile": { 2024-09-17T18:16:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "c": "2", 2024-09-17T18:16:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-device-class": "", 2024-09-17T18:16:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-failure-domain": "osd", 2024-09-17T18:16:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-num-failure-domains": "0", 2024-09-17T18:16:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-osds-per-failure-domain": "0", 2024-09-17T18:16:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-root": "default", 2024-09-17T18:16:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "k": "4", 2024-09-17T18:16:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "m": "3", 2024-09-17T18:16:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "shecprofile", 2024-09-17T18:16:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "plugin": "shec", 2024-09-17T18:16:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "technique": "multiple" 2024-09-17T18:16:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "removed_snaps_queue": [ 2024-09-17T18:16:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "pool": 3, 2024-09-17T18:16:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "snaps": [ 2024-09-17T18:16:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "begin": 5, 2024-09-17T18:16:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "length": 1 2024-09-17T18:16:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "begin": 19, 2024-09-17T18:16:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "length": 2 2024-09-17T18:16:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "begin": 26, 2024-09-17T18:16:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "length": 2 2024-09-17T18:16:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T18:16:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "new_removed_snaps": [ 2024-09-17T18:16:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "pool": 3, 2024-09-17T18:16:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "snaps": [ 2024-09-17T18:16:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "begin": 19, 2024-09-17T18:16:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "length": 1 2024-09-17T18:16:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T18:16:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "new_purged_snaps": [], 2024-09-17T18:16:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_node_flags": {}, 2024-09-17T18:16:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "device_class_flags": {}, 2024-09-17T18:16:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "stretch_mode": { 2024-09-17T18:16:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "stretch_mode_enabled": false, 2024-09-17T18:16:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "stretch_bucket_count": 0, 2024-09-17T18:16:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "degraded_stretch_mode": 0, 2024-09-17T18:16:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "recovering_stretch_mode": 0, 2024-09-17T18:16:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "stretch_mode_bucket": 0 2024-09-17T18:16:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:13.518 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:13.520 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:13.520 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:13.522 INFO:tasks.thrashosds.thrasher:j is {'epoch': 77, 'fsid': '61bbf164-0ac7-4613-95ea-b1c3bf551ccb', 'created': '2024-09-17T18:14:58.620399+0000', 'modified': '2024-09-17T18:16:12.319109+0000', 'last_up_change': '2024-09-17T18:15:12.533086+0000', 'last_in_change': '2024-09-17T18:15:03.053866+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 16, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T18:15:11.543279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 15.380000114440918, 'score_stable': 15.380000114440918, 'optimal_score': 0.12999999523162842, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T18:15:13.520321+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 27, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.75, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-17T18:15:25.661590+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 3, 'size': 7, 'min_size': 5, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 28, 'snap_epoch': 77, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'shecprofile', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 16384, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '15f80e97-3ed0-4557-b1f4-7ffa88c188dd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 21, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6802', 'nonce': 2391985960}, {'type': 'v1', 'addr': '172.21.15.87:6803', 'nonce': 2391985960}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6804', 'nonce': 2391985960}, {'type': 'v1', 'addr': '172.21.15.87:6805', 'nonce': 2391985960}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6808', 'nonce': 2391985960}, {'type': 'v1', 'addr': '172.21.15.87:6809', 'nonce': 2391985960}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6806', 'nonce': 2391985960}, {'type': 'v1', 'addr': '172.21.15.87:6807', 'nonce': 2391985960}]}, 'public_addr': '172.21.15.87:6803/2391985960', 'cluster_addr': '172.21.15.87:6805/2391985960', 'heartbeat_back_addr': '172.21.15.87:6809/2391985960', 'heartbeat_front_addr': '172.21.15.87:6807/2391985960', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a9b255d0-e8d9-4d9a-9118-742dc2ac013f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6816', 'nonce': 692679878}, {'type': 'v1', 'addr': '172.21.15.134:6817', 'nonce': 692679878}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6818', 'nonce': 692679878}, {'type': 'v1', 'addr': '172.21.15.134:6819', 'nonce': 692679878}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6822', 'nonce': 692679878}, {'type': 'v1', 'addr': '172.21.15.134:6823', 'nonce': 692679878}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6820', 'nonce': 692679878}, {'type': 'v1', 'addr': '172.21.15.134:6821', 'nonce': 692679878}]}, 'public_addr': '172.21.15.134:6817/692679878', 'cluster_addr': '172.21.15.134:6819/692679878', 'heartbeat_back_addr': '172.21.15.134:6823/692679878', 'heartbeat_front_addr': '172.21.15.134:6821/692679878', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '76ad6be0-c351-4265-893f-cec4a82ecd76', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6824', 'nonce': 197002546}, {'type': 'v1', 'addr': '172.21.15.146:6825', 'nonce': 197002546}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6826', 'nonce': 197002546}, {'type': 'v1', 'addr': '172.21.15.146:6827', 'nonce': 197002546}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6830', 'nonce': 197002546}, {'type': 'v1', 'addr': '172.21.15.146:6831', 'nonce': 197002546}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6828', 'nonce': 197002546}, {'type': 'v1', 'addr': '172.21.15.146:6829', 'nonce': 197002546}]}, 'public_addr': '172.21.15.146:6825/197002546', 'cluster_addr': '172.21.15.146:6827/197002546', 'heartbeat_back_addr': '172.21.15.146:6831/197002546', 'heartbeat_front_addr': '172.21.15.146:6829/197002546', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '325d4c94-b21d-48cd-8f47-446e6a8bcbcb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 23, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6816', 'nonce': 450535216}, {'type': 'v1', 'addr': '172.21.15.154:6817', 'nonce': 450535216}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6818', 'nonce': 450535216}, {'type': 'v1', 'addr': '172.21.15.154:6819', 'nonce': 450535216}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6822', 'nonce': 450535216}, {'type': 'v1', 'addr': '172.21.15.154:6823', 'nonce': 450535216}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6820', 'nonce': 450535216}, {'type': 'v1', 'addr': '172.21.15.154:6821', 'nonce': 450535216}]}, 'public_addr': '172.21.15.154:6817/450535216', 'cluster_addr': '172.21.15.154:6819/450535216', 'heartbeat_back_addr': '172.21.15.154:6823/450535216', 'heartbeat_front_addr': '172.21.15.154:6821/450535216', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '58b12ec9-29f5-4fea-a835-594fe03cd376', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 23, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6826', 'nonce': 1911207814}, {'type': 'v1', 'addr': '172.21.15.87:6827', 'nonce': 1911207814}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6828', 'nonce': 1911207814}, {'type': 'v1', 'addr': '172.21.15.87:6829', 'nonce': 1911207814}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6832', 'nonce': 1911207814}, {'type': 'v1', 'addr': '172.21.15.87:6833', 'nonce': 1911207814}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6830', 'nonce': 1911207814}, {'type': 'v1', 'addr': '172.21.15.87:6831', 'nonce': 1911207814}]}, 'public_addr': '172.21.15.87:6827/1911207814', 'cluster_addr': '172.21.15.87:6829/1911207814', 'heartbeat_back_addr': '172.21.15.87:6833/1911207814', 'heartbeat_front_addr': '172.21.15.87:6831/1911207814', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '27d3075f-32f4-4032-b0d4-fb7604c8bfda', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 391215769}, {'type': 'v1', 'addr': '172.21.15.134:6825', 'nonce': 391215769}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 391215769}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 391215769}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6830', 'nonce': 391215769}, {'type': 'v1', 'addr': '172.21.15.134:6831', 'nonce': 391215769}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6828', 'nonce': 391215769}, {'type': 'v1', 'addr': '172.21.15.134:6829', 'nonce': 391215769}]}, 'public_addr': '172.21.15.134:6825/391215769', 'cluster_addr': '172.21.15.134:6827/391215769', 'heartbeat_back_addr': '172.21.15.134:6831/391215769', 'heartbeat_front_addr': '172.21.15.134:6829/391215769', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '4326073e-338d-47f1-9860-5e44455f49ff', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 23, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6800', 'nonce': 1495925642}, {'type': 'v1', 'addr': '172.21.15.146:6801', 'nonce': 1495925642}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6802', 'nonce': 1495925642}, {'type': 'v1', 'addr': '172.21.15.146:6803', 'nonce': 1495925642}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6806', 'nonce': 1495925642}, {'type': 'v1', 'addr': '172.21.15.146:6807', 'nonce': 1495925642}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6804', 'nonce': 1495925642}, {'type': 'v1', 'addr': '172.21.15.146:6805', 'nonce': 1495925642}]}, 'public_addr': '172.21.15.146:6801/1495925642', 'cluster_addr': '172.21.15.146:6803/1495925642', 'heartbeat_back_addr': '172.21.15.146:6807/1495925642', 'heartbeat_front_addr': '172.21.15.146:6805/1495925642', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '455a2636-b754-4e1f-8933-16cd3fc126fd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 23, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6808', 'nonce': 3979156181}, {'type': 'v1', 'addr': '172.21.15.154:6809', 'nonce': 3979156181}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6810', 'nonce': 3979156181}, {'type': 'v1', 'addr': '172.21.15.154:6811', 'nonce': 3979156181}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6814', 'nonce': 3979156181}, {'type': 'v1', 'addr': '172.21.15.154:6815', 'nonce': 3979156181}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6812', 'nonce': 3979156181}, {'type': 'v1', 'addr': '172.21.15.154:6813', 'nonce': 3979156181}]}, 'public_addr': '172.21.15.154:6809/3979156181', 'cluster_addr': '172.21.15.154:6811/3979156181', 'heartbeat_back_addr': '172.21.15.154:6815/3979156181', 'heartbeat_front_addr': '172.21.15.154:6813/3979156181', 'state': ['exists', 'up']}, {'osd': 8, 'uuid': 'e64c05c6-2dce-4abc-8693-3e06b69723b6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6818', 'nonce': 740946583}, {'type': 'v1', 'addr': '172.21.15.87:6819', 'nonce': 740946583}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6820', 'nonce': 740946583}, {'type': 'v1', 'addr': '172.21.15.87:6821', 'nonce': 740946583}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6824', 'nonce': 740946583}, {'type': 'v1', 'addr': '172.21.15.87:6825', 'nonce': 740946583}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6822', 'nonce': 740946583}, {'type': 'v1', 'addr': '172.21.15.87:6823', 'nonce': 740946583}]}, 'public_addr': '172.21.15.87:6819/740946583', 'cluster_addr': '172.21.15.87:6821/740946583', 'heartbeat_back_addr': '172.21.15.87:6825/740946583', 'heartbeat_front_addr': '172.21.15.87:6823/740946583', 'state': ['exists', 'up']}, {'osd': 9, 'uuid': '10bcf7b0-b22d-4a33-b090-b3c8083b6445', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 21, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6808', 'nonce': 2811218890}, {'type': 'v1', 'addr': '172.21.15.134:6809', 'nonce': 2811218890}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6810', 'nonce': 2811218890}, {'type': 'v1', 'addr': '172.21.15.134:6811', 'nonce': 2811218890}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6814', 'nonce': 2811218890}, {'type': 'v1', 'addr': '172.21.15.134:6815', 'nonce': 2811218890}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6812', 'nonce': 2811218890}, {'type': 'v1', 'addr': '172.21.15.134:6813', 'nonce': 2811218890}]}, 'public_addr': '172.21.15.134:6809/2811218890', 'cluster_addr': '172.21.15.134:6811/2811218890', 'heartbeat_back_addr': '172.21.15.134:6815/2811218890', 'heartbeat_front_addr': '172.21.15.134:6813/2811218890', 'state': ['exists', 'up']}, {'osd': 10, 'uuid': 'a69d3d5e-353a-41aa-8b1c-fe7b0a68865f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6816', 'nonce': 1660646458}, {'type': 'v1', 'addr': '172.21.15.146:6817', 'nonce': 1660646458}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6818', 'nonce': 1660646458}, {'type': 'v1', 'addr': '172.21.15.146:6819', 'nonce': 1660646458}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6822', 'nonce': 1660646458}, {'type': 'v1', 'addr': '172.21.15.146:6823', 'nonce': 1660646458}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6820', 'nonce': 1660646458}, {'type': 'v1', 'addr': '172.21.15.146:6821', 'nonce': 1660646458}]}, 'public_addr': '172.21.15.146:6817/1660646458', 'cluster_addr': '172.21.15.146:6819/1660646458', 'heartbeat_back_addr': '172.21.15.146:6823/1660646458', 'heartbeat_front_addr': '172.21.15.146:6821/1660646458', 'state': ['exists', 'up']}, {'osd': 11, 'uuid': '0a0e715b-1804-4e14-87e1-8c5de231b01d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 21, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6800', 'nonce': 2080834051}, {'type': 'v1', 'addr': '172.21.15.154:6801', 'nonce': 2080834051}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6802', 'nonce': 2080834051}, {'type': 'v1', 'addr': '172.21.15.154:6803', 'nonce': 2080834051}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6806', 'nonce': 2080834051}, {'type': 'v1', 'addr': '172.21.15.154:6807', 'nonce': 2080834051}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6804', 'nonce': 2080834051}, {'type': 'v1', 'addr': '172.21.15.154:6805', 'nonce': 2080834051}]}, 'public_addr': '172.21.15.154:6801/2080834051', 'cluster_addr': '172.21.15.154:6803/2080834051', 'heartbeat_back_addr': '172.21.15.154:6807/2080834051', 'heartbeat_front_addr': '172.21.15.154:6805/2080834051', 'state': ['exists', 'up']}, {'osd': 12, 'uuid': 'bdb1a692-4d6e-4a0c-a21f-db10b3af5025', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6810', 'nonce': 249183944}, {'type': 'v1', 'addr': '172.21.15.87:6811', 'nonce': 249183944}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6812', 'nonce': 249183944}, {'type': 'v1', 'addr': '172.21.15.87:6813', 'nonce': 249183944}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6816', 'nonce': 249183944}, {'type': 'v1', 'addr': '172.21.15.87:6817', 'nonce': 249183944}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6814', 'nonce': 249183944}, {'type': 'v1', 'addr': '172.21.15.87:6815', 'nonce': 249183944}]}, 'public_addr': '172.21.15.87:6811/249183944', 'cluster_addr': '172.21.15.87:6813/249183944', 'heartbeat_back_addr': '172.21.15.87:6817/249183944', 'heartbeat_front_addr': '172.21.15.87:6815/249183944', 'state': ['exists', 'up']}, {'osd': 13, 'uuid': '225fb253-25c2-4a10-a169-97971cb06e6c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 3397465529}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 3397465529}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 3397465529}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 3397465529}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 3397465529}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 3397465529}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 3397465529}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 3397465529}]}, 'public_addr': '172.21.15.134:6801/3397465529', 'cluster_addr': '172.21.15.134:6803/3397465529', 'heartbeat_back_addr': '172.21.15.134:6807/3397465529', 'heartbeat_front_addr': '172.21.15.134:6805/3397465529', 'state': ['exists', 'up']}, {'osd': 14, 'uuid': '43d0e878-9725-4208-ab75-04407b592477', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 23, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6808', 'nonce': 950976813}, {'type': 'v1', 'addr': '172.21.15.146:6809', 'nonce': 950976813}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6810', 'nonce': 950976813}, {'type': 'v1', 'addr': '172.21.15.146:6811', 'nonce': 950976813}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6814', 'nonce': 950976813}, {'type': 'v1', 'addr': '172.21.15.146:6815', 'nonce': 950976813}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6812', 'nonce': 950976813}, {'type': 'v1', 'addr': '172.21.15.146:6813', 'nonce': 950976813}]}, 'public_addr': '172.21.15.146:6809/950976813', 'cluster_addr': '172.21.15.146:6811/950976813', 'heartbeat_back_addr': '172.21.15.146:6815/950976813', 'heartbeat_front_addr': '172.21.15.146:6813/950976813', 'state': ['exists', 'up']}, {'osd': 15, 'uuid': '1c97e00d-ee0d-4bed-953c-c99a67afe33e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 23, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6824', 'nonce': 3670919160}, {'type': 'v1', 'addr': '172.21.15.154:6825', 'nonce': 3670919160}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6826', 'nonce': 3670919160}, {'type': 'v1', 'addr': '172.21.15.154:6827', 'nonce': 3670919160}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6830', 'nonce': 3670919160}, {'type': 'v1', 'addr': '172.21.15.154:6831', 'nonce': 3670919160}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6828', 'nonce': 3670919160}, {'type': 'v1', 'addr': '172.21.15.154:6829', 'nonce': 3670919160}]}, 'public_addr': '172.21.15.154:6825/3670919160', 'cluster_addr': '172.21.15.154:6827/3670919160', 'heartbeat_back_addr': '172.21.15.154:6831/3670919160', 'heartbeat_front_addr': '172.21.15.154:6829/3670919160', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.473183+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:16:11.844633+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.988470+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.802332+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:10.166944+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.996537+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.773040+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.794981+0000', 'dead_epoch': 0}, {'osd': 8, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.785738+0000', 'dead_epoch': 0}, {'osd': 9, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.445477+0000', 'dead_epoch': 0}, {'osd': 10, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:16:11.740729+0000', 'dead_epoch': 0}, {'osd': 11, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.296968+0000', 'dead_epoch': 0}, {'osd': 12, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.903544+0000', 'dead_epoch': 0}, {'osd': 13, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.548371+0000', 'dead_epoch': 0}, {'osd': 14, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:10.280958+0000', 'dead_epoch': 0}, {'osd': 15, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:10.079389+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}, 'shecprofile': {'c': '2', 'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-num-failure-domains': '0', 'crush-osds-per-failure-domain': '0', 'crush-root': 'default', 'k': '4', 'm': '3', 'name': 'shecprofile', 'plugin': 'shec', 'technique': 'multiple'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 5, 'length': 1}, {'begin': 19, 'length': 2}, {'begin': 26, 'length': 2}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 19, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T18:16:13.522 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:16:13.522 INFO:tasks.rados.rados.0.smithi154.stdout:310: done (2 left) 2024-09-17T18:16:13.522 INFO:tasks.rados.rados.0.smithi154.stdout:313: done (1 left) 2024-09-17T18:16:13.522 INFO:tasks.rados.rados.0.smithi154.stdout:314: read oid 18 snap 22 2024-09-17T18:16:13.522 INFO:tasks.rados.rados.0.smithi154.stdout:314: expect (ObjNum 5 snap 0 seq_num 5) 2024-09-17T18:16:13.522 INFO:tasks.rados.rados.0.smithi154.stdout:315: read oid 23 snap -1 2024-09-17T18:16:13.523 INFO:tasks.rados.rados.0.smithi154.stdout:315: expect (ObjNum 97 snap 16 seq_num 97) 2024-09-17T18:16:13.523 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 26 current snap is 27 2024-09-17T18:16:13.523 INFO:tasks.rados.rados.0.smithi154.stdout:312: finishing write tid 3 to smithi15432074-16 2024-09-17T18:16:13.523 INFO:tasks.rados.rados.0.smithi154.stdout:312: finishing write tid 4 to smithi15432074-16 2024-09-17T18:16:13.523 INFO:tasks.rados.rados.0.smithi154.stdout:312: finishing write tid 5 to smithi15432074-16 2024-09-17T18:16:13.523 INFO:tasks.rados.rados.0.smithi154.stdout:312: finishing write tid 6 to smithi15432074-16 2024-09-17T18:16:13.523 INFO:tasks.rados.rados.0.smithi154.stdout:312: oid 16 updating version 0 to 58 2024-09-17T18:16:13.523 INFO:tasks.rados.rados.0.smithi154.stdout:312: oid 16 updating version 58 to 59 2024-09-17T18:16:13.523 INFO:tasks.rados.rados.0.smithi154.stdout:312: oid 16 updating version 59 to 60 2024-09-17T18:16:13.523 INFO:tasks.rados.rados.0.smithi154.stdout:312: oid 16 updating version 60 to 61 2024-09-17T18:16:13.523 INFO:tasks.rados.rados.0.smithi154.stdout:312: oid 16 version 61 is already newer than 57 2024-09-17T18:16:13.523 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 16 v 61 (ObjNum 135 snap 27 seq_num 135) dirty exists 2024-09-17T18:16:13.523 INFO:tasks.rados.rados.0.smithi154.stdout:312: left oid 16 (ObjNum 135 snap 27 seq_num 135) 2024-09-17T18:16:13.524 INFO:tasks.rados.rados.0.smithi154.stdout:316: seq_num 136 ranges {3358720=737280,4096000=770048,4866048=540672,5406720=245760} 2024-09-17T18:16:13.524 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T18:16:13.525 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:13.518+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:13.525 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:13.522+0000 7f94cf16b640 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 19 after trimming was started 2024-09-17T18:16:13.552 INFO:tasks.rados.rados.0.smithi154.stdout:316: writing smithi15432074-26 from 3358720 to 4096000 tid 1 2024-09-17T18:16:13.560 INFO:tasks.rados.rados.0.smithi154.stdout:316: writing smithi15432074-26 from 4096000 to 4866048 tid 2 2024-09-17T18:16:13.565 INFO:tasks.rados.rados.0.smithi154.stdout:316: writing smithi15432074-26 from 4866048 to 5406720 tid 3 2024-09-17T18:16:13.568 INFO:tasks.rados.rados.0.smithi154.stdout:316: writing smithi15432074-26 from 5406720 to 5652480 tid 4 2024-09-17T18:16:13.568 INFO:tasks.rados.rados.0.smithi154.stdout:312: done (3 left) 2024-09-17T18:16:13.569 INFO:tasks.rados.rados.0.smithi154.stdout:317: read oid 2 snap -1 2024-09-17T18:16:13.569 INFO:tasks.rados.rados.0.smithi154.stdout:317: expect (ObjNum 100 snap 19 seq_num 100) 2024-09-17T18:16:13.569 INFO:tasks.rados.rados.0.smithi154.stdout:318: setattr oid 46 current snap is 27 2024-09-17T18:16:13.569 INFO:tasks.rados.rados.0.smithi154.stdout:314: expect (ObjNum 5 snap 0 seq_num 5) 2024-09-17T18:16:13.569 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:13.572 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:13.576 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:13.580 INFO:tasks.rados.rados.0.smithi154.stdout:315: expect (ObjNum 97 snap 16 seq_num 97) 2024-09-17T18:16:13.595 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 963876 2024-09-17T18:16:13.620 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:13.617+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:13.659 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:13.659 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:13.674 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T18:16:13.693 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1684066 2024-09-17T18:16:13.721 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:16:13.718+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:16:13.789 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 4404241 2024-09-17T18:16:13.794 INFO:tasks.rados.rados.0.smithi154.stdout:316: finishing write tid 1 to smithi15432074-26 2024-09-17T18:16:13.794 INFO:tasks.rados.rados.0.smithi154.stdout:316: finishing write tid 2 to smithi15432074-26 2024-09-17T18:16:13.794 INFO:tasks.rados.rados.0.smithi154.stdout:316: finishing write tid 3 to smithi15432074-26 2024-09-17T18:16:13.794 INFO:tasks.rados.rados.0.smithi154.stdout:316: finishing write tid 4 to smithi15432074-26 2024-09-17T18:16:13.794 INFO:tasks.rados.rados.0.smithi154.stdout:316: finishing write tid 5 to smithi15432074-26 2024-09-17T18:16:13.795 INFO:tasks.rados.rados.0.smithi154.stdout:316: finishing write tid 6 to smithi15432074-26 2024-09-17T18:16:13.795 INFO:tasks.rados.rados.0.smithi154.stdout:316: oid 26 updating version 0 to 66 2024-09-17T18:16:13.795 INFO:tasks.rados.rados.0.smithi154.stdout:316: oid 26 version 66 is already newer than 64 2024-09-17T18:16:13.795 INFO:tasks.rados.rados.0.smithi154.stdout:316: oid 26 version 66 is already newer than 63 2024-09-17T18:16:13.795 INFO:tasks.rados.rados.0.smithi154.stdout:316: oid 26 updating version 66 to 67 2024-09-17T18:16:13.795 INFO:tasks.rados.rados.0.smithi154.stdout:316: oid 26 version 67 is already newer than 65 2024-09-17T18:16:13.795 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 26 v 67 (ObjNum 136 snap 27 seq_num 136) dirty exists 2024-09-17T18:16:13.795 INFO:tasks.rados.rados.0.smithi154.stdout:316: left oid 26 (ObjNum 136 snap 27 seq_num 136) 2024-09-17T18:16:13.795 INFO:tasks.rados.rados.0.smithi154.stdout:317: expect (ObjNum 100 snap 19 seq_num 100) 2024-09-17T18:16:13.796 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 287329 2024-09-17T18:16:13.797 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:13.797 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:13.811 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T18:16:13.821 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:13.818+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:13.837 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1058018 2024-09-17T18:16:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:16:13.874 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:16:13.880 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 2642073 2024-09-17T18:16:13.889 INFO:tasks.rados.rados.0.smithi154.stdout:314: done (4 left) 2024-09-17T18:16:13.889 INFO:tasks.rados.rados.0.smithi154.stdout:315: done (3 left) 2024-09-17T18:16:13.889 INFO:tasks.rados.rados.0.smithi154.stdout:316: done (2 left) 2024-09-17T18:16:13.889 INFO:tasks.rados.rados.0.smithi154.stdout:317: done (1 left) 2024-09-17T18:16:13.889 INFO:tasks.rados.rados.0.smithi154.stdout:319: delete oid 42 current snap is 27 2024-09-17T18:16:13.893 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-09-17T18:16:13.512267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127861299,"num_objects":143,"num_object_clones":90,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":11,"num_read":430,"num_read_kb":102675,"num_write":803,"num_write_kb":135026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1406,"ondisk_log_size":1406,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":708692,"kb_used_data":234552,"kb_used_omap":24,"kb_used_meta":473703,"kb_avail":1509240748,"statfs":{"total":1546188226560,"available":1545462525952,"internally_reserved":0,"allocated":240181248,"data_stored":351990887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":485071953},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2932736,"num_objects":3,"num_object_clones":3,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":17,"num_read_kb":10908,"num_write":12,"num_write_kb":4880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000659"},"pg_stats":[{"pgid":"3.f","version":"77'33","reported_seq":254,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T18:16:12.388491+0000","last_change":"2024-09-17T18:16:12.390211+0000","last_active":"2024-09-17T18:16:12.388491+0000","last_peered":"2024-09-17T18:16:12.388491+0000","last_clean":"2024-09-17T18:16:12.388491+0000","last_became_active":"2024-09-17T18:15:28.090920+0000","last_became_peered":"2024-09-17T18:15:28.090920+0000","last_unstale":"2024-09-17T18:16:12.388491+0000","last_undegraded":"2024-09-17T18:16:12.388491+0000","last_fullsized":"2024-09-17T18:16:12.388491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:45.420448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060122632000000002,"stat_sum":{"num_bytes":4882432,"num_objects":5,"num_object_clones":3,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":16,"num_read_kb":12189,"num_write":17,"num_write_kb":4848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3,15,14,2,11,0],"acting":[13,3,15,14,2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"5","length":"1"},{"start":"13","length":"2"},{"start":"1a","length":"2"}]},{"pgid":"3.e","version":"77'27","reported_seq":247,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T18:16:12.351780+0000","last_change":"2024-09-17T18:16:12.367809+0000","last_active":"2024-09-17T18:16:12.351780+0000","last_peered":"2024-09-17T18:16:12.351780+0000","last_clean":"2024-09-17T18:16:12.351780+0000","last_became_active":"2024-09-17T18:15:28.110648+0000","last_became_peered":"2024-09-17T18:15:28.110648+0000","last_unstale":"2024-09-17T18:16:12.351780+0000","last_undegraded":"2024-09-17T18:16:12.351780+0000","last_fullsized":"2024-09-17T18:16:12.351780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:44.927250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036004100999999997,"stat_sum":{"num_bytes":1982464,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":14,"num_read_kb":946,"num_write":30,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14,6,13,8,3,12],"acting":[11,14,6,13,8,3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"5","length":"1"},{"start":"13","length":"2"},{"start":"1a","length":"2"}]},{"pgid":"3.d","version":"77'291","reported_seq":502,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T18:16:12.395598+0000","last_change":"2024-09-17T18:16:12.396962+0000","last_active":"2024-09-17T18:16:12.395598+0000","last_peered":"2024-09-17T18:16:12.395598+0000","last_clean":"2024-09-17T18:16:12.395598+0000","last_became_active":"2024-09-17T18:15:28.273848+0000","last_became_peered":"2024-09-17T18:15:28.273848+0000","last_unstale":"2024-09-17T18:16:12.395598+0000","last_undegraded":"2024-09-17T18:16:12.395598+0000","last_fullsized":"2024-09-17T18:16:12.395598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.484845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067298298000000006,"stat_sum":{"num_bytes":27770880,"num_objects":30,"num_object_clones":21,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":1,"num_read":77,"num_read_kb":18315,"num_write":172,"num_write_kb":29616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,11,15,9,8,4],"acting":[13,1,11,15,9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"5","length":"1"},{"start":"13","length":"2"},{"start":"1a","length":"2"}]},{"pgid":"3.c","version":"77'88","reported_seq":299,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T18:16:12.368163+0000","last_change":"2024-09-17T18:16:12.369695+0000","last_active":"2024-09-17T18:16:12.368163+0000","last_peered":"2024-09-17T18:16:12.368163+0000","last_clean":"2024-09-17T18:16:12.368163+0000","last_became_active":"2024-09-17T18:15:28.112093+0000","last_became_peered":"2024-09-17T18:15:28.112093+0000","last_unstale":"2024-09-17T18:16:12.368163+0000","last_undegraded":"2024-09-17T18:16:12.368163+0000","last_fullsized":"2024-09-17T18:16:12.368163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:55.501207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029887912999999999,"stat_sum":{"num_bytes":7045120,"num_objects":9,"num_object_clones":5,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":20,"num_read_kb":7966,"num_write":29,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,3,7,12,14],"acting":[5,8,13,3,7,12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"1"},{"start":"13","length":"2"},{"start":"1a","length":"2"}]},{"pgid":"3.b","version":"73'119","reported_seq":294,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.327580+0000","last_change":"2024-09-17T18:16:08.327580+0000","last_active":"2024-09-17T18:16:08.327580+0000","last_peered":"2024-09-17T18:16:08.327580+0000","last_clean":"2024-09-17T18:16:08.327580+0000","last_became_active":"2024-09-17T18:15:28.111526+0000","last_became_peered":"2024-09-17T18:15:28.111526+0000","last_unstale":"2024-09-17T18:16:08.327580+0000","last_undegraded":"2024-09-17T18:16:08.327580+0000","last_fullsized":"2024-09-17T18:16:08.327580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:27.346346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011359917000000001,"stat_sum":{"num_bytes":12337152,"num_objects":13,"num_object_clones":9,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":1,"num_read":18,"num_read_kb":10,"num_write":82,"num_write_kb":12800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,10,12,11,1,14],"acting":[4,0,10,12,11,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.a","version":"77'188","reported_seq":394,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T18:16:12.378641+0000","last_change":"2024-09-17T18:16:12.381439+0000","last_active":"2024-09-17T18:16:12.378641+0000","last_peered":"2024-09-17T18:16:12.378641+0000","last_clean":"2024-09-17T18:16:12.378641+0000","last_became_active":"2024-09-17T18:15:28.089449+0000","last_became_peered":"2024-09-17T18:15:28.089449+0000","last_unstale":"2024-09-17T18:16:12.378641+0000","last_undegraded":"2024-09-17T18:16:12.378641+0000","last_fullsized":"2024-09-17T18:16:12.378641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:47.148526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.051366000000000002,"stat_sum":{"num_bytes":12615680,"num_objects":16,"num_object_clones":11,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":2,"num_read":49,"num_read_kb":24860,"num_write":53,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,6,5,3,15,4],"acting":[13,1,6,5,3,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"5","length":"1"},{"start":"13","length":"2"},{"start":"1a","length":"2"}]},{"pgid":"3.9","version":"73'137","reported_seq":320,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.374553+0000","last_change":"2024-09-17T18:16:08.375883+0000","last_active":"2024-09-17T18:16:08.374553+0000","last_peered":"2024-09-17T18:16:08.374553+0000","last_clean":"2024-09-17T18:16:08.374553+0000","last_became_active":"2024-09-17T18:15:28.095114+0000","last_became_peered":"2024-09-17T18:15:28.095114+0000","last_unstale":"2024-09-17T18:16:08.374553+0000","last_undegraded":"2024-09-17T18:16:08.374553+0000","last_fullsized":"2024-09-17T18:16:08.374553+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:55.553530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036000785,"stat_sum":{"num_bytes":12615680,"num_objects":13,"num_object_clones":9,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":26,"num_read_kb":5061,"num_write":71,"num_write_kb":14144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,10,11,5,8,3],"acting":[7,2,10,11,5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.8","version":"73'60","reported_seq":245,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.362425+0000","last_change":"2024-09-17T18:16:08.363074+0000","last_active":"2024-09-17T18:16:08.362425+0000","last_peered":"2024-09-17T18:16:08.362425+0000","last_clean":"2024-09-17T18:16:08.362425+0000","last_became_active":"2024-09-17T18:15:28.088066+0000","last_became_peered":"2024-09-17T18:15:28.088066+0000","last_unstale":"2024-09-17T18:16:08.362425+0000","last_undegraded":"2024-09-17T18:16:08.362425+0000","last_fullsized":"2024-09-17T18:16:08.362425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:46.465979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029649089,"stat_sum":{"num_bytes":7143424,"num_objects":7,"num_object_clones":4,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":10,"num_read_kb":7,"num_write":26,"num_write_kb":7664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,11,3,15,1,7],"acting":[6,0,11,3,15,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"1.0","version":"25'112","reported_seq":243,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.333690+0000","last_change":"2024-09-17T18:15:13.924291+0000","last_active":"2024-09-17T18:16:08.333690+0000","last_peered":"2024-09-17T18:16:08.333690+0000","last_clean":"2024-09-17T18:16:08.333690+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:16:08.333690+0000","last_undegraded":"2024-09-17T18:16:08.333690+0000","last_fullsized":"2024-09-17T18:16:08.333690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:15:12.533086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.379235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":112,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.327974+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:16:08.327974+0000","last_peered":"2024-09-17T18:16:08.327974+0000","last_clean":"2024-09-17T18:16:08.327974+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:16:08.327974+0000","last_undegraded":"2024-09-17T18:16:08.327974+0000","last_fullsized":"2024-09-17T18:16:08.327974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"73'46","reported_seq":235,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.348733+0000","last_change":"2024-09-17T18:16:08.349593+0000","last_active":"2024-09-17T18:16:08.348733+0000","last_peered":"2024-09-17T18:16:08.348733+0000","last_clean":"2024-09-17T18:16:08.348733+0000","last_became_active":"2024-09-17T18:15:28.089102+0000","last_became_peered":"2024-09-17T18:15:28.089102+0000","last_unstale":"2024-09-17T18:16:08.348733+0000","last_undegraded":"2024-09-17T18:16:08.348733+0000","last_fullsized":"2024-09-17T18:16:08.348733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.017378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021483182,"stat_sum":{"num_bytes":1015808,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":11,"num_read_kb":114,"num_write":30,"num_write_kb":1488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3,13,1,5,10,7],"acting":[14,3,13,1,5,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":117,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T18:16:11.329902+0000","last_change":"2024-09-17T18:15:16.990099+0000","last_active":"2024-09-17T18:16:11.329902+0000","last_peered":"2024-09-17T18:16:11.329902+0000","last_clean":"2024-09-17T18:16:11.329902+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:16:11.329902+0000","last_undegraded":"2024-09-17T18:16:11.329902+0000","last_fullsized":"2024-09-17T18:16:11.329902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.933228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":184,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.316178+0000","last_change":"2024-09-17T18:16:08.316532+0000","last_active":"2024-09-17T18:16:08.316178+0000","last_peered":"2024-09-17T18:16:08.316178+0000","last_clean":"2024-09-17T18:16:08.316178+0000","last_became_active":"2024-09-17T18:15:28.094455+0000","last_became_peered":"2024-09-17T18:15:28.094455+0000","last_unstale":"2024-09-17T18:16:08.316178+0000","last_undegraded":"2024-09-17T18:16:08.316178+0000","last_fullsized":"2024-09-17T18:16:08.316178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:54.162098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084907400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,14,10,7,3,2],"acting":[4,13,14,10,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":111,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.327833+0000","last_change":"2024-09-17T18:15:17.499886+0000","last_active":"2024-09-17T18:16:08.327833+0000","last_peered":"2024-09-17T18:16:08.327833+0000","last_clean":"2024-09-17T18:16:08.327833+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:16:08.327833+0000","last_undegraded":"2024-09-17T18:16:08.327833+0000","last_fullsized":"2024-09-17T18:16:08.327833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.366017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"73'37","reported_seq":230,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.369470+0000","last_change":"2024-09-17T18:16:08.329798+0000","last_active":"2024-09-17T18:16:08.369470+0000","last_peered":"2024-09-17T18:16:08.369470+0000","last_clean":"2024-09-17T18:16:08.369470+0000","last_became_active":"2024-09-17T18:15:28.273637+0000","last_became_peered":"2024-09-17T18:15:28.273637+0000","last_unstale":"2024-09-17T18:16:08.369470+0000","last_undegraded":"2024-09-17T18:16:08.369470+0000","last_fullsized":"2024-09-17T18:16:08.369470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:29.336818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027687699999999998,"stat_sum":{"num_bytes":9404416,"num_objects":6,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":6254,"num_write":19,"num_write_kb":9184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,9,2,6,15,4],"acting":[3,7,9,2,6,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":121,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T18:16:12.329398+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:16:12.329398+0000","last_peered":"2024-09-17T18:16:12.329398+0000","last_clean":"2024-09-17T18:16:12.329398+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:16:12.329398+0000","last_undegraded":"2024-09-17T18:16:12.329398+0000","last_fullsized":"2024-09-17T18:16:12.329398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:19.851941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"77'45","reported_seq":269,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T18:16:12.356814+0000","last_change":"2024-09-17T18:16:12.358032+0000","last_active":"2024-09-17T18:16:12.356814+0000","last_peered":"2024-09-17T18:16:12.356814+0000","last_clean":"2024-09-17T18:16:12.356814+0000","last_became_active":"2024-09-17T18:15:28.272974+0000","last_became_peered":"2024-09-17T18:15:28.272974+0000","last_unstale":"2024-09-17T18:16:12.356814+0000","last_undegraded":"2024-09-17T18:16:12.356814+0000","last_fullsized":"2024-09-17T18:16:12.356814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:38.953389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029813727000000002,"stat_sum":{"num_bytes":5111808,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":9399,"num_write":16,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4,13,11,2,5],"acting":[10,9,4,13,11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"5","length":"1"},{"start":"13","length":"2"},{"start":"1a","length":"2"}]},{"pgid":"3.5","version":"77'48","reported_seq":264,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T18:16:12.374397+0000","last_change":"2024-09-17T18:16:12.375723+0000","last_active":"2024-09-17T18:16:12.374397+0000","last_peered":"2024-09-17T18:16:12.374397+0000","last_clean":"2024-09-17T18:16:12.374397+0000","last_became_active":"2024-09-17T18:15:28.275306+0000","last_became_peered":"2024-09-17T18:15:28.275306+0000","last_unstale":"2024-09-17T18:16:12.374397+0000","last_undegraded":"2024-09-17T18:16:12.374397+0000","last_fullsized":"2024-09-17T18:16:12.374397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:41.686628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035922638999999999,"stat_sum":{"num_bytes":8765440,"num_objects":4,"num_object_clones":3,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":9,"num_read_kb":488,"num_write":33,"num_write_kb":8560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,11],"acting":[5,8,4,9,12,0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"1"},{"start":"13","length":"2"},{"start":"1a","length":"2"}]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.315708+0000","last_change":"2024-09-17T18:15:16.605178+0000","last_active":"2024-09-17T18:16:08.315708+0000","last_peered":"2024-09-17T18:16:08.315708+0000","last_clean":"2024-09-17T18:16:08.315708+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:16:08.315708+0000","last_undegraded":"2024-09-17T18:16:08.315708+0000","last_fullsized":"2024-09-17T18:16:08.315708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":212,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T18:16:12.337354+0000","last_change":"2024-09-17T18:16:12.337692+0000","last_active":"2024-09-17T18:16:12.337354+0000","last_peered":"2024-09-17T18:16:12.337354+0000","last_clean":"2024-09-17T18:16:12.337354+0000","last_became_active":"2024-09-17T18:15:28.090551+0000","last_became_peered":"2024-09-17T18:15:28.090551+0000","last_unstale":"2024-09-17T18:16:12.337354+0000","last_undegraded":"2024-09-17T18:16:12.337354+0000","last_fullsized":"2024-09-17T18:16:12.337354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:27.471662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059774399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15,4,2,6,10,7],"acting":[8,15,4,2,6,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"5","length":"1"},{"start":"13","length":"2"},{"start":"1a","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.338725+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:16:08.338725+0000","last_peered":"2024-09-17T18:16:08.338725+0000","last_clean":"2024-09-17T18:16:08.338725+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:16:08.338725+0000","last_undegraded":"2024-09-17T18:16:08.338725+0000","last_fullsized":"2024-09-17T18:16:08.338725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:14.501281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"72'92","reported_seq":293,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T18:16:08.316499+0000","last_change":"2024-09-17T18:16:08.316961+0000","last_active":"2024-09-17T18:16:08.316499+0000","last_peered":"2024-09-17T18:16:08.316499+0000","last_clean":"2024-09-17T18:16:08.316499+0000","last_became_active":"2024-09-17T18:15:27.692814+0000","last_became_peered":"2024-09-17T18:15:27.692814+0000","last_unstale":"2024-09-17T18:16:08.316499+0000","last_undegraded":"2024-09-17T18:16:08.316499+0000","last_fullsized":"2024-09-17T18:16:08.316499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:49.942613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010722209999999999,"stat_sum":{"num_bytes":7438336,"num_objects":12,"num_object_clones":7,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":42,"num_read_kb":9833,"num_write":47,"num_write_kb":7264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,0,14,10,13],"acting":[4,11,6,0,14,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":119,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T18:16:12.337006+0000","last_change":"2024-09-17T18:15:17.502621+0000","last_active":"2024-09-17T18:16:12.337006+0000","last_peered":"2024-09-17T18:16:12.337006+0000","last_clean":"2024-09-17T18:16:12.337006+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:16:12.337006+0000","last_undegraded":"2024-09-17T18:16:12.337006+0000","last_fullsized":"2024-09-17T18:16:12.337006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.990534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"76'80","reported_seq":286,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T18:16:11.398424+0000","last_change":"2024-09-17T18:16:11.354450+0000","last_active":"2024-09-17T18:16:11.398424+0000","last_peered":"2024-09-17T18:16:11.398424+0000","last_clean":"2024-09-17T18:16:11.398424+0000","last_became_active":"2024-09-17T18:15:28.272963+0000","last_became_peered":"2024-09-17T18:15:28.272963+0000","last_unstale":"2024-09-17T18:16:11.398424+0000","last_undegraded":"2024-09-17T18:16:11.398424+0000","last_fullsized":"2024-09-17T18:16:11.398424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.745132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021937525999999999,"stat_sum":{"num_bytes":9142272,"num_objects":10,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":20,"num_read_kb":7160,"num_write":31,"num_write_kb":8928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14,6,2,5,9,15],"acting":[0,14,6,2,5,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"5","length":"1"},{"start":"14","length":"1"},{"start":"1a","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":119,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T18:16:12.330019+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:16:12.330019+0000","last_peered":"2024-09-17T18:16:12.330019+0000","last_clean":"2024-09-17T18:16:12.330019+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:16:12.330019+0000","last_undegraded":"2024-09-17T18:16:12.330019+0000","last_fullsized":"2024-09-17T18:16:12.330019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:17.193575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":127270912,"num_objects":139,"num_object_clones":90,"num_object_copies":973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":11,"num_read":344,"num_read_kb":102602,"num_write":656,"num_write_kb":132352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":224612352,"data_stored":346501120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1291,"ondisk_log_size":1291,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247823,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49012,"kb_used_data":17820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322828,"statfs":{"total":96636764160,"available":96586575872,"internally_reserved":0,"allocated":18247680,"data_stored":26834701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247823,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42344,"kb_used_data":11148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329496,"statfs":{"total":96636764160,"available":96593403904,"internally_reserved":0,"allocated":11415552,"data_stored":16774381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280528,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35996,"kb_used_data":8960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335844,"statfs":{"total":96636764160,"available":96599904256,"internally_reserved":0,"allocated":9175040,"data_stored":13158308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313232,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44924,"kb_used_data":13736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326916,"statfs":{"total":96636764160,"available":96590761984,"internally_reserved":0,"allocated":14065664,"data_stored":22390673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280528,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49608,"kb_used_data":18412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322232,"statfs":{"total":96636764160,"available":96585965568,"internally_reserved":0,"allocated":18853888,"data_stored":26998692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313232,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42220,"kb_used_data":15188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94329620,"statfs":{"total":96636764160,"available":96593530880,"internally_reserved":0,"allocated":15552512,"data_stored":21561072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280526,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42608,"kb_used_data":15572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94329232,"statfs":{"total":96636764160,"available":96593133568,"internally_reserved":0,"allocated":15945728,"data_stored":21505937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280527,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38808,"kb_used_data":11772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333032,"statfs":{"total":96636764160,"available":96597024768,"internally_reserved":0,"allocated":12054528,"data_stored":18724753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,4,5,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313231,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54288,"kb_used_data":23096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94317552,"statfs":{"total":96636764160,"available":96581173248,"internally_reserved":0,"allocated":23650304,"data_stored":36499606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280526,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47400,"kb_used_data":16208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324440,"statfs":{"total":96636764160,"available":96588226560,"internally_reserved":0,"allocated":16596992,"data_stored":25855213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280527,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37660,"kb_used_data":10624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334180,"statfs":{"total":96636764160,"available":96598200320,"internally_reserved":0,"allocated":10878976,"data_stored":14940049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247821,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45192,"kb_used_data":14000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326648,"statfs":{"total":96636764160,"available":96590487552,"internally_reserved":0,"allocated":14336000,"data_stored":20559085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247823,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52092,"kb_used_data":20896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94319748,"statfs":{"total":96636764160,"available":96583421952,"internally_reserved":0,"allocated":21397504,"data_stored":32322797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247823,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43824,"kb_used_data":12632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328016,"statfs":{"total":96636764160,"available":96591888384,"internally_reserved":0,"allocated":12935168,"data_stored":18165782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247822,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40436,"kb_used_data":9244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331404,"statfs":{"total":96636764160,"available":96595357696,"internally_reserved":0,"allocated":9465856,"data_stored":13853933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280526,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42280,"kb_used_data":15244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94329560,"statfs":{"total":96636764160,"available":96593469440,"internally_reserved":0,"allocated":15609856,"data_stored":21845905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12984320,"data_stored":21774336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15220736,"data_stored":24469504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9797632,"data_stored":15446016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14159872,"data_stored":20824064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20860928,"data_stored":31776768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14864384,"data_stored":22011904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11370496,"data_stored":17051648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9289728,"data_stored":14118912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":14528512,"data_stored":22470656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":14573568,"data_stored":21692416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":10973184,"data_stored":18108416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":22552576,"data_stored":35872768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":8089600,"data_stored":12541952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":17768448,"data_stored":26382336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":10399744,"data_stored":16199680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":17178624,"data_stored":25759744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:16:13.895 INFO:tasks.thrashosds.thrasher:Setting 3.d to [13, 10, 11, 3, 8, 12, 2, 4, 7, 15, 0, 14, 1, 9] 2024-09-17T18:16:13.895 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.d', '13', '10', '11', '3', '8', '12', '2', '4', '7', '15', '0', '14', '1', '9'] 2024-09-17T18:16:13.895 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.d 13 10 11 3 8 12 2 4 7 15 0 14 1 9 2024-09-17T18:16:13.896 INFO:tasks.rados.rados.0.smithi154.stdout:319: done (1 left) 2024-09-17T18:16:13.896 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 20 current snap is 27 2024-09-17T18:16:13.896 INFO:tasks.rados.rados.0.smithi154.stdout:320: seq_num 138 ranges {1114112=770048,1884160=540672,2424832=753664,3178496=262144} 2024-09-17T18:16:13.912 INFO:tasks.rados.rados.0.smithi154.stdout:320: writing smithi15432074-20 from 1114112 to 1884160 tid 1 2024-09-17T18:16:13.920 INFO:tasks.rados.rados.0.smithi154.stdout:320: writing smithi15432074-20 from 1884160 to 2424832 tid 2 2024-09-17T18:16:13.922 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:13.918+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:13.926 INFO:tasks.rados.rados.0.smithi154.stdout:320: writing smithi15432074-20 from 2424832 to 3178496 tid 3 2024-09-17T18:16:13.929 INFO:tasks.rados.rados.0.smithi154.stdout:320: writing smithi15432074-20 from 3178496 to 3440640 tid 4 2024-09-17T18:16:13.930 INFO:tasks.rados.rados.0.smithi154.stdout:321: delete oid 34 current snap is 27 2024-09-17T18:16:13.930 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 46 v 142 (ObjNum 401 snap 0 seq_num 2994306656) dirty exists 2024-09-17T18:16:13.930 INFO:tasks.rados.rados.0.smithi154.stdout:320: finishing write tid 1 to smithi15432074-20 2024-09-17T18:16:13.930 INFO:tasks.rados.rados.0.smithi154.stdout:320: finishing write tid 2 to smithi15432074-20 2024-09-17T18:16:13.933 INFO:tasks.rados.rados.0.smithi154.stdout:320: finishing write tid 3 to smithi15432074-20 2024-09-17T18:16:13.937 INFO:tasks.rados.rados.0.smithi154.stdout:318: done (2 left) 2024-09-17T18:16:13.937 INFO:tasks.rados.rados.0.smithi154.stdout:321: done (1 left) 2024-09-17T18:16:13.937 INFO:tasks.rados.rados.0.smithi154.stdout:322: read oid 26 snap -1 2024-09-17T18:16:13.937 INFO:tasks.rados.rados.0.smithi154.stdout:322: expect (ObjNum 136 snap 27 seq_num 136) 2024-09-17T18:16:13.937 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 22 current snap is 27 2024-09-17T18:16:13.937 INFO:tasks.rados.rados.0.smithi154.stdout:323: seq_num 140 ranges {0=802816,802816=425984,1228800=720896,1949696=409600} 2024-09-17T18:16:13.939 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:13.939 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:13.947 INFO:tasks.rados.rados.0.smithi154.stdout:323: writing smithi15432074-22 from 0 to 802816 tid 1 2024-09-17T18:16:13.952 INFO:tasks.rados.rados.0.smithi154.stdout:323: writing smithi15432074-22 from 802816 to 1228800 tid 2 2024-09-17T18:16:13.958 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T18:16:13.962 INFO:tasks.rados.rados.0.smithi154.stdout:323: writing smithi15432074-22 from 1228800 to 1949696 tid 3 2024-09-17T18:16:13.968 INFO:tasks.rados.rados.0.smithi154.stdout:323: writing smithi15432074-22 from 1949696 to 2359296 tid 4 2024-09-17T18:16:13.968 INFO:tasks.rados.rados.0.smithi154.stdout:324: copy_from oid 5 from oid 12 current snap is 27 2024-09-17T18:16:13.969 INFO:tasks.rados.rados.0.smithi154.stdout:320: finishing write tid 4 to smithi15432074-20 2024-09-17T18:16:13.969 INFO:tasks.rados.rados.0.smithi154.stdout:320: finishing write tid 5 to smithi15432074-20 2024-09-17T18:16:13.969 INFO:tasks.rados.rados.0.smithi154.stdout:320: finishing write tid 6 to smithi15432074-20 2024-09-17T18:16:13.969 INFO:tasks.rados.rados.0.smithi154.stdout:320: oid 20 updating version 0 to 145 2024-09-17T18:16:13.969 INFO:tasks.rados.rados.0.smithi154.stdout:320: oid 20 updating version 145 to 147 2024-09-17T18:16:13.969 INFO:tasks.rados.rados.0.smithi154.stdout:320: oid 20 version 147 is already newer than 146 2024-09-17T18:16:13.969 INFO:tasks.rados.rados.0.smithi154.stdout:320: oid 20 updating version 147 to 148 2024-09-17T18:16:13.969 INFO:tasks.rados.rados.0.smithi154.stdout:320: oid 20 version 148 is already newer than 144 2024-09-17T18:16:13.969 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 20 v 148 (ObjNum 138 snap 27 seq_num 138) dirty exists 2024-09-17T18:16:13.969 INFO:tasks.rados.rados.0.smithi154.stdout:320: left oid 20 (ObjNum 138 snap 27 seq_num 138) 2024-09-17T18:16:13.969 INFO:tasks.rados.rados.0.smithi154.stdout:323: finishing write tid 1 to smithi15432074-22 2024-09-17T18:16:13.970 INFO:tasks.rados.rados.0.smithi154.stdout:320: done (3 left) 2024-09-17T18:16:13.970 INFO:tasks.rados.rados.0.smithi154.stdout:325: delete oid 36 current snap is 27 2024-09-17T18:16:13.970 INFO:tasks.rados.rados.0.smithi154.stdout:323: finishing write tid 2 to smithi15432074-22 2024-09-17T18:16:13.970 INFO:tasks.rados.rados.0.smithi154.stdout:322: expect (ObjNum 136 snap 27 seq_num 136) 2024-09-17T18:16:13.970 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:14.023 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:14.017+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:14.065 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:14.118 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:14.118 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:14.124 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:14.121+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:14.132 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T18:16:14.182 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 4334472 2024-09-17T18:16:14.195 INFO:tasks.rados.rados.0.smithi154.stdout:323: finishing write tid 3 to smithi15432074-22 2024-09-17T18:16:14.196 INFO:tasks.rados.rados.0.smithi154.stdout:323: finishing write tid 4 to smithi15432074-22 2024-09-17T18:16:14.196 INFO:tasks.rados.rados.0.smithi154.stdout:323: finishing write tid 5 to smithi15432074-22 2024-09-17T18:16:14.196 INFO:tasks.rados.rados.0.smithi154.stdout:323: finishing write tid 6 to smithi15432074-22 2024-09-17T18:16:14.196 INFO:tasks.rados.rados.0.smithi154.stdout:323: oid 22 updating version 0 to 298 2024-09-17T18:16:14.196 INFO:tasks.rados.rados.0.smithi154.stdout:323: oid 22 updating version 298 to 300 2024-09-17T18:16:14.196 INFO:tasks.rados.rados.0.smithi154.stdout:323: oid 22 version 300 is already newer than 299 2024-09-17T18:16:14.196 INFO:tasks.rados.rados.0.smithi154.stdout:323: oid 22 version 300 is already newer than 297 2024-09-17T18:16:14.196 INFO:tasks.rados.rados.0.smithi154.stdout:323: oid 22 version 300 is already newer than 296 2024-09-17T18:16:14.196 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 22 v 300 (ObjNum 140 snap 27 seq_num 140) dirty exists 2024-09-17T18:16:14.196 INFO:tasks.rados.rados.0.smithi154.stdout:323: left oid 22 (ObjNum 140 snap 27 seq_num 140) 2024-09-17T18:16:14.196 INFO:tasks.rados.rados.0.smithi154.stdout:324: finishing copy_from racing read to smithi15432074-5 2024-09-17T18:16:14.197 INFO:tasks.rados.rados.0.smithi154.stdout:324: finishing copy_from to smithi15432074-5 2024-09-17T18:16:14.197 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 5 v 82 (ObjNum 97 snap 16 seq_num 97) dirty exists 2024-09-17T18:16:14.197 INFO:tasks.rados.rados.0.smithi154.stdout:322: done (3 left) 2024-09-17T18:16:14.197 INFO:tasks.rados.rados.0.smithi154.stdout:323: done (2 left) 2024-09-17T18:16:14.197 INFO:tasks.rados.rados.0.smithi154.stdout:324: done (1 left) 2024-09-17T18:16:14.197 INFO:tasks.rados.rados.0.smithi154.stdout:325: done (0 left) 2024-09-17T18:16:14.197 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 15 current snap is 27 2024-09-17T18:16:14.197 INFO:tasks.rados.rados.0.smithi154.stdout:326: seq_num 142 ranges {3653632=442368,4096000=720896,4816896=540672,5357568=688128} 2024-09-17T18:16:14.226 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:16:14.222+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:16:14.242 INFO:tasks.rados.rados.0.smithi154.stdout:326: writing smithi15432074-15 from 3653632 to 4096000 tid 1 2024-09-17T18:16:14.251 INFO:tasks.rados.rados.0.smithi154.stdout:326: writing smithi15432074-15 from 4096000 to 4816896 tid 2 2024-09-17T18:16:14.255 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:14.255 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:14.256 INFO:tasks.rados.rados.0.smithi154.stdout:326: writing smithi15432074-15 from 4816896 to 5357568 tid 3 2024-09-17T18:16:14.263 INFO:tasks.rados.rados.0.smithi154.stdout:326: writing smithi15432074-15 from 5357568 to 6045696 tid 4 2024-09-17T18:16:14.263 INFO:tasks.rados.rados.0.smithi154.stdout:327: rollback oid 21 current snap is 27 2024-09-17T18:16:14.263 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 21 to 6 2024-09-17T18:16:14.263 INFO:tasks.rados.rados.0.smithi154.stdout:326: finishing write tid 1 to smithi15432074-15 2024-09-17T18:16:14.263 INFO:tasks.rados.rados.0.smithi154.stdout:326: finishing write tid 2 to smithi15432074-15 2024-09-17T18:16:14.263 INFO:tasks.rados.rados.0.smithi154.stdout:328: rmattr oid 30 current snap is 27 2024-09-17T18:16:14.264 INFO:tasks.rados.rados.0.smithi154.stdout:328: done (2 left) 2024-09-17T18:16:14.264 INFO:tasks.rados.rados.0.smithi154.stdout:329: rollback oid 50 current snap is 27 2024-09-17T18:16:14.264 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 50 to 21 2024-09-17T18:16:14.264 INFO:tasks.rados.rados.0.smithi154.stdout:330: read oid 5 snap -1 2024-09-17T18:16:14.264 INFO:tasks.rados.rados.0.smithi154.stdout:330: expect (ObjNum 97 snap 16 seq_num 97) 2024-09-17T18:16:14.264 INFO:tasks.rados.rados.0.smithi154.stdout:331: snap_remove snap 4 2024-09-17T18:16:14.280 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T18:16:14.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T18:16:14.327 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:14.326+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:14.359 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T18:16:14.400 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:14.400 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:14.414 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T18:16:14.421 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:16:14.421 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:16:14.428 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:14.425+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:14.440 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:16:14.440 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:16:14.460 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:16:14.461 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:16:14.478 INFO:teuthology.orchestra.run.smithi087.stderr:set 3.d pg_upmap_items mapping to [13->10,11->3,8->12,2->4,7->15,0->14,1->9] 2024-09-17T18:16:14.481 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:16:14.481 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:16:14.482 INFO:tasks.rados.rados.0.smithi154.stdout:331: done (4 left) 2024-09-17T18:16:14.482 INFO:tasks.rados.rados.0.smithi154.stdout:332: copy_from oid 28 from oid 12 current snap is 27 2024-09-17T18:16:14.482 INFO:tasks.rados.rados.0.smithi154.stdout:329: finishing rollback tid 0 to smithi15432074-50 2024-09-17T18:16:14.482 INFO:tasks.rados.rados.0.smithi154.stdout:326: finishing write tid 3 to smithi15432074-15 2024-09-17T18:16:14.483 INFO:tasks.rados.rados.0.smithi154.stdout:329: finishing rollback tid 1 to smithi15432074-50 2024-09-17T18:16:14.483 INFO:tasks.rados.rados.0.smithi154.stdout:329: finishing rollback tid 2 to smithi15432074-50 2024-09-17T18:16:14.483 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 50 v 70 (ObjNum 101 snap 20 seq_num 101) dirty exists 2024-09-17T18:16:14.483 INFO:tasks.rados.rados.0.smithi154.stdout:326: finishing write tid 4 to smithi15432074-15 2024-09-17T18:16:14.483 INFO:tasks.rados.rados.0.smithi154.stdout:326: finishing write tid 5 to smithi15432074-15 2024-09-17T18:16:14.483 INFO:tasks.rados.rados.0.smithi154.stdout:326: finishing write tid 6 to smithi15432074-15 2024-09-17T18:16:14.483 INFO:tasks.rados.rados.0.smithi154.stdout:326: oid 15 updating version 0 to 201 2024-09-17T18:16:14.483 INFO:tasks.rados.rados.0.smithi154.stdout:326: oid 15 version 201 is already newer than 198 2024-09-17T18:16:14.483 INFO:tasks.rados.rados.0.smithi154.stdout:326: oid 15 version 201 is already newer than 199 2024-09-17T18:16:14.483 INFO:tasks.rados.rados.0.smithi154.stdout:326: oid 15 version 201 is already newer than 200 2024-09-17T18:16:14.483 INFO:tasks.rados.rados.0.smithi154.stdout:326: oid 15 updating version 201 to 202 2024-09-17T18:16:14.484 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 15 v 202 (ObjNum 142 snap 27 seq_num 142) dirty exists 2024-09-17T18:16:14.484 INFO:tasks.rados.rados.0.smithi154.stdout:326: left oid 15 (ObjNum 142 snap 27 seq_num 142) 2024-09-17T18:16:14.484 INFO:tasks.rados.rados.0.smithi154.stdout:327: finishing rollback tid 1 to smithi15432074-21 2024-09-17T18:16:14.484 INFO:tasks.rados.rados.0.smithi154.stdout:327: finishing rollback tid 2 to smithi15432074-21 2024-09-17T18:16:14.484 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 21 v 204 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-09-17T18:16:14.484 INFO:tasks.rados.rados.0.smithi154.stdout:330: expect (ObjNum 97 snap 16 seq_num 97) 2024-09-17T18:16:14.484 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:14.507 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:16:14.507 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:16:14.528 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:14.525+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:14.529 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:16:14.530 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:16:14.557 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:16:14.557 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:16:14.573 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 17055 2024-09-17T18:16:14.576 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:16:14.576 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:16:14.594 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:16:14.595 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:16:14.596 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:14.596 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:14.610 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T18:16:14.611 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:16:14.611 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:16:14.629 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:14.626+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:14.631 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:16:14.631 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:16:14.649 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:14.651 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:16:14.651 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:16:14.667 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:16:14.667 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:16:14.687 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:16:14.687 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:16:14.707 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:16:14.707 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:16:14.724 INFO:tasks.rados.rados.0.smithi154.stdout:326: done (4 left) 2024-09-17T18:16:14.724 INFO:tasks.rados.rados.0.smithi154.stdout:327: done (3 left) 2024-09-17T18:16:14.724 INFO:tasks.rados.rados.0.smithi154.stdout:329: done (2 left) 2024-09-17T18:16:14.724 INFO:tasks.rados.rados.0.smithi154.stdout:330: done (1 left) 2024-09-17T18:16:14.724 INFO:tasks.rados.rados.0.smithi154.stdout:333: snap_remove snap 14 2024-09-17T18:16:14.727 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:16:14.727 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:16:14.729 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:14.726+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:14.734 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:14.734 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:16:14.734 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:14.748 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T18:16:14.830 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:14.829+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:14.871 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:14.871 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:16:14.871 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:16:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:14.885 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T18:16:14.931 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:14.929+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:339 3.ds0 3:b554fbc1:::smithi15432074-41:head [create,setxattr h^blbcaNtSmmsQtZPdaRtPkhOOgN_Vi\\f`NtsZ[V (561) in=40b,setxattr T (17332) in=1b,setxattr UVoaZteYfmpthpcfl[gebaR\\TdqcNkhPRRdrgsX] (279) in=40b,setxattr bTPgfXb\\YXtXkQag\\Qh`hlXr[posd]]cje]^eebl (1121) in=40b,setxattr hm^gakWSOOOfNOTph^tma]iaNsaqfjqZYb\\seZNW (3297) in=40b,setxattr YiNn[]m_q`YlQlaV^mRn^ (17332) in=21b,setxattr \\tllpkXThmWXSkOopogrdtjY]f^a^sem_krafjfi (947) in=40b,setxattr RXiRZRQVSaUTaZmQT^bfqZhS^mZsqadaPdW]ijm` (1963) in=40b,setxattr WTmsTZhNpU`tZY\\^aROaNdmtYsjjsgWWboehPOP` (19508) in=40b,setxattr UZmWZeWaoiX]jmbn][UadnNkcZc_hdcjidtNsRYo (1999) in=40b,setxattr NSebjRYYQ`SbaatVjZWNab`cenkljRq`^]Xr\\jRm (11788) in=40b,setxattr ip`daUaop[rdbNPo\\^c[Wcelsl]a][RScQZ[kfa^ (18524) in=40b,setxattr qU_qcNcQpNkegs_Od`jieTXX[mto]lsR^jTcYprR (593) in=40b,setxattr dboVg`srq[bReagdR]fX\\Pe`Warrp]\\[XpSipTN[ (1683) in=40b,setxattr ZdTaVj[ScjsOiQ]a_]R[RQWoYohnjd`fi[dYmfs` (840) in=40b,setxattr N_[blmbpstWhtUgW]ZjZ[\\O_erqcnQN]R_V^U\\RT (1015) in=40b,setxattr jXbP_mNsadnq`UVfmc^lfZUs\\r_[ZnrahqTUk^Zp (383) in=40b,setxattr nmemd\\ipehj\\q^UVY_YtSrhZjcabNXhlai_noQSO (807) in=40b,setxattr Rbc\\cahhlcrckUioieUbQnrseNkZkdPf\\rUmNb]S (384) in=40b,setxattr ZiOkXqg^PobTdZgrtZ]]l^Rap_tfSQoUQqaefj]] (69) in=40b] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.763657+0000", 2024-09-17T18:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.244462358, 2024-09-17T18:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033376057000000001, 2024-09-17T18:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 339 2024-09-17T18:16:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.763657+0000", 2024-09-17T18:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.763657+0000", 2024-09-17T18:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.763660+0000", 2024-09-17T18:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2389999999999998e-06 2024-09-17T18:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.763972+0000", 2024-09-17T18:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031217300000000001 2024-09-17T18:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764069+0000", 2024-09-17T18:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6099000000000003e-05 2024-09-17T18:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764094+0000", 2024-09-17T18:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5652000000000001e-05 2024-09-17T18:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764253+0000", 2024-09-17T18:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000159216 2024-09-17T18:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764267+0000", 2024-09-17T18:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.36e-05 2024-09-17T18:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777749+0000", 2024-09-17T18:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013481523 2024-09-17T18:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777928+0000", 2024-09-17T18:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000179662 2024-09-17T18:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.779951+0000", 2024-09-17T18:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020230460000000001 2024-09-17T18:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.796028+0000", 2024-09-17T18:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016076788000000002 2024-09-17T18:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.796663+0000", 2024-09-17T18:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00063526800000000003 2024-09-17T18:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797033+0000", 2024-09-17T18:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036979100000000001 2024-09-17T18:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.021 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:340 3.as0 3:5b87f4c2:::smithi15432074-21:7 [read 535691~54133,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:15.021 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764141+0000", 2024-09-17T18:16:15.021 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.243978194, 2024-09-17T18:16:15.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.032865103999999999, 2024-09-17T18:16:15.021 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.021 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.021 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:15.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 340 2024-09-17T18:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764141+0000", 2024-09-17T18:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764141+0000", 2024-09-17T18:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764143+0000", 2024-09-17T18:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-17T18:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764155+0000", 2024-09-17T18:16:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1345999999999999e-05 2024-09-17T18:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764177+0000", 2024-09-17T18:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2532e-05 2024-09-17T18:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764193+0000", 2024-09-17T18:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6093e-05 2024-09-17T18:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764315+0000", 2024-09-17T18:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121931 2024-09-17T18:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764327+0000", 2024-09-17T18:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1423000000000001e-05 2024-09-17T18:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.769504+0000", 2024-09-17T18:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005177208 2024-09-17T18:16:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.769742+0000", 2024-09-17T18:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023849299999999999 2024-09-17T18:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797006+0000", 2024-09-17T18:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027264004000000001 2024-09-17T18:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:341 3.as0 3:5b87f4c2:::smithi15432074-21:7 [read 0~589824,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764228+0000", 2024-09-17T18:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.243891847999997, 2024-09-17T18:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034228878999999997, 2024-09-17T18:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 341 2024-09-17T18:16:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764228+0000", 2024-09-17T18:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764228+0000", 2024-09-17T18:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764229+0000", 2024-09-17T18:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3039999999999999e-06 2024-09-17T18:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764235+0000", 2024-09-17T18:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1800000000000001e-06 2024-09-17T18:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764247+0000", 2024-09-17T18:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1736000000000001e-05 2024-09-17T18:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764255+0000", 2024-09-17T18:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2530000000000004e-06 2024-09-17T18:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764416+0000", 2024-09-17T18:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016111899999999999 2024-09-17T18:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764432+0000", 2024-09-17T18:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5846e-05 2024-09-17T18:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.770739+0000", 2024-09-17T18:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063069479999999997 2024-09-17T18:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.770999+0000", 2024-09-17T18:16:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025988200000000002 2024-09-17T18:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.798456+0000", 2024-09-17T18:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027457611 2024-09-17T18:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:342 3.as0 3:5b87f4c2:::smithi15432074-21:7 [read 0~589824,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764269+0000", 2024-09-17T18:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.243849926000003, 2024-09-17T18:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035045893000000002, 2024-09-17T18:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 342 2024-09-17T18:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764269+0000", 2024-09-17T18:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764269+0000", 2024-09-17T18:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764270+0000", 2024-09-17T18:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7299999999999995e-07 2024-09-17T18:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764274+0000", 2024-09-17T18:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0570000000000003e-06 2024-09-17T18:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764283+0000", 2024-09-17T18:16:15.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2960000000000004e-06 2024-09-17T18:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764291+0000", 2024-09-17T18:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4329999999999998e-06 2024-09-17T18:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764533+0000", 2024-09-17T18:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024180299999999999 2024-09-17T18:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764548+0000", 2024-09-17T18:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5172e-05 2024-09-17T18:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772076+0000", 2024-09-17T18:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075283499999999996 2024-09-17T18:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772311+0000", 2024-09-17T18:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023469699999999999 2024-09-17T18:16:15.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.799315+0000", 2024-09-17T18:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027004411999999998 2024-09-17T18:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:349 3.as0 3:57f0af22:::smithi15432074-39:head [read 0~2572288,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:15.038 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764536+0000", 2024-09-17T18:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.243583680999997, 2024-09-17T18:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037750283000000003, 2024-09-17T18:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 349 2024-09-17T18:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.039 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764536+0000", 2024-09-17T18:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764536+0000", 2024-09-17T18:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764538+0000", 2024-09-17T18:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.649e-06 2024-09-17T18:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764553+0000", 2024-09-17T18:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4426999999999999e-05 2024-09-17T18:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764591+0000", 2024-09-17T18:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7975000000000001e-05 2024-09-17T18:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764614+0000", 2024-09-17T18:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2789000000000002e-05 2024-09-17T18:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764724+0000", 2024-09-17T18:16:15.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110418 2024-09-17T18:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764737+0000", 2024-09-17T18:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2663000000000001e-05 2024-09-17T18:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.773245+0000", 2024-09-17T18:16:15.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085088690000000005 2024-09-17T18:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.773462+0000", 2024-09-17T18:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021628399999999999 2024-09-17T18:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.802286+0000", 2024-09-17T18:16:15.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028824209 2024-09-17T18:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:350 3.as0 3:57f0af22:::smithi15432074-39:head [read 0~2572288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764660+0000", 2024-09-17T18:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.243459289999997, 2024-09-17T18:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.040875872000000001, 2024-09-17T18:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.045 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 350 2024-09-17T18:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764660+0000", 2024-09-17T18:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764660+0000", 2024-09-17T18:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764662+0000", 2024-09-17T18:16:15.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5999999999999999e-06 2024-09-17T18:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764670+0000", 2024-09-17T18:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7690000000000002e-06 2024-09-17T18:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764692+0000", 2024-09-17T18:16:15.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1852999999999999e-05 2024-09-17T18:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764709+0000", 2024-09-17T18:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6702999999999999e-05 2024-09-17T18:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764803+0000", 2024-09-17T18:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4239000000000004e-05 2024-09-17T18:16:15.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764816+0000", 2024-09-17T18:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3251999999999999e-05 2024-09-17T18:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.774347+0000", 2024-09-17T18:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095306539999999995 2024-09-17T18:16:15.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.774622+0000", 2024-09-17T18:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000275195 2024-09-17T18:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.805536+0000", 2024-09-17T18:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030913606999999999 2024-09-17T18:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.052 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:351 3.as0 3:57f0af22:::smithi15432074-39:head [read 0~2572288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764738+0000", 2024-09-17T18:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.24338092, 2024-09-17T18:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050115125000000003, 2024-09-17T18:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.053 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 351 2024-09-17T18:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764738+0000", 2024-09-17T18:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764738+0000", 2024-09-17T18:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764740+0000", 2024-09-17T18:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3689999999999999e-06 2024-09-17T18:16:15.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764752+0000", 2024-09-17T18:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2607e-05 2024-09-17T18:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764771+0000", 2024-09-17T18:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8759000000000001e-05 2024-09-17T18:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764786+0000", 2024-09-17T18:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4922e-05 2024-09-17T18:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764896+0000", 2024-09-17T18:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010985900000000001 2024-09-17T18:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764914+0000", 2024-09-17T18:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7963000000000001e-05 2024-09-17T18:16:15.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.805681+0000", 2024-09-17T18:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.040767202000000002 2024-09-17T18:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.805820+0000", 2024-09-17T18:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013898200000000001 2024-09-17T18:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.814854+0000", 2024-09-17T18:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090334620000000008 2024-09-17T18:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:355 3.as0 3:591714be:::smithi15432074-11:head [read 0~180224,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764838+0000", 2024-09-17T18:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.243281285000002, 2024-09-17T18:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050658993999999999, 2024-09-17T18:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.060 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 355 2024-09-17T18:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764838+0000", 2024-09-17T18:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764838+0000", 2024-09-17T18:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764840+0000", 2024-09-17T18:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6500000000000001e-06 2024-09-17T18:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764848+0000", 2024-09-17T18:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2099999999999993e-06 2024-09-17T18:16:15.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764867+0000", 2024-09-17T18:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9446e-05 2024-09-17T18:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764883+0000", 2024-09-17T18:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5116000000000001e-05 2024-09-17T18:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764979+0000", 2024-09-17T18:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6329000000000006e-05 2024-09-17T18:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764993+0000", 2024-09-17T18:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3909e-05 2024-09-17T18:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.807139+0000", 2024-09-17T18:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.042146001000000002 2024-09-17T18:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.807373+0000", 2024-09-17T18:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023453100000000001 2024-09-17T18:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.815497+0000", 2024-09-17T18:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081238019999999994 2024-09-17T18:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:356 3.as0 3:591714be:::smithi15432074-11:head [read 137278~42946,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764908+0000", 2024-09-17T18:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.243211250999998, 2024-09-17T18:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.051245559000000003, 2024-09-17T18:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 356 2024-09-17T18:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764908+0000", 2024-09-17T18:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764908+0000", 2024-09-17T18:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764909+0000", 2024-09-17T18:16:15.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.353e-06 2024-09-17T18:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764916+0000", 2024-09-17T18:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8360000000000003e-06 2024-09-17T18:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764934+0000", 2024-09-17T18:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7657000000000001e-05 2024-09-17T18:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764956+0000", 2024-09-17T18:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2452000000000001e-05 2024-09-17T18:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765079+0000", 2024-09-17T18:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012227700000000001 2024-09-17T18:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765095+0000", 2024-09-17T18:16:15.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5985999999999999e-05 2024-09-17T18:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.808162+0000", 2024-09-17T18:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.043067626999999997 2024-09-17T18:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.808280+0000", 2024-09-17T18:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118016 2024-09-17T18:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.816154+0000", 2024-09-17T18:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078733550000000003 2024-09-17T18:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:357 3.as0 3:591714be:::smithi15432074-11:head [read 0~180224,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764981+0000", 2024-09-17T18:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.243138184000003, 2024-09-17T18:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055363373, 2024-09-17T18:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.071 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 357 2024-09-17T18:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764981+0000", 2024-09-17T18:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764981+0000", 2024-09-17T18:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764982+0000", 2024-09-17T18:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2359999999999999e-06 2024-09-17T18:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764990+0000", 2024-09-17T18:16:15.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5530000000000004e-06 2024-09-17T18:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765008+0000", 2024-09-17T18:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7629e-05 2024-09-17T18:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765022+0000", 2024-09-17T18:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3947e-05 2024-09-17T18:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765143+0000", 2024-09-17T18:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121384 2024-09-17T18:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765155+0000", 2024-09-17T18:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1712999999999999e-05 2024-09-17T18:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.809756+0000", 2024-09-17T18:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.044601190999999998 2024-09-17T18:16:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.809901+0000", 2024-09-17T18:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014498700000000001 2024-09-17T18:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.820345+0000", 2024-09-17T18:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010443733 2024-09-17T18:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:365 3.ds0 3:b4393ba6:::smithi15432074-18:head [copy-from ver 38] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:16:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.771149+0000", 2024-09-17T18:16:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.236970425000003, 2024-09-17T18:16:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.042586502999999998, 2024-09-17T18:16:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 365 2024-09-17T18:16:15.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.078 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771149+0000", 2024-09-17T18:16:15.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771149+0000", 2024-09-17T18:16:15.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771152+0000", 2024-09-17T18:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-06 2024-09-17T18:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771167+0000", 2024-09-17T18:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4919000000000001e-05 2024-09-17T18:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771200+0000", 2024-09-17T18:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2515000000000003e-05 2024-09-17T18:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771221+0000", 2024-09-17T18:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1123000000000001e-05 2024-09-17T18:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771375+0000", 2024-09-17T18:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015396299999999999 2024-09-17T18:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771395+0000", 2024-09-17T18:16:15.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-09-17T18:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.774140+0000", 2024-09-17T18:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027452230000000002 2024-09-17T18:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.774299+0000", 2024-09-17T18:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015924600000000001 2024-09-17T18:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.796950+0000", 2024-09-17T18:16:15.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022650358999999998 2024-09-17T18:16:15.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812885+0000", 2024-09-17T18:16:15.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015935451 2024-09-17T18:16:15.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:15.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.813546+0000", 2024-09-17T18:16:15.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066145500000000003 2024-09-17T18:16:15.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.813735+0000", 2024-09-17T18:16:15.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018900000000000001 2024-09-17T18:16:15.083 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.083 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.083 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.083 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:366 3.ds0 3:b4393ba6:::smithi15432074-18:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:16:15.083 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.771279+0000", 2024-09-17T18:16:15.083 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.236840811, 2024-09-17T18:16:15.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033426215000000002, 2024-09-17T18:16:15.083 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.084 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.084 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:15.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.084 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 366 2024-09-17T18:16:15.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.084 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771279+0000", 2024-09-17T18:16:15.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771279+0000", 2024-09-17T18:16:15.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771280+0000", 2024-09-17T18:16:15.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6700000000000001e-06 2024-09-17T18:16:15.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771384+0000", 2024-09-17T18:16:15.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103866 2024-09-17T18:16:15.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771408+0000", 2024-09-17T18:16:15.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3489000000000002e-05 2024-09-17T18:16:15.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771442+0000", 2024-09-17T18:16:15.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4085000000000003e-05 2024-09-17T18:16:15.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771564+0000", 2024-09-17T18:16:15.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012266499999999999 2024-09-17T18:16:15.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:15.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771581+0000", 2024-09-17T18:16:15.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7161999999999999e-05 2024-09-17T18:16:15.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.774574+0000", 2024-09-17T18:16:15.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029929290000000001 2024-09-17T18:16:15.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-09-17T18:16:15.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.774648+0000", 2024-09-17T18:16:15.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3326999999999998e-05 2024-09-17T18:16:15.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.804326+0000", 2024-09-17T18:16:15.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029678067999999998 2024-09-17T18:16:15.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.804503+0000", 2024-09-17T18:16:15.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017732699999999999 2024-09-17T18:16:15.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.804705+0000", 2024-09-17T18:16:15.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020162700000000001 2024-09-17T18:16:15.089 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.089 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.089 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.089 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:416 3.as0 3:57f0af22:::smithi15432074-39:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-17T18:16:15.090 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:45.856064+0000", 2024-09-17T18:16:15.090 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.152054940999999, 2024-09-17T18:16:15.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033397346000000001, 2024-09-17T18:16:15.090 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.090 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.090 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:15.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.090 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 416 2024-09-17T18:16:15.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.090 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856064+0000", 2024-09-17T18:16:15.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856064+0000", 2024-09-17T18:16:15.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856066+0000", 2024-09-17T18:16:15.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.237e-06 2024-09-17T18:16:15.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856071+0000", 2024-09-17T18:16:15.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4689999999999996e-06 2024-09-17T18:16:15.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856089+0000", 2024-09-17T18:16:15.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7506000000000001e-05 2024-09-17T18:16:15.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856102+0000", 2024-09-17T18:16:15.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3713000000000001e-05 2024-09-17T18:16:15.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.875096+0000", 2024-09-17T18:16:15.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018993877999999999 2024-09-17T18:16:15.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:15.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.875228+0000", 2024-09-17T18:16:15.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000132065 2024-09-17T18:16:15.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.881248+0000", 2024-09-17T18:16:15.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060196520000000003 2024-09-17T18:16:15.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.881567+0000", 2024-09-17T18:16:15.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031875499999999999 2024-09-17T18:16:15.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.889462+0000", 2024-09-17T18:16:15.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007895071 2024-09-17T18:16:15.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.095 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.095 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:418 3.as0 3:591714be:::smithi15432074-11:e [read 77516~102708,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-17T18:16:15.095 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:45.856190+0000", 2024-09-17T18:16:15.095 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.151928875999999, 2024-09-17T18:16:15.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031900123000000002, 2024-09-17T18:16:15.095 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.095 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.095 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:15.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.096 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.096 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.096 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 418 2024-09-17T18:16:15.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.096 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856190+0000", 2024-09-17T18:16:15.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856190+0000", 2024-09-17T18:16:15.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856192+0000", 2024-09-17T18:16:15.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.093e-06 2024-09-17T18:16:15.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856201+0000", 2024-09-17T18:16:15.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.73e-06 2024-09-17T18:16:15.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856218+0000", 2024-09-17T18:16:15.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6359e-05 2024-09-17T18:16:15.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856237+0000", 2024-09-17T18:16:15.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.961e-05 2024-09-17T18:16:15.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.877256+0000", 2024-09-17T18:16:15.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021018934999999999 2024-09-17T18:16:15.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.877519+0000", 2024-09-17T18:16:15.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026259800000000001 2024-09-17T18:16:15.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.888091+0000", 2024-09-17T18:16:15.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010571798 2024-09-17T18:16:15.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.099 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.100 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:419 3.as0 3:591714be:::smithi15432074-11:e [read 165282~14942,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-17T18:16:15.100 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:45.856254+0000", 2024-09-17T18:16:15.100 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.151865461, 2024-09-17T18:16:15.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.032807557000000001, 2024-09-17T18:16:15.100 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.100 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.100 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:15.100 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.100 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.100 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.100 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 419 2024-09-17T18:16:15.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.101 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856254+0000", 2024-09-17T18:16:15.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856254+0000", 2024-09-17T18:16:15.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856255+0000", 2024-09-17T18:16:15.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.066e-06 2024-09-17T18:16:15.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856261+0000", 2024-09-17T18:16:15.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.404e-06 2024-09-17T18:16:15.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856278+0000", 2024-09-17T18:16:15.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6415000000000001e-05 2024-09-17T18:16:15.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856291+0000", 2024-09-17T18:16:15.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2836999999999999e-05 2024-09-17T18:16:15.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.878696+0000", 2024-09-17T18:16:15.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022405571999999999 2024-09-17T18:16:15.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.878898+0000", 2024-09-17T18:16:15.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020193000000000001 2024-09-17T18:16:15.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.889061+0000", 2024-09-17T18:16:15.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010163333 2024-09-17T18:16:15.104 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.104 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.104 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.104 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:545 3.as0 3:5aa4d9c6:::smithi15432074-15:head [copy-from ver 123] snapc 12=[12,11,10,d,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T18:16:15.105 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:54.356779+0000", 2024-09-17T18:16:15.105 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.651339991, 2024-09-17T18:16:15.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033097537000000003, 2024-09-17T18:16:15.105 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.105 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.105 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:15.105 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.105 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.105 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.105 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 545 2024-09-17T18:16:15.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.105 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.356779+0000", 2024-09-17T18:16:15.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.356779+0000", 2024-09-17T18:16:15.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.356783+0000", 2024-09-17T18:16:15.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9330000000000003e-06 2024-09-17T18:16:15.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.356802+0000", 2024-09-17T18:16:15.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9009e-05 2024-09-17T18:16:15.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.356850+0000", 2024-09-17T18:16:15.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7895999999999997e-05 2024-09-17T18:16:15.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.356877+0000", 2024-09-17T18:16:15.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6389000000000001e-05 2024-09-17T18:16:15.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357067+0000", 2024-09-17T18:16:15.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019028799999999999 2024-09-17T18:16:15.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:15.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357086+0000", 2024-09-17T18:16:15.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9069e-05 2024-09-17T18:16:15.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.361047+0000", 2024-09-17T18:16:15.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003960819 2024-09-17T18:16:15.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.361193+0000", 2024-09-17T18:16:15.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145759 2024-09-17T18:16:15.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.382375+0000", 2024-09-17T18:16:15.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021182764 2024-09-17T18:16:15.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.388773+0000", 2024-09-17T18:16:15.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063976129999999999 2024-09-17T18:16:15.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:15.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.389751+0000", 2024-09-17T18:16:15.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00097763800000000007 2024-09-17T18:16:15.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.389877+0000", 2024-09-17T18:16:15.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012636 2024-09-17T18:16:15.111 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.111 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.111 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.111 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:547 3.ds0 3:bae030be:::smithi15432074-12:head [copy-from ver 82] snapc 12=[12,11,10,d,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T18:16:15.111 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:54.357048+0000", 2024-09-17T18:16:15.111 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.651071719000001, 2024-09-17T18:16:15.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062720789999999998, 2024-09-17T18:16:15.111 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.111 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.111 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:15.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.112 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 547 2024-09-17T18:16:15.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.112 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357048+0000", 2024-09-17T18:16:15.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357048+0000", 2024-09-17T18:16:15.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357049+0000", 2024-09-17T18:16:15.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3629999999999999e-06 2024-09-17T18:16:15.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357055+0000", 2024-09-17T18:16:15.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2530000000000001e-06 2024-09-17T18:16:15.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357068+0000", 2024-09-17T18:16:15.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2449999999999999e-05 2024-09-17T18:16:15.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357076+0000", 2024-09-17T18:16:15.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4659999999999999e-06 2024-09-17T18:16:15.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357191+0000", 2024-09-17T18:16:15.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001147 2024-09-17T18:16:15.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:15.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357212+0000", 2024-09-17T18:16:15.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1406000000000001e-05 2024-09-17T18:16:15.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.361032+0000", 2024-09-17T18:16:15.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038197970000000002 2024-09-17T18:16:15.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.361193+0000", 2024-09-17T18:16:15.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016107200000000001 2024-09-17T18:16:15.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.404397+0000", 2024-09-17T18:16:15.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.043203762 2024-09-17T18:16:15.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.415965+0000", 2024-09-17T18:16:15.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011568531 2024-09-17T18:16:15.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:15.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.419604+0000", 2024-09-17T18:16:15.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036381289999999999 2024-09-17T18:16:15.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.419768+0000", 2024-09-17T18:16:15.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016486100000000001 2024-09-17T18:16:15.117 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.118 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.118 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:548 3.ds0 3:bae030be:::smithi15432074-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e59)", 2024-09-17T18:16:15.118 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:54.357102+0000", 2024-09-17T18:16:15.118 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.651017407000001, 2024-09-17T18:16:15.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056672487000000001, 2024-09-17T18:16:15.118 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.118 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.118 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:15.118 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.118 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.119 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 548 2024-09-17T18:16:15.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.119 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357102+0000", 2024-09-17T18:16:15.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357102+0000", 2024-09-17T18:16:15.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357103+0000", 2024-09-17T18:16:15.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.043e-06 2024-09-17T18:16:15.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357108+0000", 2024-09-17T18:16:15.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4060000000000004e-06 2024-09-17T18:16:15.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357125+0000", 2024-09-17T18:16:15.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6543000000000001e-05 2024-09-17T18:16:15.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357139+0000", 2024-09-17T18:16:15.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3903000000000001e-05 2024-09-17T18:16:15.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357263+0000", 2024-09-17T18:16:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124277 2024-09-17T18:16:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357274+0000", 2024-09-17T18:16:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0496000000000001e-05 2024-09-17T18:16:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.361448+0000", 2024-09-17T18:16:15.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041742890000000003 2024-09-17T18:16:15.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-09-17T18:16:15.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.361522+0000", 2024-09-17T18:16:15.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4274000000000001e-05 2024-09-17T18:16:15.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.413301+0000", 2024-09-17T18:16:15.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.051778519000000002 2024-09-17T18:16:15.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.413533+0000", 2024-09-17T18:16:15.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023213899999999999 2024-09-17T18:16:15.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.413774+0000", 2024-09-17T18:16:15.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024159800000000001 2024-09-17T18:16:15.124 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.125 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.125 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:553 3.as0 3:52022904:::smithi15432074-17:head [setxattr _header (57) in=7b] snapc 12=[12,11,10,d,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T18:16:15.125 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:54.374001+0000", 2024-09-17T18:16:15.125 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.634118852, 2024-09-17T18:16:15.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035713573999999998, 2024-09-17T18:16:15.125 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.125 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.125 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:15.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.126 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 553 2024-09-17T18:16:15.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.126 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374001+0000", 2024-09-17T18:16:15.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374001+0000", 2024-09-17T18:16:15.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374002+0000", 2024-09-17T18:16:15.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4330000000000001e-06 2024-09-17T18:16:15.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374012+0000", 2024-09-17T18:16:15.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0103e-05 2024-09-17T18:16:15.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374027+0000", 2024-09-17T18:16:15.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5383000000000002e-05 2024-09-17T18:16:15.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374043+0000", 2024-09-17T18:16:15.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5206e-05 2024-09-17T18:16:15.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.400787+0000", 2024-09-17T18:16:15.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026744378999999999 2024-09-17T18:16:15.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.401071+0000", 2024-09-17T18:16:15.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028405100000000001 2024-09-17T18:16:15.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.402326+0000", 2024-09-17T18:16:15.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0012549760000000001 2024-09-17T18:16:15.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.405480+0000", 2024-09-17T18:16:15.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031536860000000002 2024-09-17T18:16:15.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:15.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.409464+0000", 2024-09-17T18:16:15.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039840120000000003 2024-09-17T18:16:15.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.409714+0000", 2024-09-17T18:16:15.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025034500000000002 2024-09-17T18:16:15.130 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.130 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.130 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.131 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:554 3.as0 3:52022904:::smithi15432074-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e59)", 2024-09-17T18:16:15.131 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:54.374064+0000", 2024-09-17T18:16:15.131 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.634055537999998, 2024-09-17T18:16:15.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.039468334000000001, 2024-09-17T18:16:15.131 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:15.131 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:15.131 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:15.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:15.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:15.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:15.131 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 554 2024-09-17T18:16:15.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.132 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:15.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:15.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374064+0000", 2024-09-17T18:16:15.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:15.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374064+0000", 2024-09-17T18:16:15.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:15.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:15.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374065+0000", 2024-09-17T18:16:15.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5340000000000001e-06 2024-09-17T18:16:15.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:15.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374071+0000", 2024-09-17T18:16:15.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0460000000000002e-06 2024-09-17T18:16:15.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:15.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374093+0000", 2024-09-17T18:16:15.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1279000000000001e-05 2024-09-17T18:16:15.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374108+0000", 2024-09-17T18:16:15.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5460000000000001e-05 2024-09-17T18:16:15.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.403163+0000", 2024-09-17T18:16:15.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029054592000000001 2024-09-17T18:16:15.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:15.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.403431+0000", 2024-09-17T18:16:15.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026833100000000002 2024-09-17T18:16:15.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:15.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.411082+0000", 2024-09-17T18:16:15.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076512749999999999 2024-09-17T18:16:15.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:15.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.411405+0000", 2024-09-17T18:16:15.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000322553 2024-09-17T18:16:15.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:15.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:15.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:15.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.413532+0000", 2024-09-17T18:16:15.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021272639999999998 2024-09-17T18:16:15.136 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.136 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.136 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.136 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:15.136 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:15.137 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:15.138 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T18:16:15.139 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:15.134+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:15.239 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:15.237+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:15.268 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:15.268 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:16:15.269 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:16:15.269 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:15.282 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T18:16:15.340 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:15.337+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:15.405 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:15.406 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:16:15.406 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:16:15.406 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:16:15.406 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:15.419 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T18:16:15.441 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:16:15.438+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:16:15.498 INFO:tasks.rados.rados.0.smithi154.stdout:333: done (1 left) 2024-09-17T18:16:15.498 INFO:tasks.rados.rados.0.smithi154.stdout:334: read oid 18 snap -1 2024-09-17T18:16:15.498 INFO:tasks.rados.rados.0.smithi154.stdout:334: expect (ObjNum 129 snap 26 seq_num 129) 2024-09-17T18:16:15.499 INFO:tasks.rados.rados.0.smithi154.stdout:335: copy_from oid 9 from oid 21 current snap is 27 2024-09-17T18:16:15.499 INFO:tasks.rados.rados.0.smithi154.stdout:336: read oid 50 snap -1 2024-09-17T18:16:15.499 INFO:tasks.rados.rados.0.smithi154.stdout:336: expect (ObjNum 101 snap 20 seq_num 101) 2024-09-17T18:16:15.499 INFO:tasks.rados.rados.0.smithi154.stdout:337: read oid 43 snap -1 2024-09-17T18:16:15.499 INFO:tasks.rados.rados.0.smithi154.stdout:337: expect (ObjNum 78 snap 7 seq_num 78) 2024-09-17T18:16:15.499 INFO:tasks.rados.rados.0.smithi154.stdout:338: read oid 44 snap -1 2024-09-17T18:16:15.500 INFO:tasks.rados.rados.0.smithi154.stdout:338: expect deleted 2024-09-17T18:16:15.500 INFO:tasks.rados.rados.0.smithi154.stdout:339: copy_from oid 2 from oid 38 current snap is 27 2024-09-17T18:16:15.500 INFO:tasks.rados.rados.0.smithi154.stdout:340: snap_create 2024-09-17T18:16:15.500 INFO:teuthology.orchestra.run.smithi087.stderr:nodeep-scrub is set 2024-09-17T18:16:15.531 INFO:tasks.rados.rados.0.smithi154.stdout:336: expect (ObjNum 101 snap 20 seq_num 101) 2024-09-17T18:16:15.542 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:15.538+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:15.544 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 2303956 2024-09-17T18:16:15.558 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:15.558 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:16:15.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:16:15.559 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-17T18:16:15.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.559 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 42/31 ECSubWrite(tid=40, reqid=client.4565.0:363, at_version=42'26, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:16:15.559 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.767056+0000", 2024-09-17T18:16:15.559 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 37.789680410999999, 2024-09-17T18:16:15.559 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022714127000000001, 2024-09-17T18:16:15.559 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.559 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.559 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.559 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.559 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.559 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.560 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767056+0000", 2024-09-17T18:16:15.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.560 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.560 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767056+0000", 2024-09-17T18:16:15.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.560 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.560 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.560 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767057+0000", 2024-09-17T18:16:15.560 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4600000000000005e-07 2024-09-17T18:16:15.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767098+0000", 2024-09-17T18:16:15.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1013000000000002e-05 2024-09-17T18:16:15.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767126+0000", 2024-09-17T18:16:15.561 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8399e-05 2024-09-17T18:16:15.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.561 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.561 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.561 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767150+0000", 2024-09-17T18:16:15.562 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.393e-05 2024-09-17T18:16:15.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.564 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.564 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.564 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767397+0000", 2024-09-17T18:16:15.564 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00024644499999999998 2024-09-17T18:16:15.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767421+0000", 2024-09-17T18:16:15.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4643000000000001e-05 2024-09-17T18:16:15.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.565 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789658+0000", 2024-09-17T18:16:15.565 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022236949999999998 2024-09-17T18:16:15.565 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.565 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.565 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.566 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789770+0000", 2024-09-17T18:16:15.566 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011220100000000001 2024-09-17T18:16:15.566 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.566 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.566 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.566 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.566 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 42/31 ECSubWrite(tid=15, reqid=osd.3.0:14, at_version=0'0, trim_to=0'0, roll_forward_to=42'11))", 2024-09-17T18:16:15.566 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.772587+0000", 2024-09-17T18:16:15.567 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 37.784149272000001, 2024-09-17T18:16:15.567 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.014350889, 2024-09-17T18:16:15.567 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.567 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.567 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.567 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.568 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.568 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772587+0000", 2024-09-17T18:16:15.568 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.568 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.569 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.569 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772587+0000", 2024-09-17T18:16:15.569 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.569 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.570 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.570 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772590+0000", 2024-09-17T18:16:15.570 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.137e-06 2024-09-17T18:16:15.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.570 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.570 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.570 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772619+0000", 2024-09-17T18:16:15.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9615999999999999e-05 2024-09-17T18:16:15.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.571 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.571 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772662+0000", 2024-09-17T18:16:15.571 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3179000000000001e-05 2024-09-17T18:16:15.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.572 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.572 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.572 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772689+0000", 2024-09-17T18:16:15.572 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7123000000000001e-05 2024-09-17T18:16:15.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.573 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.573 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.573 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772889+0000", 2024-09-17T18:16:15.573 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019974000000000001 2024-09-17T18:16:15.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.574 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.574 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772914+0000", 2024-09-17T18:16:15.574 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4791999999999999e-05 2024-09-17T18:16:15.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.574 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.575 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.575 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.786833+0000", 2024-09-17T18:16:15.575 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013919030000000001 2024-09-17T18:16:15.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.575 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.576 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.576 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.786938+0000", 2024-09-17T18:16:15.576 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105272 2024-09-17T18:16:15.576 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.576 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.576 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.577 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.577 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 42/31 ECSubWrite(tid=41, reqid=osd.7.0:41, at_version=42'28, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:16:15.577 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.772597+0000", 2024-09-17T18:16:15.578 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 37.784139805000002, 2024-09-17T18:16:15.578 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017244046999999998, 2024-09-17T18:16:15.578 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.578 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.578 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.578 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.579 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.579 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.579 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772597+0000", 2024-09-17T18:16:15.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.580 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.580 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.580 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.580 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772597+0000", 2024-09-17T18:16:15.580 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.581 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.581 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.581 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772599+0000", 2024-09-17T18:16:15.581 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2960000000000001e-06 2024-09-17T18:16:15.581 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.581 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.581 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772652+0000", 2024-09-17T18:16:15.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2685999999999997e-05 2024-09-17T18:16:15.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772687+0000", 2024-09-17T18:16:15.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5026e-05 2024-09-17T18:16:15.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.582 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.582 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.582 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772711+0000", 2024-09-17T18:16:15.582 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3903000000000001e-05 2024-09-17T18:16:15.582 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772918+0000", 2024-09-17T18:16:15.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000207116 2024-09-17T18:16:15.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772941+0000", 2024-09-17T18:16:15.583 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2940000000000001e-05 2024-09-17T18:16:15.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.583 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.583 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.583 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789784+0000", 2024-09-17T18:16:15.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016843563999999998 2024-09-17T18:16:15.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.584 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.584 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789841+0000", 2024-09-17T18:16:15.584 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6515999999999999e-05 2024-09-17T18:16:15.584 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.584 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.584 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.584 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.584 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.584 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 42/31 ECSubWrite(tid=42, reqid=osd.7.0:42, at_version=42'30, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:16:15.585 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.776416+0000", 2024-09-17T18:16:15.585 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 37.780320912999997, 2024-09-17T18:16:15.585 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015784901, 2024-09-17T18:16:15.585 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.585 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.585 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.585 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.585 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.585 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.585 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776416+0000", 2024-09-17T18:16:15.585 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.585 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.585 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776416+0000", 2024-09-17T18:16:15.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776418+0000", 2024-09-17T18:16:15.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9190000000000002e-06 2024-09-17T18:16:15.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.586 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.586 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.586 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776502+0000", 2024-09-17T18:16:15.586 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4308999999999995e-05 2024-09-17T18:16:15.586 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776548+0000", 2024-09-17T18:16:15.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6192000000000001e-05 2024-09-17T18:16:15.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776739+0000", 2024-09-17T18:16:15.587 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019082999999999999 2024-09-17T18:16:15.587 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.587 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.587 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.587 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.780985+0000", 2024-09-17T18:16:15.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0042460909999999996 2024-09-17T18:16:15.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.781000+0000", 2024-09-17T18:16:15.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5213e-05 2024-09-17T18:16:15.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.588 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.588 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792098+0000", 2024-09-17T18:16:15.588 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011097325 2024-09-17T18:16:15.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.588 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.589 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.589 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792201+0000", 2024-09-17T18:16:15.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103022 2024-09-17T18:16:15.589 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.589 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.589 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.589 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.589 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.589 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.fs4 43/31 ECSubWrite(tid=182, reqid=osd.13.0:182, at_version=43'14, trim_to=0'0, roll_forward_to=42'12))", 2024-09-17T18:16:15.589 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.775836+0000", 2024-09-17T18:16:15.589 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 36.780900299000002, 2024-09-17T18:16:15.589 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0074634699999999998, 2024-09-17T18:16:15.589 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.590 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.590 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.590 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.590 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.775836+0000", 2024-09-17T18:16:15.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.590 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.590 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.590 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.775836+0000", 2024-09-17T18:16:15.590 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.775837+0000", 2024-09-17T18:16:15.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7700000000000004e-07 2024-09-17T18:16:15.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.775895+0000", 2024-09-17T18:16:15.591 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8195000000000001e-05 2024-09-17T18:16:15.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.591 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.591 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.591 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.775920+0000", 2024-09-17T18:16:15.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5282999999999998e-05 2024-09-17T18:16:15.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.592 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.592 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.592 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.775943+0000", 2024-09-17T18:16:15.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2836e-05 2024-09-17T18:16:15.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.592 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.592 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.592 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776110+0000", 2024-09-17T18:16:15.592 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016691300000000001 2024-09-17T18:16:15.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.592 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.593 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.593 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.776140+0000", 2024-09-17T18:16:15.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0307e-05 2024-09-17T18:16:15.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.593 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.593 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.783188+0000", 2024-09-17T18:16:15.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0070471079999999998 2024-09-17T18:16:15.593 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.593 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.593 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.783300+0000", 2024-09-17T18:16:15.593 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011225100000000001 2024-09-17T18:16:15.594 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.594 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.594 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.594 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.594 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.3s5 43/31 ECSubWrite(tid=16, reqid=osd.10.0:16, at_version=43'10, trim_to=0'0, roll_forward_to=35'8))", 2024-09-17T18:16:15.594 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.778590+0000", 2024-09-17T18:16:15.594 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 36.778146903, 2024-09-17T18:16:15.594 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0073565480000000001, 2024-09-17T18:16:15.594 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.594 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.594 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.594 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.778590+0000", 2024-09-17T18:16:15.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.778590+0000", 2024-09-17T18:16:15.595 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.595 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.595 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.595 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.595 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.778591+0000", 2024-09-17T18:16:15.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8599999999999997e-07 2024-09-17T18:16:15.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.778736+0000", 2024-09-17T18:16:15.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014535399999999999 2024-09-17T18:16:15.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.596 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.596 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.596 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.778780+0000", 2024-09-17T18:16:15.596 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4419000000000003e-05 2024-09-17T18:16:15.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.597 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.597 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.597 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.778812+0000", 2024-09-17T18:16:15.597 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1405999999999997e-05 2024-09-17T18:16:15.597 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.597 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.597 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.597 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779020+0000", 2024-09-17T18:16:15.597 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020835299999999999 2024-09-17T18:16:15.597 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.597 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.597 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.598 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.779046+0000", 2024-09-17T18:16:15.598 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5989000000000001e-05 2024-09-17T18:16:15.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.598 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.785852+0000", 2024-09-17T18:16:15.598 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0068063830000000001 2024-09-17T18:16:15.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.598 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.598 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.598 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.785946+0000", 2024-09-17T18:16:15.598 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3857999999999995e-05 2024-09-17T18:16:15.598 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.598 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.599 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.599 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.599 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.3s5 54/31 ECSubWrite(tid=24, reqid=osd.10.0:24, at_version=54'17, trim_to=0'0, roll_forward_to=53'15))", 2024-09-17T18:16:15.599 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.328294+0000", 2024-09-17T18:16:15.599 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.228443137999999, 2024-09-17T18:16:15.599 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0064417060000000002, 2024-09-17T18:16:15.599 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.599 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.599 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.599 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.599 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328294+0000", 2024-09-17T18:16:15.600 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.600 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.600 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.600 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328294+0000", 2024-09-17T18:16:15.600 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.600 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.600 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.600 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.600 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328294+0000", 2024-09-17T18:16:15.600 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8999999999999996e-07 2024-09-17T18:16:15.601 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.601 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.601 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.601 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328349+0000", 2024-09-17T18:16:15.601 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4812999999999998e-05 2024-09-17T18:16:15.601 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.601 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.601 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.601 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328380+0000", 2024-09-17T18:16:15.601 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1343000000000001e-05 2024-09-17T18:16:15.602 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.602 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.602 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.602 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328404+0000", 2024-09-17T18:16:15.602 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4059000000000001e-05 2024-09-17T18:16:15.602 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.602 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.602 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.602 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328553+0000", 2024-09-17T18:16:15.602 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000148744 2024-09-17T18:16:15.602 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.602 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.602 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.603 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.328599+0000", 2024-09-17T18:16:15.603 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6020000000000003e-05 2024-09-17T18:16:15.603 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.603 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.603 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.603 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.334611+0000", 2024-09-17T18:16:15.603 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0060116650000000002 2024-09-17T18:16:15.603 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.603 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.603 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.604 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.334735+0000", 2024-09-17T18:16:15.604 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012437200000000001 2024-09-17T18:16:15.604 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.604 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.604 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.604 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.604 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.604 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 70/31 ECSubWrite(tid=37, reqid=client.4565.0:659, at_version=70'28, trim_to=0'0, roll_forward_to=66'27))", 2024-09-17T18:16:15.604 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:05.448719+0000", 2024-09-17T18:16:15.604 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.108017802999999, 2024-09-17T18:16:15.604 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0078130560000000005, 2024-09-17T18:16:15.604 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.604 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.605 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.605 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.605 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.605 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.605 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:05.448719+0000", 2024-09-17T18:16:15.605 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.605 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.605 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.605 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.605 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:05.448719+0000", 2024-09-17T18:16:15.605 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:05.448719+0000", 2024-09-17T18:16:15.606 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2000000000000001e-07 2024-09-17T18:16:15.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:05.449196+0000", 2024-09-17T18:16:15.606 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00047713999999999998 2024-09-17T18:16:15.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.606 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.606 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:05.449251+0000", 2024-09-17T18:16:15.607 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4750999999999998e-05 2024-09-17T18:16:15.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.607 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.607 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:05.449278+0000", 2024-09-17T18:16:15.607 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6828000000000001e-05 2024-09-17T18:16:15.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.607 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.607 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:05.449528+0000", 2024-09-17T18:16:15.608 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00025007499999999999 2024-09-17T18:16:15.608 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.608 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.608 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.608 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:05.449557+0000", 2024-09-17T18:16:15.608 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8605000000000001e-05 2024-09-17T18:16:15.608 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.608 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.608 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.608 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:05.456420+0000", 2024-09-17T18:16:15.608 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0068636219999999998 2024-09-17T18:16:15.608 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.608 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.609 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.609 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:05.456532+0000", 2024-09-17T18:16:15.609 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111715 2024-09-17T18:16:15.609 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.609 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.609 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.609 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.609 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.609 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 75/31 ECSubWrite(tid=49, reqid=osd.3.0:49, at_version=75'41, trim_to=0'0, roll_forward_to=73'37))", 2024-09-17T18:16:15.609 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.323288+0000", 2024-09-17T18:16:15.609 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.2334488559999999, 2024-09-17T18:16:15.609 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010937696, 2024-09-17T18:16:15.610 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.610 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.610 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.610 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.610 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.610 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.610 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.323288+0000", 2024-09-17T18:16:15.610 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.610 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.610 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.611 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.611 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.323288+0000", 2024-09-17T18:16:15.611 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.611 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.611 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.611 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.611 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.323290+0000", 2024-09-17T18:16:15.611 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9659999999999999e-06 2024-09-17T18:16:15.611 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.611 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.611 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.611 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.323340+0000", 2024-09-17T18:16:15.611 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0382e-05 2024-09-17T18:16:15.611 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.612 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.612 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.323371+0000", 2024-09-17T18:16:15.612 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0919e-05 2024-09-17T18:16:15.612 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.612 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.612 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.323394+0000", 2024-09-17T18:16:15.612 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2772000000000002e-05 2024-09-17T18:16:15.612 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.612 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.613 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.324975+0000", 2024-09-17T18:16:15.613 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001581369 2024-09-17T18:16:15.613 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.613 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.613 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.613 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.325004+0000", 2024-09-17T18:16:15.613 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8319000000000001e-05 2024-09-17T18:16:15.613 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.613 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.614 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.614 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.334122+0000", 2024-09-17T18:16:15.614 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0091185329999999998 2024-09-17T18:16:15.614 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.614 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.614 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.614 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.334226+0000", 2024-09-17T18:16:15.614 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103436 2024-09-17T18:16:15.614 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.614 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.614 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.614 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.614 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.615 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 75/31 ECSubWrite(tid=153, reqid=osd.7.0:153, at_version=75'141, trim_to=0'0, roll_forward_to=73'137))", 2024-09-17T18:16:15.615 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.327049+0000", 2024-09-17T18:16:15.615 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.2296872309999998, 2024-09-17T18:16:15.615 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011607802, 2024-09-17T18:16:15.615 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.615 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.615 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.615 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.615 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.615 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.615 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327049+0000", 2024-09-17T18:16:15.615 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.615 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.616 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.616 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.616 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327049+0000", 2024-09-17T18:16:15.616 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.616 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.616 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.616 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.616 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327051+0000", 2024-09-17T18:16:15.616 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7740000000000001e-06 2024-09-17T18:16:15.616 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.616 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.616 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.617 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327108+0000", 2024-09-17T18:16:15.617 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6548000000000001e-05 2024-09-17T18:16:15.617 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.617 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.617 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.617 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327137+0000", 2024-09-17T18:16:15.617 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8931000000000001e-05 2024-09-17T18:16:15.617 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.617 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.617 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.617 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327159+0000", 2024-09-17T18:16:15.617 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1968999999999999e-05 2024-09-17T18:16:15.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.618 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.618 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327342+0000", 2024-09-17T18:16:15.618 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018296999999999999 2024-09-17T18:16:15.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.618 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.618 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327367+0000", 2024-09-17T18:16:15.618 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5802000000000001e-05 2024-09-17T18:16:15.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.619 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.619 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338557+0000", 2024-09-17T18:16:15.619 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011189952 2024-09-17T18:16:15.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.619 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.619 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.619 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338657+0000", 2024-09-17T18:16:15.619 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9856000000000001e-05 2024-09-17T18:16:15.619 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.619 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.620 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.620 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.620 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.620 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s3 75/31 ECSubWrite(tid=82, reqid=osd.0.0:82, at_version=75'70, trim_to=0'0, roll_forward_to=73'66))", 2024-09-17T18:16:15.620 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.329057+0000", 2024-09-17T18:16:15.621 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.2276796460000003, 2024-09-17T18:16:15.621 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013499446999999999, 2024-09-17T18:16:15.621 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.621 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.621 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.621 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.621 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.621 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.621 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.329057+0000", 2024-09-17T18:16:15.621 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.622 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.622 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.622 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.622 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.329057+0000", 2024-09-17T18:16:15.622 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.622 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.622 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.622 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.622 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.329059+0000", 2024-09-17T18:16:15.622 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4030000000000001e-06 2024-09-17T18:16:15.622 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.622 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.622 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.623 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.329113+0000", 2024-09-17T18:16:15.623 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3498000000000002e-05 2024-09-17T18:16:15.623 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.623 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.623 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.623 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.329156+0000", 2024-09-17T18:16:15.623 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3021e-05 2024-09-17T18:16:15.623 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.623 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.623 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.623 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.329179+0000", 2024-09-17T18:16:15.623 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2765999999999999e-05 2024-09-17T18:16:15.624 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.624 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.331556+0000", 2024-09-17T18:16:15.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023774719999999998 2024-09-17T18:16:15.624 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.624 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.624 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.331581+0000", 2024-09-17T18:16:15.624 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4949000000000001e-05 2024-09-17T18:16:15.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.625 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.625 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.342455+0000", 2024-09-17T18:16:15.625 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010874007999999999 2024-09-17T18:16:15.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.625 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.625 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.625 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.342556+0000", 2024-09-17T18:16:15.625 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010132999999999999 2024-09-17T18:16:15.626 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.626 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.626 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.626 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.626 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.626 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 75/31 ECSubWrite(tid=50, reqid=osd.3.0:49, at_version=0'0, trim_to=0'0, roll_forward_to=75'41))", 2024-09-17T18:16:15.626 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.335246+0000", 2024-09-17T18:16:15.626 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.2214906540000001, 2024-09-17T18:16:15.626 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0078418849999999998, 2024-09-17T18:16:15.626 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.626 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.626 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.627 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.627 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.627 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335246+0000", 2024-09-17T18:16:15.627 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.627 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.627 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.627 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.627 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335246+0000", 2024-09-17T18:16:15.627 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.627 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335248+0000", 2024-09-17T18:16:15.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1229999999999998e-06 2024-09-17T18:16:15.628 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.628 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.628 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335291+0000", 2024-09-17T18:16:15.628 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2441999999999998e-05 2024-09-17T18:16:15.628 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.628 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.629 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.629 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335322+0000", 2024-09-17T18:16:15.629 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1878999999999998e-05 2024-09-17T18:16:15.629 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.629 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.629 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.629 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335344+0000", 2024-09-17T18:16:15.629 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1962000000000001e-05 2024-09-17T18:16:15.629 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.629 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.629 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.629 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335492+0000", 2024-09-17T18:16:15.629 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014782700000000001 2024-09-17T18:16:15.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.630 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335517+0000", 2024-09-17T18:16:15.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4555000000000001e-05 2024-09-17T18:16:15.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.630 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.630 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.342993+0000", 2024-09-17T18:16:15.630 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.007476384 2024-09-17T18:16:15.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.630 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.631 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.343088+0000", 2024-09-17T18:16:15.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4712999999999999e-05 2024-09-17T18:16:15.631 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.631 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.631 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.631 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 75/31 ECSubWrite(tid=154, reqid=osd.7.0:153, at_version=0'0, trim_to=0'0, roll_forward_to=75'141))", 2024-09-17T18:16:15.631 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.348831+0000", 2024-09-17T18:16:15.631 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.2079053870000003, 2024-09-17T18:16:15.631 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0079211650000000008, 2024-09-17T18:16:15.631 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.631 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.631 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.632 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.348831+0000", 2024-09-17T18:16:15.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.632 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.348831+0000", 2024-09-17T18:16:15.632 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.632 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.633 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.348833+0000", 2024-09-17T18:16:15.633 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5799999999999999e-06 2024-09-17T18:16:15.633 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.633 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.633 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.633 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.348858+0000", 2024-09-17T18:16:15.633 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5578000000000001e-05 2024-09-17T18:16:15.633 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.633 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.633 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.633 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.348899+0000", 2024-09-17T18:16:15.633 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0785000000000003e-05 2024-09-17T18:16:15.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.348923+0000", 2024-09-17T18:16:15.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3303e-05 2024-09-17T18:16:15.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.634 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.634 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.349363+0000", 2024-09-17T18:16:15.634 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00044075100000000002 2024-09-17T18:16:15.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.349393+0000", 2024-09-17T18:16:15.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9589000000000001e-05 2024-09-17T18:16:15.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.356649+0000", 2024-09-17T18:16:15.635 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0072564960000000003 2024-09-17T18:16:15.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.635 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.635 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.356752+0000", 2024-09-17T18:16:15.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103083 2024-09-17T18:16:15.636 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.636 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.636 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.636 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s3 76/31 ECSubWrite(tid=84, reqid=osd.0.0:84, at_version=76'72, trim_to=0'0, roll_forward_to=75'70))", 2024-09-17T18:16:15.636 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:11.334909+0000", 2024-09-17T18:16:15.636 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.221827545, 2024-09-17T18:16:15.636 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0071492450000000003, 2024-09-17T18:16:15.636 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.636 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.636 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.637 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.637 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.637 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.334909+0000", 2024-09-17T18:16:15.637 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.334909+0000", 2024-09-17T18:16:15.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.638 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.638 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.334910+0000", 2024-09-17T18:16:15.638 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7599999999999997e-07 2024-09-17T18:16:15.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.334965+0000", 2024-09-17T18:16:15.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5257999999999998e-05 2024-09-17T18:16:15.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.639 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.335009+0000", 2024-09-17T18:16:15.639 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3575000000000002e-05 2024-09-17T18:16:15.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.639 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.640 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.335033+0000", 2024-09-17T18:16:15.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4192000000000001e-05 2024-09-17T18:16:15.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.640 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.335584+0000", 2024-09-17T18:16:15.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00055103699999999999 2024-09-17T18:16:15.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.640 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.640 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.335611+0000", 2024-09-17T18:16:15.640 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6699e-05 2024-09-17T18:16:15.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.641 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.341966+0000", 2024-09-17T18:16:15.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.006355772 2024-09-17T18:16:15.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.641 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.641 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.342058+0000", 2024-09-17T18:16:15.641 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2035999999999998e-05 2024-09-17T18:16:15.641 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.641 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.641 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.642 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 76/31 ECSubWrite(tid=51, reqid=osd.3.0:51, at_version=76'43, trim_to=0'0, roll_forward_to=75'41))", 2024-09-17T18:16:15.642 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:11.335183+0000", 2024-09-17T18:16:15.642 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.2215538869999998, 2024-09-17T18:16:15.642 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0085428880000000002, 2024-09-17T18:16:15.642 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.642 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.642 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.642 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.642 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.335183+0000", 2024-09-17T18:16:15.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.643 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.335183+0000", 2024-09-17T18:16:15.643 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.643 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.643 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.643 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.335183+0000", 2024-09-17T18:16:15.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8400000000000004e-07 2024-09-17T18:16:15.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.335226+0000", 2024-09-17T18:16:15.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2970999999999999e-05 2024-09-17T18:16:15.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.644 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.644 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.644 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.335259+0000", 2024-09-17T18:16:15.644 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2688999999999998e-05 2024-09-17T18:16:15.644 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.645 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.645 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.645 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.335296+0000", 2024-09-17T18:16:15.645 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7131000000000001e-05 2024-09-17T18:16:15.645 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.645 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.645 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.645 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336503+0000", 2024-09-17T18:16:15.645 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001207234 2024-09-17T18:16:15.645 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.645 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.645 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.645 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336528+0000", 2024-09-17T18:16:15.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4695e-05 2024-09-17T18:16:15.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.343630+0000", 2024-09-17T18:16:15.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0071015380000000001 2024-09-17T18:16:15.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.646 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.646 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.343726+0000", 2024-09-17T18:16:15.646 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.6045999999999995e-05 2024-09-17T18:16:15.646 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.646 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.646 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.647 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.647 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s3 76/31 ECSubWrite(tid=85, reqid=osd.0.0:85, at_version=76'74, trim_to=0'0, roll_forward_to=75'70))", 2024-09-17T18:16:15.647 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:11.336358+0000", 2024-09-17T18:16:15.647 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.2203789489999997, 2024-09-17T18:16:15.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0087486950000000008, 2024-09-17T18:16:15.647 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.647 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.647 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.647 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.647 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.647 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.647 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336358+0000", 2024-09-17T18:16:15.647 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.648 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336358+0000", 2024-09-17T18:16:15.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.648 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336360+0000", 2024-09-17T18:16:15.648 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9369999999999998e-06 2024-09-17T18:16:15.648 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.648 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336415+0000", 2024-09-17T18:16:15.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5306999999999997e-05 2024-09-17T18:16:15.649 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.649 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.649 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336451+0000", 2024-09-17T18:16:15.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5581999999999999e-05 2024-09-17T18:16:15.649 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.649 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.649 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.649 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336477+0000", 2024-09-17T18:16:15.649 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6735999999999999e-05 2024-09-17T18:16:15.649 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.650 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.650 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336815+0000", 2024-09-17T18:16:15.650 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033782899999999999 2024-09-17T18:16:15.650 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.650 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.650 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336837+0000", 2024-09-17T18:16:15.650 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155999999999999e-05 2024-09-17T18:16:15.650 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.650 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.650 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.345000+0000", 2024-09-17T18:16:15.650 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0081631829999999992 2024-09-17T18:16:15.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.651 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.651 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.345106+0000", 2024-09-17T18:16:15.651 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010596500000000001 2024-09-17T18:16:15.651 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.651 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.651 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.651 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 76/31 ECSubWrite(tid=156, reqid=osd.7.0:156, at_version=76'145, trim_to=0'0, roll_forward_to=75'141))", 2024-09-17T18:16:15.651 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:11.351762+0000", 2024-09-17T18:16:15.651 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.2049749719999996, 2024-09-17T18:16:15.652 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0087225129999999994, 2024-09-17T18:16:15.652 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.652 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.652 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.652 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.652 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.652 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.351762+0000", 2024-09-17T18:16:15.652 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.652 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.652 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.653 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.351762+0000", 2024-09-17T18:16:15.653 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.653 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.653 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.653 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.351763+0000", 2024-09-17T18:16:15.653 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0529999999999999e-06 2024-09-17T18:16:15.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.654 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.654 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.351825+0000", 2024-09-17T18:16:15.654 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.1741000000000004e-05 2024-09-17T18:16:15.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.654 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.654 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.351849+0000", 2024-09-17T18:16:15.654 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4975999999999999e-05 2024-09-17T18:16:15.655 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.655 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.655 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.655 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.351869+0000", 2024-09-17T18:16:15.655 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9548999999999999e-05 2024-09-17T18:16:15.655 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.655 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.655 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.655 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.353150+0000", 2024-09-17T18:16:15.655 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001280546 2024-09-17T18:16:15.655 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.655 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.655 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.656 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.353173+0000", 2024-09-17T18:16:15.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3598999999999999e-05 2024-09-17T18:16:15.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.656 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.656 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.360393+0000", 2024-09-17T18:16:15.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0072195530000000001 2024-09-17T18:16:15.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.656 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.656 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.360484+0000", 2024-09-17T18:16:15.656 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1496000000000006e-05 2024-09-17T18:16:15.657 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.657 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.657 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.657 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s3 76/31 ECSubWrite(tid=86, reqid=osd.0.0:85, at_version=0'0, trim_to=0'0, roll_forward_to=76'74))", 2024-09-17T18:16:15.657 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:11.353776+0000", 2024-09-17T18:16:15.657 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.2029602690000001, 2024-09-17T18:16:15.657 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0066405989999999996, 2024-09-17T18:16:15.657 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.658 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.658 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.658 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.353776+0000", 2024-09-17T18:16:15.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.658 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.658 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.353776+0000", 2024-09-17T18:16:15.658 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.353778+0000", 2024-09-17T18:16:15.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.996e-06 2024-09-17T18:16:15.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.353807+0000", 2024-09-17T18:16:15.659 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8846000000000001e-05 2024-09-17T18:16:15.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.659 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.659 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.353841+0000", 2024-09-17T18:16:15.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4238e-05 2024-09-17T18:16:15.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.660 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.353865+0000", 2024-09-17T18:16:15.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3025999999999999e-05 2024-09-17T18:16:15.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.660 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.660 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.354068+0000", 2024-09-17T18:16:15.660 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000203248 2024-09-17T18:16:15.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.354094+0000", 2024-09-17T18:16:15.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6228999999999999e-05 2024-09-17T18:16:15.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.661 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.360338+0000", 2024-09-17T18:16:15.661 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0062441629999999996 2024-09-17T18:16:15.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.661 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.662 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.360417+0000", 2024-09-17T18:16:15.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8852999999999999e-05 2024-09-17T18:16:15.662 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.662 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.662 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.662 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 79/31 ECSubWrite(tid=70, reqid=osd.3.0:70, at_version=79'59, trim_to=0'0, roll_forward_to=78'57))", 2024-09-17T18:16:15.662 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:14.491601+0000", 2024-09-17T18:16:15.662 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 1.0651358440000001, 2024-09-17T18:16:15.662 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0067014700000000002, 2024-09-17T18:16:15.662 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.662 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.663 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.663 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.663 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.663 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.491601+0000", 2024-09-17T18:16:15.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.663 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.663 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.491601+0000", 2024-09-17T18:16:15.663 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.491602+0000", 2024-09-17T18:16:15.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8700000000000005e-07 2024-09-17T18:16:15.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.491657+0000", 2024-09-17T18:16:15.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5427999999999999e-05 2024-09-17T18:16:15.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.664 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.664 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.491700+0000", 2024-09-17T18:16:15.664 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3140999999999999e-05 2024-09-17T18:16:15.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.491754+0000", 2024-09-17T18:16:15.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3721000000000003e-05 2024-09-17T18:16:15.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.665 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.492143+0000", 2024-09-17T18:16:15.665 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00038954499999999998 2024-09-17T18:16:15.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.665 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.492168+0000", 2024-09-17T18:16:15.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4623000000000001e-05 2024-09-17T18:16:15.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.498215+0000", 2024-09-17T18:16:15.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0060470389999999997 2024-09-17T18:16:15.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.666 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.666 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.498302+0000", 2024-09-17T18:16:15.666 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7286000000000004e-05 2024-09-17T18:16:15.666 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.666 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.667 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.667 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s3 79/31 ECSubWrite(tid=102, reqid=osd.0.0:102, at_version=79'92, trim_to=0'0, roll_forward_to=78'88))", 2024-09-17T18:16:15.667 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:14.495898+0000", 2024-09-17T18:16:15.667 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 1.060838714, 2024-09-17T18:16:15.667 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0064603830000000001, 2024-09-17T18:16:15.667 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:15.667 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:15.667 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:15.667 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:15.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.667 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:15.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.495898+0000", 2024-09-17T18:16:15.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:15.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.495898+0000", 2024-09-17T18:16:15.668 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:15.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.668 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.668 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:15.668 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.495900+0000", 2024-09-17T18:16:15.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1169999999999998e-06 2024-09-17T18:16:15.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:15.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.495958+0000", 2024-09-17T18:16:15.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7544000000000003e-05 2024-09-17T18:16:15.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.669 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:15.669 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.495993+0000", 2024-09-17T18:16:15.669 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5159e-05 2024-09-17T18:16:15.669 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:15.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.496015+0000", 2024-09-17T18:16:15.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2552e-05 2024-09-17T18:16:15.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:15.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.496926+0000", 2024-09-17T18:16:15.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000911095 2024-09-17T18:16:15.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.670 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.670 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:15.670 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.496953+0000", 2024-09-17T18:16:15.670 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6976000000000001e-05 2024-09-17T18:16:15.670 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.671 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.671 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:15.671 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.502233+0000", 2024-09-17T18:16:15.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0052800219999999997 2024-09-17T18:16:15.671 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:15.671 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:15.671 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:15.671 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:14.502358+0000", 2024-09-17T18:16:15.671 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012491800000000001 2024-09-17T18:16:15.671 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.671 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.671 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.671 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:15.672 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:15.672 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:15.673 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 2001098 2024-09-17T18:16:15.674 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:15.674 INFO:tasks.rados.rados.0.smithi154.stdout:337: expect (ObjNum 78 snap 7 seq_num 78) 2024-09-17T18:16:15.674 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:15.674 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:15.674 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T18:16:15.675 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:15.669+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:15.683 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:15.715 INFO:tasks.rados.rados.0.smithi154.stdout:335: finishing copy_from racing read to smithi15432074-9 2024-09-17T18:16:15.718 INFO:tasks.rados.rados.0.smithi154.stdout:335: finishing copy_from to smithi15432074-9 2024-09-17T18:16:15.718 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 9 v 204 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-09-17T18:16:15.774 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:15.769+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:15.805 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:15.805 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:16:15.805 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:16:15.805 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:15.819 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T18:16:15.874 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:15.870+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:15.937 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:15.937 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:16:15.937 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:16:15.937 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:16:15.937 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:15.951 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T18:16:15.976 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:15.974+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:16.076 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:16.074+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:16.119 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:16:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:16:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-17T18:16:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:16:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:13.571510+0000", 2024-09-17T18:16:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 62.544239738999998, 2024-09-17T18:16:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.35549906399999998, 2024-09-17T18:16:16.120 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:16:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:16:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 1 2024-09-17T18:16:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571510+0000", 2024-09-17T18:16:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571510+0000", 2024-09-17T18:16:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571513+0000", 2024-09-17T18:16:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5900000000000002e-06 2024-09-17T18:16:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571526+0000", 2024-09-17T18:16:16.122 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3106e-05 2024-09-17T18:16:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571548+0000", 2024-09-17T18:16:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1832999999999999e-05 2024-09-17T18:16:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571568+0000", 2024-09-17T18:16:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0446e-05 2024-09-17T18:16:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.123 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571715+0000", 2024-09-17T18:16:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000146475 2024-09-17T18:16:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for peered", 2024-09-17T18:16:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.571741+0000", 2024-09-17T18:16:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6009000000000001e-05 2024-09-17T18:16:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.922992+0000", 2024-09-17T18:16:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.35125145800000002 2024-09-17T18:16:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.923283+0000", 2024-09-17T18:16:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00029046999999999998 2024-09-17T18:16:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:16:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.923607+0000", 2024-09-17T18:16:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00032395200000000002 2024-09-17T18:16:16.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:16:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.924798+0000", 2024-09-17T18:16:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011917329999999999 2024-09-17T18:16:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:16:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.926847+0000", 2024-09-17T18:16:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020485009999999999 2024-09-17T18:16:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.926945+0000", 2024-09-17T18:16:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7750000000000004e-05 2024-09-17T18:16:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:13.927009+0000", 2024-09-17T18:16:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4740999999999996e-05 2024-09-17T18:16:16.127 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:16:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073054+0000", 2024-09-17T18:16:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 62.042696151999998, 2024-09-17T18:16:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017781126000000001, 2024-09-17T18:16:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.128 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:16:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:16:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 47 2024-09-17T18:16:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073054+0000", 2024-09-17T18:16:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073054+0000", 2024-09-17T18:16:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073055+0000", 2024-09-17T18:16:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4700000000000001e-07 2024-09-17T18:16:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073138+0000", 2024-09-17T18:16:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3607000000000001e-05 2024-09-17T18:16:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073153+0000", 2024-09-17T18:16:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4969e-05 2024-09-17T18:16:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073161+0000", 2024-09-17T18:16:16.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6000000000000001e-06 2024-09-17T18:16:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.084558+0000", 2024-09-17T18:16:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011397457999999999 2024-09-17T18:16:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.084732+0000", 2024-09-17T18:16:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000173401 2024-09-17T18:16:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.132 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:16:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.084940+0000", 2024-09-17T18:16:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020803400000000001 2024-09-17T18:16:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:16:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090671+0000", 2024-09-17T18:16:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0057309450000000003 2024-09-17T18:16:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:16:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090695+0000", 2024-09-17T18:16:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3932000000000001e-05 2024-09-17T18:16:16.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090771+0000", 2024-09-17T18:16:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6014999999999996e-05 2024-09-17T18:16:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090835+0000", 2024-09-17T18:16:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4418000000000006e-05 2024-09-17T18:16:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:16:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073198+0000", 2024-09-17T18:16:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 62.042551930000002, 2024-09-17T18:16:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018005944999999999, 2024-09-17T18:16:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:16:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:16:16.135 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 48 2024-09-17T18:16:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073198+0000", 2024-09-17T18:16:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.136 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073198+0000", 2024-09-17T18:16:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073199+0000", 2024-09-17T18:16:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7599999999999996e-07 2024-09-17T18:16:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073205+0000", 2024-09-17T18:16:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2840000000000003e-06 2024-09-17T18:16:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073221+0000", 2024-09-17T18:16:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5498999999999998e-05 2024-09-17T18:16:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073246+0000", 2024-09-17T18:16:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4793000000000001e-05 2024-09-17T18:16:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.139 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.085863+0000", 2024-09-17T18:16:16.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012617033 2024-09-17T18:16:16.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.139 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.085983+0000", 2024-09-17T18:16:16.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012071299999999999 2024-09-17T18:16:16.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.139 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:16:16.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.086174+0000", 2024-09-17T18:16:16.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000190457 2024-09-17T18:16:16.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.140 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:16:16.140 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.090925+0000", 2024-09-17T18:16:16.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047513659999999999 2024-09-17T18:16:16.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.140 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:16:16.140 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091032+0000", 2024-09-17T18:16:16.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106933 2024-09-17T18:16:16.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.141 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091143+0000", 2024-09-17T18:16:16.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000111197 2024-09-17T18:16:16.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.141 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091204+0000", 2024-09-17T18:16:16.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0794000000000001e-05 2024-09-17T18:16:16.141 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.141 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.142 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.142 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.142 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:16:16.142 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073262+0000", 2024-09-17T18:16:16.142 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 62.042488442, 2024-09-17T18:16:16.142 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018090469000000001, 2024-09-17T18:16:16.142 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.142 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.142 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.142 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.142 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:16:16.143 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:16:16.143 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 49 2024-09-17T18:16:16.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.143 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.143 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.143 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.143 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073262+0000", 2024-09-17T18:16:16.143 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.143 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.143 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.143 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073262+0000", 2024-09-17T18:16:16.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073263+0000", 2024-09-17T18:16:16.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0160000000000001e-06 2024-09-17T18:16:16.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073269+0000", 2024-09-17T18:16:16.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0039999999999996e-06 2024-09-17T18:16:16.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073283+0000", 2024-09-17T18:16:16.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4559000000000001e-05 2024-09-17T18:16:16.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073291+0000", 2024-09-17T18:16:16.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7200000000000006e-06 2024-09-17T18:16:16.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.087142+0000", 2024-09-17T18:16:16.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013850987 2024-09-17T18:16:16.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.146 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.146 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.087298+0000", 2024-09-17T18:16:16.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015572900000000001 2024-09-17T18:16:16.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.146 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:16:16.146 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.087485+0000", 2024-09-17T18:16:16.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018764399999999999 2024-09-17T18:16:16.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.146 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:16:16.147 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091014+0000", 2024-09-17T18:16:16.147 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035285780000000001 2024-09-17T18:16:16.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.147 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.147 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:16:16.147 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091217+0000", 2024-09-17T18:16:16.147 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020357 2024-09-17T18:16:16.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.147 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.147 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.147 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091302+0000", 2024-09-17T18:16:16.148 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4614e-05 2024-09-17T18:16:16.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.148 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.148 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091352+0000", 2024-09-17T18:16:16.148 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0047999999999999e-05 2024-09-17T18:16:16.148 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.148 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.148 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.148 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:16:16.149 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073303+0000", 2024-09-17T18:16:16.149 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 62.042447160000002, 2024-09-17T18:16:16.149 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.020201742000000002, 2024-09-17T18:16:16.149 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.149 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.149 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.149 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.149 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:16:16.149 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:16:16.149 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 50 2024-09-17T18:16:16.149 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.149 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.149 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.150 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.150 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073303+0000", 2024-09-17T18:16:16.150 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.150 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.150 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.150 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.150 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073303+0000", 2024-09-17T18:16:16.150 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.150 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.150 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.150 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.150 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073304+0000", 2024-09-17T18:16:16.150 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1699999999999997e-07 2024-09-17T18:16:16.151 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.151 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.151 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.151 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073388+0000", 2024-09-17T18:16:16.151 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4222999999999996e-05 2024-09-17T18:16:16.151 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.151 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.151 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.151 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073403+0000", 2024-09-17T18:16:16.151 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.488e-05 2024-09-17T18:16:16.151 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.151 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.151 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.152 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073411+0000", 2024-09-17T18:16:16.152 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0660000000000004e-06 2024-09-17T18:16:16.152 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.152 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.152 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.152 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.089184+0000", 2024-09-17T18:16:16.152 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015773646999999998 2024-09-17T18:16:16.152 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.152 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.152 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.152 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.089309+0000", 2024-09-17T18:16:16.152 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000124809 2024-09-17T18:16:16.153 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.153 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.153 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:16:16.153 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.089514+0000", 2024-09-17T18:16:16.153 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000204871 2024-09-17T18:16:16.153 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.153 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.153 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:16:16.153 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093318+0000", 2024-09-17T18:16:16.153 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0038034050000000002 2024-09-17T18:16:16.153 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.153 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.153 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:16:16.153 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093337+0000", 2024-09-17T18:16:16.154 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9839000000000001e-05 2024-09-17T18:16:16.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.154 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.154 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.154 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093412+0000", 2024-09-17T18:16:16.154 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5012000000000006e-05 2024-09-17T18:16:16.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.154 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.154 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.154 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093505+0000", 2024-09-17T18:16:16.154 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2273000000000002e-05 2024-09-17T18:16:16.154 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.154 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.155 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.155 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.155 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.155 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:16:16.155 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:16:16.155 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 62.042324514000001, 2024-09-17T18:16:16.155 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.020790197, 2024-09-17T18:16:16.155 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.155 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.155 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.155 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.155 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:16:16.155 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:16:16.156 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 51 2024-09-17T18:16:16.156 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.156 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.156 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.156 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.156 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:16:16.156 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.156 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.156 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.156 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.156 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:16:16.156 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.156 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.157 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.157 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.157 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073426+0000", 2024-09-17T18:16:16.157 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5000000000000001e-07 2024-09-17T18:16:16.157 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.157 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.157 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.157 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073432+0000", 2024-09-17T18:16:16.157 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7030000000000003e-06 2024-09-17T18:16:16.157 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.157 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.157 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.157 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073445+0000", 2024-09-17T18:16:16.157 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.239e-05 2024-09-17T18:16:16.158 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.158 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.158 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.158 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073452+0000", 2024-09-17T18:16:16.158 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8460000000000008e-06 2024-09-17T18:16:16.158 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.158 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.158 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.158 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091415+0000", 2024-09-17T18:16:16.158 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017962982999999998 2024-09-17T18:16:16.158 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.158 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.158 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.158 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091545+0000", 2024-09-17T18:16:16.159 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013008599999999999 2024-09-17T18:16:16.159 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.159 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.159 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:16:16.159 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.091736+0000", 2024-09-17T18:16:16.159 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019030100000000001 2024-09-17T18:16:16.159 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.159 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.159 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:16:16.159 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.093524+0000", 2024-09-17T18:16:16.159 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0017882060000000001 2024-09-17T18:16:16.159 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.159 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.160 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:16:16.160 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094070+0000", 2024-09-17T18:16:16.160 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00054624999999999997 2024-09-17T18:16:16.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.160 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.160 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.160 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094156+0000", 2024-09-17T18:16:16.160 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5446999999999997e-05 2024-09-17T18:16:16.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.160 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.160 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.160 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094216+0000", 2024-09-17T18:16:16.160 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0134999999999999e-05 2024-09-17T18:16:16.161 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.161 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.161 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.161 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.161 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.161 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:16:16.161 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.073465+0000", 2024-09-17T18:16:16.161 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 62.042285178, 2024-09-17T18:16:16.161 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021176878, 2024-09-17T18:16:16.161 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.161 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.162 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.162 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.162 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:16:16.162 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:16:16.162 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 52 2024-09-17T18:16:16.162 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.162 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.162 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.162 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.162 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073465+0000", 2024-09-17T18:16:16.162 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.162 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.162 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.163 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.163 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073465+0000", 2024-09-17T18:16:16.163 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.163 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.163 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.163 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.163 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073466+0000", 2024-09-17T18:16:16.163 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3e-07 2024-09-17T18:16:16.163 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.163 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.163 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.163 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073472+0000", 2024-09-17T18:16:16.163 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0519999999999998e-06 2024-09-17T18:16:16.164 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.164 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.164 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.164 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073483+0000", 2024-09-17T18:16:16.164 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1586999999999999e-05 2024-09-17T18:16:16.164 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.164 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.164 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.164 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.073490+0000", 2024-09-17T18:16:16.164 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8229999999999997e-06 2024-09-17T18:16:16.164 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.165 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.165 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.165 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.092415+0000", 2024-09-17T18:16:16.165 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018924926000000002 2024-09-17T18:16:16.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.165 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.165 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.165 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.092535+0000", 2024-09-17T18:16:16.165 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012039 2024-09-17T18:16:16.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.165 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.165 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:16:16.166 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.092739+0000", 2024-09-17T18:16:16.166 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000203926 2024-09-17T18:16:16.166 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.166 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.166 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:16:16.166 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094258+0000", 2024-09-17T18:16:16.166 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015184689999999999 2024-09-17T18:16:16.166 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.166 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.166 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:16:16.166 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094513+0000", 2024-09-17T18:16:16.166 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00025523199999999998 2024-09-17T18:16:16.166 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.167 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.167 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.167 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094590+0000", 2024-09-17T18:16:16.167 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6743999999999996e-05 2024-09-17T18:16:16.167 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.167 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.167 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.167 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.094642+0000", 2024-09-17T18:16:16.167 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1999000000000001e-05 2024-09-17T18:16:16.167 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.167 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.167 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.168 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.168 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.168 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:16:16.168 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180912+0000", 2024-09-17T18:16:16.168 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 61.934838147000001, 2024-09-17T18:16:16.168 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017495620999999999, 2024-09-17T18:16:16.168 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.168 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.168 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.168 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.168 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:16:16.169 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:16:16.169 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 73 2024-09-17T18:16:16.169 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.169 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.169 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.169 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.169 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180912+0000", 2024-09-17T18:16:16.169 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.169 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.169 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.169 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.169 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180912+0000", 2024-09-17T18:16:16.170 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.170 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.170 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.170 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.170 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180913+0000", 2024-09-17T18:16:16.170 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0529999999999999e-06 2024-09-17T18:16:16.170 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.170 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.170 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.170 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180920+0000", 2024-09-17T18:16:16.170 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8369999999999999e-06 2024-09-17T18:16:16.170 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.170 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.171 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.171 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180929+0000", 2024-09-17T18:16:16.171 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3659999999999998e-06 2024-09-17T18:16:16.171 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.171 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.171 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.171 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180936+0000", 2024-09-17T18:16:16.171 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9659999999999999e-06 2024-09-17T18:16:16.171 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.171 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.171 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.171 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.191317+0000", 2024-09-17T18:16:16.171 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010380545 2024-09-17T18:16:16.171 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.172 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.172 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.172 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.191435+0000", 2024-09-17T18:16:16.172 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000118746 2024-09-17T18:16:16.172 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.172 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.172 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:16:16.172 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.191616+0000", 2024-09-17T18:16:16.172 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018002799999999999 2024-09-17T18:16:16.172 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.172 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.172 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:16:16.173 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.197244+0000", 2024-09-17T18:16:16.173 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0056280940000000002 2024-09-17T18:16:16.173 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.173 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.173 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:16:16.173 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198243+0000", 2024-09-17T18:16:16.173 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00099925500000000011 2024-09-17T18:16:16.173 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.173 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.173 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.173 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198336+0000", 2024-09-17T18:16:16.173 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3447000000000002e-05 2024-09-17T18:16:16.174 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.174 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.174 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.174 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198408+0000", 2024-09-17T18:16:16.174 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1284000000000004e-05 2024-09-17T18:16:16.174 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.174 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.174 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.174 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.174 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.174 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:16:16.174 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180948+0000", 2024-09-17T18:16:16.174 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 61.934801794999998, 2024-09-17T18:16:16.175 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017711738000000001, 2024-09-17T18:16:16.175 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.175 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.175 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.175 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.175 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:16:16.175 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:16:16.175 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 74 2024-09-17T18:16:16.175 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.175 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.175 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.175 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.175 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180948+0000", 2024-09-17T18:16:16.176 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.176 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.176 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.176 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.176 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180948+0000", 2024-09-17T18:16:16.176 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.176 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.176 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.176 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.176 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180949+0000", 2024-09-17T18:16:16.176 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9000000000000005e-07 2024-09-17T18:16:16.176 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.176 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.176 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.177 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180955+0000", 2024-09-17T18:16:16.177 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3900000000000001e-06 2024-09-17T18:16:16.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.177 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.177 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.177 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180964+0000", 2024-09-17T18:16:16.177 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0559999999999994e-06 2024-09-17T18:16:16.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.177 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.177 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.177 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180970+0000", 2024-09-17T18:16:16.177 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5899999999999996e-06 2024-09-17T18:16:16.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.192795+0000", 2024-09-17T18:16:16.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011825057999999999 2024-09-17T18:16:16.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193035+0000", 2024-09-17T18:16:16.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00023942000000000001 2024-09-17T18:16:16.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:16:16.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193232+0000", 2024-09-17T18:16:16.179 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000197383 2024-09-17T18:16:16.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.179 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.179 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:16:16.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.197434+0000", 2024-09-17T18:16:16.179 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0042018029999999996 2024-09-17T18:16:16.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.179 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.179 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:16:16.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198506+0000", 2024-09-17T18:16:16.179 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0010720860000000001 2024-09-17T18:16:16.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.179 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.180 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.180 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198595+0000", 2024-09-17T18:16:16.180 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8710999999999998e-05 2024-09-17T18:16:16.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.180 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.180 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.180 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.198660+0000", 2024-09-17T18:16:16.180 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5251000000000003e-05 2024-09-17T18:16:16.180 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.180 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.180 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.180 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.180 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:16:16.181 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.180982+0000", 2024-09-17T18:16:16.181 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 61.934768116000001, 2024-09-17T18:16:16.181 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0204972, 2024-09-17T18:16:16.181 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.181 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.181 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.181 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.181 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:16:16.181 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:16:16.181 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 75 2024-09-17T18:16:16.181 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.181 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180982+0000", 2024-09-17T18:16:16.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180982+0000", 2024-09-17T18:16:16.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.183 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.180983+0000", 2024-09-17T18:16:16.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8700000000000005e-07 2024-09-17T18:16:16.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.183 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.183 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.183 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181111+0000", 2024-09-17T18:16:16.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012798200000000001 2024-09-17T18:16:16.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.183 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.183 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.183 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181123+0000", 2024-09-17T18:16:16.184 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2283000000000001e-05 2024-09-17T18:16:16.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.184 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181133+0000", 2024-09-17T18:16:16.184 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.028e-05 2024-09-17T18:16:16.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.184 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193832+0000", 2024-09-17T18:16:16.184 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012698276999999999 2024-09-17T18:16:16.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.193952+0000", 2024-09-17T18:16:16.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012077 2024-09-17T18:16:16.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:16:16.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.194141+0000", 2024-09-17T18:16:16.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018815100000000001 2024-09-17T18:16:16.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:16:16.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.199915+0000", 2024-09-17T18:16:16.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0057741190000000003 2024-09-17T18:16:16.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:16:16.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201326+0000", 2024-09-17T18:16:16.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001411463 2024-09-17T18:16:16.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.186 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.186 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201410+0000", 2024-09-17T18:16:16.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4166999999999996e-05 2024-09-17T18:16:16.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201479+0000", 2024-09-17T18:16:16.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8921e-05 2024-09-17T18:16:16.187 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.187 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.187 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.187 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:16:16.187 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.181149+0000", 2024-09-17T18:16:16.187 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 61.934601155000003, 2024-09-17T18:16:16.188 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.02060089, 2024-09-17T18:16:16.188 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.188 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.188 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.188 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.188 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:16:16.188 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:16:16.188 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 76 2024-09-17T18:16:16.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.188 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.188 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181149+0000", 2024-09-17T18:16:16.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.189 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181149+0000", 2024-09-17T18:16:16.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.189 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181150+0000", 2024-09-17T18:16:16.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3399999999999997e-07 2024-09-17T18:16:16.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.190 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.190 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181157+0000", 2024-09-17T18:16:16.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.379e-06 2024-09-17T18:16:16.190 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.190 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.190 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181166+0000", 2024-09-17T18:16:16.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0869999999999996e-06 2024-09-17T18:16:16.190 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.190 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.190 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.181173+0000", 2024-09-17T18:16:16.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8360000000000003e-06 2024-09-17T18:16:16.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.191 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.191 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.195884+0000", 2024-09-17T18:16:16.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.014710877000000001 2024-09-17T18:16:16.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.191 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.191 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.196029+0000", 2024-09-17T18:16:16.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014536900000000001 2024-09-17T18:16:16.191 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.191 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:16:16.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.196221+0000", 2024-09-17T18:16:16.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019122 2024-09-17T18:16:16.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:16:16.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.199925+0000", 2024-09-17T18:16:16.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0037047389999999999 2024-09-17T18:16:16.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:16:16.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201572+0000", 2024-09-17T18:16:16.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001646652 2024-09-17T18:16:16.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201656+0000", 2024-09-17T18:16:16.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4107e-05 2024-09-17T18:16:16.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.201750+0000", 2024-09-17T18:16:16.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3690000000000006e-05 2024-09-17T18:16:16.193 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.193 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.193 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.194 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:16:16.194 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378327+0000", 2024-09-17T18:16:16.194 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 61.737423356000001, 2024-09-17T18:16:16.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018591921000000001, 2024-09-17T18:16:16.194 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.194 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.194 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.194 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.194 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:16:16.194 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:16:16.194 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 122 2024-09-17T18:16:16.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.194 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378327+0000", 2024-09-17T18:16:16.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.195 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378327+0000", 2024-09-17T18:16:16.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.195 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378328+0000", 2024-09-17T18:16:16.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3170000000000001e-06 2024-09-17T18:16:16.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.196 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378338+0000", 2024-09-17T18:16:16.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0006e-05 2024-09-17T18:16:16.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.196 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378358+0000", 2024-09-17T18:16:16.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9919e-05 2024-09-17T18:16:16.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.197 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378371+0000", 2024-09-17T18:16:16.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3363999999999999e-05 2024-09-17T18:16:16.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.197 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392332+0000", 2024-09-17T18:16:16.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013960396999999999 2024-09-17T18:16:16.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392445+0000", 2024-09-17T18:16:16.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011278899999999999 2024-09-17T18:16:16.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:16:16.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.392625+0000", 2024-09-17T18:16:16.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000180082 2024-09-17T18:16:16.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:16:16.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396780+0000", 2024-09-17T18:16:16.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0041555639999999996 2024-09-17T18:16:16.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.199 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:16:16.199 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396802+0000", 2024-09-17T18:16:16.199 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1460000000000001e-05 2024-09-17T18:16:16.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.199 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.199 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396864+0000", 2024-09-17T18:16:16.199 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2193999999999994e-05 2024-09-17T18:16:16.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.200 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.200 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396919+0000", 2024-09-17T18:16:16.200 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4829e-05 2024-09-17T18:16:16.200 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.201 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.201 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.201 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.201 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:16:16.201 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378397+0000", 2024-09-17T18:16:16.201 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 61.737352991000002, 2024-09-17T18:16:16.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018905537, 2024-09-17T18:16:16.201 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.201 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.201 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.201 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.202 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:16:16.202 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:16:16.202 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 123 2024-09-17T18:16:16.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.202 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.202 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378397+0000", 2024-09-17T18:16:16.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.202 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378397+0000", 2024-09-17T18:16:16.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.203 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.203 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.203 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378399+0000", 2024-09-17T18:16:16.203 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4559999999999999e-06 2024-09-17T18:16:16.203 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.203 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.203 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378595+0000", 2024-09-17T18:16:16.203 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019676399999999999 2024-09-17T18:16:16.203 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.203 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.203 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378611+0000", 2024-09-17T18:16:16.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5268999999999999e-05 2024-09-17T18:16:16.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.204 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.204 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.204 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378622+0000", 2024-09-17T18:16:16.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1593999999999999e-05 2024-09-17T18:16:16.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.204 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.204 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.204 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393759+0000", 2024-09-17T18:16:16.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015136836000000001 2024-09-17T18:16:16.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.204 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.204 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.393966+0000", 2024-09-17T18:16:16.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020672 2024-09-17T18:16:16.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:16:16.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.394159+0000", 2024-09-17T18:16:16.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000193594 2024-09-17T18:16:16.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:16:16.205 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396935+0000", 2024-09-17T18:16:16.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027754889999999999 2024-09-17T18:16:16.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:16:16.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397041+0000", 2024-09-17T18:16:16.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105853 2024-09-17T18:16:16.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397193+0000", 2024-09-17T18:16:16.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015243200000000001 2024-09-17T18:16:16.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397303+0000", 2024-09-17T18:16:16.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010953 2024-09-17T18:16:16.207 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.207 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.207 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.207 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4257.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T18:16:16.207 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:14.378646+0000", 2024-09-17T18:16:16.207 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 61.737104549000001, 2024-09-17T18:16:16.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019220590999999999, 2024-09-17T18:16:16.207 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.207 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.207 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.207 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.207 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4257", 2024-09-17T18:16:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.87:0/2078965061", 2024-09-17T18:16:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 124 2024-09-17T18:16:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378646+0000", 2024-09-17T18:16:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378646+0000", 2024-09-17T18:16:16.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378647+0000", 2024-09-17T18:16:16.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.17e-06 2024-09-17T18:16:16.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378655+0000", 2024-09-17T18:16:16.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.8199999999999997e-06 2024-09-17T18:16:16.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.210 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378669+0000", 2024-09-17T18:16:16.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4715000000000001e-05 2024-09-17T18:16:16.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.210 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.210 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.378677+0000", 2024-09-17T18:16:16.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5499999999999997e-06 2024-09-17T18:16:16.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.210 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.210 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.395519+0000", 2024-09-17T18:16:16.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016842012999999999 2024-09-17T18:16:16.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.395741+0000", 2024-09-17T18:16:16.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000221776 2024-09-17T18:16:16.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for subops from 15", 2024-09-17T18:16:16.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.396098+0000", 2024-09-17T18:16:16.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00035730199999999999 2024-09-17T18:16:16.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op_commit", 2024-09-17T18:16:16.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397456+0000", 2024-09-17T18:16:16.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001357701 2024-09-17T18:16:16.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_commit_rec", 2024-09-17T18:16:16.212 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397740+0000", 2024-09-17T18:16:16.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000284068 2024-09-17T18:16:16.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.212 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397813+0000", 2024-09-17T18:16:16.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.2934000000000003e-05 2024-09-17T18:16:16.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:14.397866+0000", 2024-09-17T18:16:16.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3542000000000003e-05 2024-09-17T18:16:16.213 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.213 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.213 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.213 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:510 3.8s0 3:1aecdbc1:::smithi15432074-42:head [append 0~442368] snapc 10=[10,e,d,c,b,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:16.213 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.316884+0000", 2024-09-17T18:16:16.213 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.798865929000002, 2024-09-17T18:16:16.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.031567413000000002, 2024-09-17T18:16:16.213 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.213 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.214 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.214 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.214 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:16.214 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:16.214 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 510 2024-09-17T18:16:16.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.214 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.316884+0000", 2024-09-17T18:16:16.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.316884+0000", 2024-09-17T18:16:16.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.316889+0000", 2024-09-17T18:16:16.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4789999999999998e-06 2024-09-17T18:16:16.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.318436+0000", 2024-09-17T18:16:16.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001547199 2024-09-17T18:16:16.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.318465+0000", 2024-09-17T18:16:16.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8687000000000002e-05 2024-09-17T18:16:16.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.318480+0000", 2024-09-17T18:16:16.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5536000000000002e-05 2024-09-17T18:16:16.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.318645+0000", 2024-09-17T18:16:16.217 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016444100000000001 2024-09-17T18:16:16.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.217 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-17T18:16:16.217 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.318665+0000", 2024-09-17T18:16:16.217 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0403000000000001e-05 2024-09-17T18:16:16.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.217 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.217 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.327594+0000", 2024-09-17T18:16:16.217 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0089287629999999993 2024-09-17T18:16:16.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.327892+0000", 2024-09-17T18:16:16.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000298332 2024-09-17T18:16:16.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.331990+0000", 2024-09-17T18:16:16.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040984350000000001 2024-09-17T18:16:16.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.347593+0000", 2024-09-17T18:16:16.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015602582 2024-09-17T18:16:16.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.348150+0000", 2024-09-17T18:16:16.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00055665399999999996 2024-09-17T18:16:16.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.219 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.348452+0000", 2024-09-17T18:16:16.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000301902 2024-09-17T18:16:16.219 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.219 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.219 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.220 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:511 3.8s0 3:1aecdbc1:::smithi15432074-42:head [append 0~540672] snapc 10=[10,e,d,c,b,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:16.220 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.329689+0000", 2024-09-17T18:16:16.220 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.786061023999999, 2024-09-17T18:16:16.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.032863626999999999, 2024-09-17T18:16:16.220 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.220 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.220 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.220 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.220 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:16.220 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:16.220 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 511 2024-09-17T18:16:16.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.221 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.329689+0000", 2024-09-17T18:16:16.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.329689+0000", 2024-09-17T18:16:16.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.329693+0000", 2024-09-17T18:16:16.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6030000000000001e-06 2024-09-17T18:16:16.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.331200+0000", 2024-09-17T18:16:16.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015075469999999999 2024-09-17T18:16:16.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.331237+0000", 2024-09-17T18:16:16.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6612000000000001e-05 2024-09-17T18:16:16.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.331259+0000", 2024-09-17T18:16:16.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1800000000000001e-05 2024-09-17T18:16:16.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340574+0000", 2024-09-17T18:16:16.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093152440000000003 2024-09-17T18:16:16.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340841+0000", 2024-09-17T18:16:16.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00026700200000000002 2024-09-17T18:16:16.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.224 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.224 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.344881+0000", 2024-09-17T18:16:16.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040397640000000004 2024-09-17T18:16:16.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.224 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.224 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.357502+0000", 2024-09-17T18:16:16.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012621557 2024-09-17T18:16:16.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.224 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.224 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.362378+0000", 2024-09-17T18:16:16.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0048762179999999999 2024-09-17T18:16:16.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.225 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.225 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.362553+0000", 2024-09-17T18:16:16.225 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017427999999999999 2024-09-17T18:16:16.225 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.225 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.225 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.225 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.225 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:512 3.8s0 3:1aecdbc1:::smithi15432074-42:head [append 0~622592] snapc 10=[10,e,d,c,b,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:16.226 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.339227+0000", 2024-09-17T18:16:16.226 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.776523533999999, 2024-09-17T18:16:16.226 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.02825772, 2024-09-17T18:16:16.226 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.226 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.226 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.226 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.226 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:16.226 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:16.226 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 512 2024-09-17T18:16:16.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.226 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.226 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.339227+0000", 2024-09-17T18:16:16.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.339227+0000", 2024-09-17T18:16:16.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.227 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.227 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.227 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.339230+0000", 2024-09-17T18:16:16.227 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0570000000000001e-06 2024-09-17T18:16:16.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340637+0000", 2024-09-17T18:16:16.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0014072710000000001 2024-09-17T18:16:16.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340673+0000", 2024-09-17T18:16:16.228 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5769999999999998e-05 2024-09-17T18:16:16.228 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.228 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.228 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.228 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340695+0000", 2024-09-17T18:16:16.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1953000000000001e-05 2024-09-17T18:16:16.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.229 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.229 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.349122+0000", 2024-09-17T18:16:16.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0084269040000000007 2024-09-17T18:16:16.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.229 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.229 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.349350+0000", 2024-09-17T18:16:16.229 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000228166 2024-09-17T18:16:16.229 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.229 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.229 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.230 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.352772+0000", 2024-09-17T18:16:16.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0034218120000000002 2024-09-17T18:16:16.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.230 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.357645+0000", 2024-09-17T18:16:16.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.004873128 2024-09-17T18:16:16.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.230 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.230 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.367325+0000", 2024-09-17T18:16:16.230 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0096804219999999993 2024-09-17T18:16:16.230 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.230 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.231 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.231 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.367484+0000", 2024-09-17T18:16:16.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015923700000000001 2024-09-17T18:16:16.231 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.231 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.231 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.231 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.231 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.231 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:513 3.8s0 3:1aecdbc1:::smithi15432074-42:head [setxattr _header (57) in=7b] snapc 10=[10,e,d,c,b,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:16.231 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.340735+0000", 2024-09-17T18:16:16.231 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.775015336999999, 2024-09-17T18:16:16.231 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.029807212999999999, 2024-09-17T18:16:16.231 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.232 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.232 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.232 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.232 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:16.232 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:16.232 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 513 2024-09-17T18:16:16.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.232 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.232 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.232 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340735+0000", 2024-09-17T18:16:16.232 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.232 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.232 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340735+0000", 2024-09-17T18:16:16.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340737+0000", 2024-09-17T18:16:16.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.95e-06 2024-09-17T18:16:16.233 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.233 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.233 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.233 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340745+0000", 2024-09-17T18:16:16.233 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6859999999999995e-06 2024-09-17T18:16:16.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340767+0000", 2024-09-17T18:16:16.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1480000000000001e-05 2024-09-17T18:16:16.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.234 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340782+0000", 2024-09-17T18:16:16.234 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5366000000000002e-05 2024-09-17T18:16:16.234 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.234 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.234 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.354803+0000", 2024-09-17T18:16:16.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.014020359 2024-09-17T18:16:16.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.235 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.355093+0000", 2024-09-17T18:16:16.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00029036200000000001 2024-09-17T18:16:16.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.235 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.235 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.356350+0000", 2024-09-17T18:16:16.235 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012570610000000001 2024-09-17T18:16:16.235 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.235 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.236 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.236 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.358546+0000", 2024-09-17T18:16:16.236 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021961010000000002 2024-09-17T18:16:16.236 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.236 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.236 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.236 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.370364+0000", 2024-09-17T18:16:16.236 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011817539 2024-09-17T18:16:16.236 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.236 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.236 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.236 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.370542+0000", 2024-09-17T18:16:16.236 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000178309 2024-09-17T18:16:16.237 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.237 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.237 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.237 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.237 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.237 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:514 3.8s0 3:1aecdbc1:::smithi15432074-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:16.237 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.340816+0000", 2024-09-17T18:16:16.237 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.774934465000001, 2024-09-17T18:16:16.237 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.032647508999999998, 2024-09-17T18:16:16.237 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.237 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.237 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-17T18:16:16.237 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.238 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:16.238 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:16.238 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 514 2024-09-17T18:16:16.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.238 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.238 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.238 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.238 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340816+0000", 2024-09-17T18:16:16.238 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.238 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.238 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.238 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.238 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340816+0000", 2024-09-17T18:16:16.238 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.239 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.239 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340817+0000", 2024-09-17T18:16:16.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.48e-06 2024-09-17T18:16:16.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.239 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.239 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340824+0000", 2024-09-17T18:16:16.239 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8229999999999997e-06 2024-09-17T18:16:16.239 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.239 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.239 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.239 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340842+0000", 2024-09-17T18:16:16.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8505999999999999e-05 2024-09-17T18:16:16.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.240 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.340856+0000", 2024-09-17T18:16:16.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3747000000000001e-05 2024-09-17T18:16:16.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.240 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.240 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.240 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.358066+0000", 2024-09-17T18:16:16.240 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017210195000000001 2024-09-17T18:16:16.240 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.241 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:16.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.358287+0000", 2024-09-17T18:16:16.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022095700000000001 2024-09-17T18:16:16.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.241 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.371255+0000", 2024-09-17T18:16:16.241 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012967953000000001 2024-09-17T18:16:16.241 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.241 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.241 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.241 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.371412+0000", 2024-09-17T18:16:16.242 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015673999999999999 2024-09-17T18:16:16.242 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.242 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.242 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.242 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.373463+0000", 2024-09-17T18:16:16.242 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0020511079999999998 2024-09-17T18:16:16.242 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.242 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.242 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.242 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.242 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.242 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(osd.4.23:4 3.8s0 3:1fdb63ef:::smithi15432074-49:head [assert-version v28,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:16.242 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:49.344516+0000", 2024-09-17T18:16:16.242 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 26.771233747, 2024-09-17T18:16:16.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.028065837999999999, 2024-09-17T18:16:16.243 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.243 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.243 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-17T18:16:16.243 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.243 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.243 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.344516+0000", 2024-09-17T18:16:16.243 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.243 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.243 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.243 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.243 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.344516+0000", 2024-09-17T18:16:16.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.244 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.344519+0000", 2024-09-17T18:16:16.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8669999999999998e-06 2024-09-17T18:16:16.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.244 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.344533+0000", 2024-09-17T18:16:16.244 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3366e-05 2024-09-17T18:16:16.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.244 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.245 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.344560+0000", 2024-09-17T18:16:16.245 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7282999999999999e-05 2024-09-17T18:16:16.245 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.245 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.245 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.245 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.344579+0000", 2024-09-17T18:16:16.245 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8827000000000001e-05 2024-09-17T18:16:16.245 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.245 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.245 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.245 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.358395+0000", 2024-09-17T18:16:16.245 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013815792 2024-09-17T18:16:16.245 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.246 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:16.246 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.358533+0000", 2024-09-17T18:16:16.246 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013825799999999999 2024-09-17T18:16:16.246 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.246 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.246 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.361197+0000", 2024-09-17T18:16:16.246 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0026645409999999999 2024-09-17T18:16:16.246 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.246 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.246 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.361395+0000", 2024-09-17T18:16:16.246 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019756799999999999 2024-09-17T18:16:16.247 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.247 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.247 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.247 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:49.372582+0000", 2024-09-17T18:16:16.247 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011187336000000001 2024-09-17T18:16:16.247 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.247 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.247 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.247 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.247 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.247 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:16.249 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T18:16:16.249 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:16.245+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:16.349 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:16:16.346+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:16:16.422 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:16.422 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:16:16.422 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:16:16.422 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:16.437 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T18:16:16.451 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:16.449+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:16.497 INFO:tasks.rados.rados.0.smithi154.stdout:335: done (7 left) 2024-09-17T18:16:16.497 INFO:tasks.rados.rados.0.smithi154.stdout:336: done (6 left) 2024-09-17T18:16:16.497 INFO:tasks.rados.rados.0.smithi154.stdout:337: done (5 left) 2024-09-17T18:16:16.498 INFO:tasks.rados.rados.0.smithi154.stdout:338: done (4 left) 2024-09-17T18:16:16.498 INFO:tasks.rados.rados.0.smithi154.stdout:340: done (3 left) 2024-09-17T18:16:16.498 INFO:tasks.rados.rados.0.smithi154.stdout:341: snap_create 2024-09-17T18:16:16.552 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:16.550+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:16.605 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:16.605 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:16:16.605 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:16:16.605 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:16:16.605 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:16.619 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T18:16:16.654 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:16.649+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:16.740 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:16.740 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:16:16.740 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:16:16.740 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-17T18:16:16.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.741 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s2 42/31 ECSubWrite(tid=40, reqid=client.4565.0:363, at_version=42'26, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:16:16.741 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.767133+0000", 2024-09-17T18:16:16.741 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.969943962999999, 2024-09-17T18:16:16.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021588646, 2024-09-17T18:16:16.741 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.741 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.741 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.741 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.741 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.741 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767133+0000", 2024-09-17T18:16:16.741 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767133+0000", 2024-09-17T18:16:16.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767133+0000", 2024-09-17T18:16:16.742 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4000000000000002e-07 2024-09-17T18:16:16.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.742 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.742 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.742 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767171+0000", 2024-09-17T18:16:16.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7116000000000002e-05 2024-09-17T18:16:16.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767198+0000", 2024-09-17T18:16:16.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.756e-05 2024-09-17T18:16:16.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.743 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767223+0000", 2024-09-17T18:16:16.743 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4723e-05 2024-09-17T18:16:16.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.743 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767425+0000", 2024-09-17T18:16:16.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020206299999999999 2024-09-17T18:16:16.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767451+0000", 2024-09-17T18:16:16.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5769e-05 2024-09-17T18:16:16.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.744 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.744 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788636+0000", 2024-09-17T18:16:16.744 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021185626999999999 2024-09-17T18:16:16.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.745 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.745 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788722+0000", 2024-09-17T18:16:16.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5347999999999997e-05 2024-09-17T18:16:16.745 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.745 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.745 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.745 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=86, reqid=client.4565.0:343, at_version=42'21, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:16.745 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.769752+0000", 2024-09-17T18:16:16.745 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.967324988000001, 2024-09-17T18:16:16.745 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022302678999999999, 2024-09-17T18:16:16.745 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.746 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.746 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.746 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769752+0000", 2024-09-17T18:16:16.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.746 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.746 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.746 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769752+0000", 2024-09-17T18:16:16.746 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.747 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769753+0000", 2024-09-17T18:16:16.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3e-07 2024-09-17T18:16:16.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.747 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769810+0000", 2024-09-17T18:16:16.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7501999999999999e-05 2024-09-17T18:16:16.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.747 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.747 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.747 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769843+0000", 2024-09-17T18:16:16.747 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2299999999999999e-05 2024-09-17T18:16:16.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.769866+0000", 2024-09-17T18:16:16.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3448999999999999e-05 2024-09-17T18:16:16.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.748 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.770089+0000", 2024-09-17T18:16:16.748 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022273200000000001 2024-09-17T18:16:16.748 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.748 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.748 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.770113+0000", 2024-09-17T18:16:16.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4170000000000001e-05 2024-09-17T18:16:16.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.791961+0000", 2024-09-17T18:16:16.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021847829999999999 2024-09-17T18:16:16.749 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.749 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.749 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792055+0000", 2024-09-17T18:16:16.749 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3966000000000001e-05 2024-09-17T18:16:16.749 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.749 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.750 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.750 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.750 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 42/31 ECSubWrite(tid=87, reqid=client.4565.0:358, at_version=42'26, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:16.750 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.772061+0000", 2024-09-17T18:16:16.750 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.965015651999998, 2024-09-17T18:16:16.750 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.020486306999999999, 2024-09-17T18:16:16.750 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.750 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.750 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.750 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.750 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.750 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772061+0000", 2024-09-17T18:16:16.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772061+0000", 2024-09-17T18:16:16.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.751 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.751 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772063+0000", 2024-09-17T18:16:16.751 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0870000000000001e-06 2024-09-17T18:16:16.751 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.751 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772121+0000", 2024-09-17T18:16:16.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7156e-05 2024-09-17T18:16:16.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772165+0000", 2024-09-17T18:16:16.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4885000000000001e-05 2024-09-17T18:16:16.752 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.752 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.752 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772198+0000", 2024-09-17T18:16:16.752 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2634e-05 2024-09-17T18:16:16.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772630+0000", 2024-09-17T18:16:16.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00043200500000000001 2024-09-17T18:16:16.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.753 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.753 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772656+0000", 2024-09-17T18:16:16.753 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5942e-05 2024-09-17T18:16:16.753 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.753 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792367+0000", 2024-09-17T18:16:16.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019711310999999999 2024-09-17T18:16:16.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.754 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.754 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792548+0000", 2024-09-17T18:16:16.754 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000180287 2024-09-17T18:16:16.754 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.754 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.754 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.754 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.755 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=88, reqid=client.4565.0:344, at_version=42'22, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:16.755 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.772258+0000", 2024-09-17T18:16:16.755 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.964819298000002, 2024-09-17T18:16:16.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022345961000000001, 2024-09-17T18:16:16.755 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.755 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.755 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.755 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.755 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.755 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.755 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772258+0000", 2024-09-17T18:16:16.755 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.756 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.756 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772258+0000", 2024-09-17T18:16:16.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.756 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.756 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.756 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.756 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772259+0000", 2024-09-17T18:16:16.756 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.28e-06 2024-09-17T18:16:16.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772311+0000", 2024-09-17T18:16:16.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2061999999999997e-05 2024-09-17T18:16:16.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.757 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772339+0000", 2024-09-17T18:16:16.757 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7613000000000001e-05 2024-09-17T18:16:16.757 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.757 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.757 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772359+0000", 2024-09-17T18:16:16.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0313e-05 2024-09-17T18:16:16.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782669+0000", 2024-09-17T18:16:16.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010310293 2024-09-17T18:16:16.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.758 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.758 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.782707+0000", 2024-09-17T18:16:16.758 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8213000000000002e-05 2024-09-17T18:16:16.758 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.758 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794497+0000", 2024-09-17T18:16:16.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011789366000000001 2024-09-17T18:16:16.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.759 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.759 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794604+0000", 2024-09-17T18:16:16.759 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000106821 2024-09-17T18:16:16.759 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.759 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.759 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.759 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.759 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.759 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s2 42/31 ECSubWrite(tid=42, reqid=osd.7.0:42, at_version=42'30, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:16:16.760 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.773805+0000", 2024-09-17T18:16:16.760 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.963271597999999, 2024-09-17T18:16:16.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.020956761000000001, 2024-09-17T18:16:16.760 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.760 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.760 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.760 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.760 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.760 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773805+0000", 2024-09-17T18:16:16.760 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.760 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.760 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.761 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773805+0000", 2024-09-17T18:16:16.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.761 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773807+0000", 2024-09-17T18:16:16.761 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9400000000000001e-06 2024-09-17T18:16:16.761 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.761 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.761 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.761 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773855+0000", 2024-09-17T18:16:16.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7753000000000002e-05 2024-09-17T18:16:16.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773891+0000", 2024-09-17T18:16:16.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5493000000000001e-05 2024-09-17T18:16:16.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.762 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773912+0000", 2024-09-17T18:16:16.762 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1818999999999999e-05 2024-09-17T18:16:16.762 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.762 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.762 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783091+0000", 2024-09-17T18:16:16.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0091785649999999996 2024-09-17T18:16:16.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783111+0000", 2024-09-17T18:16:16.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0523e-05 2024-09-17T18:16:16.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.763 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.763 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.763 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794669+0000", 2024-09-17T18:16:16.763 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011557263999999999 2024-09-17T18:16:16.763 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.764 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.764 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794762+0000", 2024-09-17T18:16:16.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3404000000000002e-05 2024-09-17T18:16:16.764 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.764 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.764 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.764 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.764 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.764 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=89, reqid=client.4565.0:345, at_version=42'23, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:16.764 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775036+0000", 2024-09-17T18:16:16.764 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.962040621, 2024-09-17T18:16:16.764 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019634636, 2024-09-17T18:16:16.765 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.765 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.765 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.765 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.765 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.765 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.765 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775036+0000", 2024-09-17T18:16:16.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.765 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.765 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.765 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.765 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775036+0000", 2024-09-17T18:16:16.765 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775038+0000", 2024-09-17T18:16:16.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0930000000000001e-06 2024-09-17T18:16:16.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775084+0000", 2024-09-17T18:16:16.766 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5612999999999998e-05 2024-09-17T18:16:16.766 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.766 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.766 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.766 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775122+0000", 2024-09-17T18:16:16.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7945999999999999e-05 2024-09-17T18:16:16.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775147+0000", 2024-09-17T18:16:16.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5296e-05 2024-09-17T18:16:16.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.767 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.767 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785552+0000", 2024-09-17T18:16:16.767 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010404722 2024-09-17T18:16:16.767 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.767 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785575+0000", 2024-09-17T18:16:16.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.313e-05 2024-09-17T18:16:16.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794613+0000", 2024-09-17T18:16:16.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0090377110000000004 2024-09-17T18:16:16.768 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.768 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.768 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.768 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794671+0000", 2024-09-17T18:16:16.768 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8125000000000003e-05 2024-09-17T18:16:16.769 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.769 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.769 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.769 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.769 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=91, reqid=client.4565.0:352, at_version=42'25, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:16.769 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775354+0000", 2024-09-17T18:16:16.769 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.961722563999999, 2024-09-17T18:16:16.769 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019376402000000001, 2024-09-17T18:16:16.769 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.769 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.769 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.769 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.769 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775354+0000", 2024-09-17T18:16:16.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775354+0000", 2024-09-17T18:16:16.770 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.770 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.770 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.770 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.770 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775355+0000", 2024-09-17T18:16:16.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8700000000000004e-07 2024-09-17T18:16:16.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775411+0000", 2024-09-17T18:16:16.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5599000000000001e-05 2024-09-17T18:16:16.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.771 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.771 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775435+0000", 2024-09-17T18:16:16.771 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4156999999999999e-05 2024-09-17T18:16:16.771 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.771 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775454+0000", 2024-09-17T18:16:16.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8546000000000002e-05 2024-09-17T18:16:16.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787101+0000", 2024-09-17T18:16:16.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011647309 2024-09-17T18:16:16.772 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.772 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.772 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.772 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787134+0000", 2024-09-17T18:16:16.772 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2922000000000001e-05 2024-09-17T18:16:16.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794677+0000", 2024-09-17T18:16:16.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0075426629999999998 2024-09-17T18:16:16.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.773 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.773 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.773 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794731+0000", 2024-09-17T18:16:16.773 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4318999999999999e-05 2024-09-17T18:16:16.773 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.773 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.773 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.773 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.774 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 42/31 ECSubWrite(tid=92, reqid=client.4565.0:360, at_version=42'28, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:16.774 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775482+0000", 2024-09-17T18:16:16.774 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.961594968999997, 2024-09-17T18:16:16.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019181841000000002, 2024-09-17T18:16:16.774 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.774 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.774 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.774 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.774 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.774 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775482+0000", 2024-09-17T18:16:16.774 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775482+0000", 2024-09-17T18:16:16.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775483+0000", 2024-09-17T18:16:16.775 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4e-07 2024-09-17T18:16:16.775 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.775 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.775 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.775 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775514+0000", 2024-09-17T18:16:16.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1429e-05 2024-09-17T18:16:16.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.776 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.776 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775536+0000", 2024-09-17T18:16:16.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1773e-05 2024-09-17T18:16:16.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.776 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.776 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775551+0000", 2024-09-17T18:16:16.776 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.448e-05 2024-09-17T18:16:16.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785199+0000", 2024-09-17T18:16:16.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0096482760000000008 2024-09-17T18:16:16.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785221+0000", 2024-09-17T18:16:16.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2217000000000001e-05 2024-09-17T18:16:16.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.777 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.777 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794561+0000", 2024-09-17T18:16:16.777 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093396580000000007 2024-09-17T18:16:16.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.778 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.778 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.794664+0000", 2024-09-17T18:16:16.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103168 2024-09-17T18:16:16.778 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.778 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.778 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.778 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=94, reqid=client.4565.0:353, at_version=42'26, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:16.778 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.778391+0000", 2024-09-17T18:16:16.778 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.958686342999997, 2024-09-17T18:16:16.778 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019505588000000001, 2024-09-17T18:16:16.779 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.779 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.779 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.779 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778391+0000", 2024-09-17T18:16:16.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.779 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.779 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778391+0000", 2024-09-17T18:16:16.779 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778393+0000", 2024-09-17T18:16:16.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9130000000000001e-06 2024-09-17T18:16:16.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778432+0000", 2024-09-17T18:16:16.780 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.9515999999999999e-05 2024-09-17T18:16:16.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.780 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.780 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778475+0000", 2024-09-17T18:16:16.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2898999999999997e-05 2024-09-17T18:16:16.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.778517+0000", 2024-09-17T18:16:16.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2376000000000002e-05 2024-09-17T18:16:16.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.781 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788635+0000", 2024-09-17T18:16:16.781 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010117321 2024-09-17T18:16:16.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.781 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788661+0000", 2024-09-17T18:16:16.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6101999999999998e-05 2024-09-17T18:16:16.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.797809+0000", 2024-09-17T18:16:16.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0091479130000000006 2024-09-17T18:16:16.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.782 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.782 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.797896+0000", 2024-09-17T18:16:16.782 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7547999999999996e-05 2024-09-17T18:16:16.782 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.782 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.783 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.783 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 42/31 ECSubWrite(tid=95, reqid=client.4565.0:354, at_version=42'27, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:16.783 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779563+0000", 2024-09-17T18:16:16.783 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.957513708, 2024-09-17T18:16:16.783 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018430695, 2024-09-17T18:16:16.783 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.783 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.783 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.783 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.783 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779563+0000", 2024-09-17T18:16:16.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779563+0000", 2024-09-17T18:16:16.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.784 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.784 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779565+0000", 2024-09-17T18:16:16.784 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9099999999999999e-06 2024-09-17T18:16:16.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779611+0000", 2024-09-17T18:16:16.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5595e-05 2024-09-17T18:16:16.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779644+0000", 2024-09-17T18:16:16.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3113e-05 2024-09-17T18:16:16.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.785 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.785 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779667+0000", 2024-09-17T18:16:16.785 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3033000000000001e-05 2024-09-17T18:16:16.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.790793+0000", 2024-09-17T18:16:16.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011125894000000001 2024-09-17T18:16:16.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.790816+0000", 2024-09-17T18:16:16.786 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3037e-05 2024-09-17T18:16:16.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.786 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.786 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.797906+0000", 2024-09-17T18:16:16.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0070905680000000002 2024-09-17T18:16:16.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.787 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.787 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.797994+0000", 2024-09-17T18:16:16.787 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7545000000000003e-05 2024-09-17T18:16:16.787 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.787 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.787 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.787 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 42/31 ECSubWrite(tid=96, reqid=osd.4.0:96, at_version=42'32, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:16.787 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779930+0000", 2024-09-17T18:16:16.787 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.957146684999998, 2024-09-17T18:16:16.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018156274999999999, 2024-09-17T18:16:16.788 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.788 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.788 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.788 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.788 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779930+0000", 2024-09-17T18:16:16.788 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.788 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779930+0000", 2024-09-17T18:16:16.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779932+0000", 2024-09-17T18:16:16.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3999999999999999e-06 2024-09-17T18:16:16.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.789 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.789 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.789 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779978+0000", 2024-09-17T18:16:16.789 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6221999999999999e-05 2024-09-17T18:16:16.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.780043+0000", 2024-09-17T18:16:16.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5436000000000002e-05 2024-09-17T18:16:16.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.780066+0000", 2024-09-17T18:16:16.790 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2955e-05 2024-09-17T18:16:16.790 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.790 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.790 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788704+0000", 2024-09-17T18:16:16.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0086378989999999992 2024-09-17T18:16:16.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.788729+0000", 2024-09-17T18:16:16.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4598999999999999e-05 2024-09-17T18:16:16.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.791 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.791 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.798004+0000", 2024-09-17T18:16:16.791 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0092750939999999994 2024-09-17T18:16:16.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.792 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.792 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.798087+0000", 2024-09-17T18:16:16.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2670000000000006e-05 2024-09-17T18:16:16.792 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.792 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.792 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.792 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s2 75/31 ECSubWrite(tid=152, reqid=osd.7.0:152, at_version=75'139, trim_to=0'0, roll_forward_to=73'137))", 2024-09-17T18:16:16.792 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.327611+0000", 2024-09-17T18:16:16.792 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.4094658080000002, 2024-09-17T18:16:16.792 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.01789046, 2024-09-17T18:16:16.792 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.793 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.793 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.793 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327611+0000", 2024-09-17T18:16:16.793 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.793 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.793 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327611+0000", 2024-09-17T18:16:16.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327612+0000", 2024-09-17T18:16:16.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0400000000000005e-07 2024-09-17T18:16:16.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.794 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.794 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327672+0000", 2024-09-17T18:16:16.794 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0034000000000002e-05 2024-09-17T18:16:16.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.328007+0000", 2024-09-17T18:16:16.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033460899999999998 2024-09-17T18:16:16.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.795 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.328035+0000", 2024-09-17T18:16:16.795 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8524999999999999e-05 2024-09-17T18:16:16.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.795 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.329233+0000", 2024-09-17T18:16:16.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001197636 2024-09-17T18:16:16.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.329259+0000", 2024-09-17T18:16:16.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5939e-05 2024-09-17T18:16:16.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.796 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.796 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.345357+0000", 2024-09-17T18:16:16.796 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016098241999999999 2024-09-17T18:16:16.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.797 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.797 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.345502+0000", 2024-09-17T18:16:16.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000144571 2024-09-17T18:16:16.797 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.797 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.797 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.797 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 75/31 ECSubWrite(tid=244, reqid=osd.4.0:243, at_version=0'0, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:16.797 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.327886+0000", 2024-09-17T18:16:16.797 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.4091911890000004, 2024-09-17T18:16:16.797 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.020115609999999999, 2024-09-17T18:16:16.798 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.798 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.798 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.798 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327886+0000", 2024-09-17T18:16:16.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.798 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.798 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327886+0000", 2024-09-17T18:16:16.798 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327888+0000", 2024-09-17T18:16:16.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.99e-06 2024-09-17T18:16:16.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327916+0000", 2024-09-17T18:16:16.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7835e-05 2024-09-17T18:16:16.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.799 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.799 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327959+0000", 2024-09-17T18:16:16.799 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2871999999999999e-05 2024-09-17T18:16:16.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.800 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327983+0000", 2024-09-17T18:16:16.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4295e-05 2024-09-17T18:16:16.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.800 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.800 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.332570+0000", 2024-09-17T18:16:16.800 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0045876950000000001 2024-09-17T18:16:16.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.332598+0000", 2024-09-17T18:16:16.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7055000000000001e-05 2024-09-17T18:16:16.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.347919+0000", 2024-09-17T18:16:16.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015321632 2024-09-17T18:16:16.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.801 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.801 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.348001+0000", 2024-09-17T18:16:16.801 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2236000000000003e-05 2024-09-17T18:16:16.801 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.802 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.802 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.802 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s5 75/31 ECSubWrite(tid=246, reqid=client.4565.0:760, at_version=75'94, trim_to=0'0, roll_forward_to=72'92))", 2024-09-17T18:16:16.802 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.333207+0000", 2024-09-17T18:16:16.802 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.403870253, 2024-09-17T18:16:16.802 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.024825656000000001, 2024-09-17T18:16:16.802 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.802 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.802 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.802 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.802 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.333207+0000", 2024-09-17T18:16:16.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.333207+0000", 2024-09-17T18:16:16.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.803 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.803 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.333208+0000", 2024-09-17T18:16:16.803 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.226e-06 2024-09-17T18:16:16.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.336593+0000", 2024-09-17T18:16:16.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0033848329999999999 2024-09-17T18:16:16.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.336623+0000", 2024-09-17T18:16:16.804 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0198000000000001e-05 2024-09-17T18:16:16.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.804 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.804 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.336646+0000", 2024-09-17T18:16:16.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2886000000000001e-05 2024-09-17T18:16:16.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.336812+0000", 2024-09-17T18:16:16.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016626600000000001 2024-09-17T18:16:16.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.805 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.805 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.336839+0000", 2024-09-17T18:16:16.805 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6962e-05 2024-09-17T18:16:16.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.806 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.357945+0000", 2024-09-17T18:16:16.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021105848999999999 2024-09-17T18:16:16.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.806 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.806 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.358032+0000", 2024-09-17T18:16:16.806 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.7435999999999994e-05 2024-09-17T18:16:16.806 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.806 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.806 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.807 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 75/31 ECSubWrite(tid=247, reqid=client.4565.0:762, at_version=75'124, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:16.807 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.336860+0000", 2024-09-17T18:16:16.807 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.4002169130000004, 2024-09-17T18:16:16.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.023090277999999999, 2024-09-17T18:16:16.807 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.807 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.807 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.807 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.807 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.807 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.336860+0000", 2024-09-17T18:16:16.807 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.336860+0000", 2024-09-17T18:16:16.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.336861+0000", 2024-09-17T18:16:16.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.094e-06 2024-09-17T18:16:16.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.808 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.808 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.336911+0000", 2024-09-17T18:16:16.808 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9524000000000002e-05 2024-09-17T18:16:16.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.336934+0000", 2024-09-17T18:16:16.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3592999999999999e-05 2024-09-17T18:16:16.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.336954+0000", 2024-09-17T18:16:16.809 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9619e-05 2024-09-17T18:16:16.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.809 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.809 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.809 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.341569+0000", 2024-09-17T18:16:16.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0046154359999999997 2024-09-17T18:16:16.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.341596+0000", 2024-09-17T18:16:16.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6911999999999999e-05 2024-09-17T18:16:16.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.810 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.810 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.359871+0000", 2024-09-17T18:16:16.810 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0182744 2024-09-17T18:16:16.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.811 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.811 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.359950+0000", 2024-09-17T18:16:16.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9699999999999999e-05 2024-09-17T18:16:16.811 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.811 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.811 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.811 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 75/31 ECSubWrite(tid=248, reqid=client.4565.0:763, at_version=75'125, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:16.811 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.338441+0000", 2024-09-17T18:16:16.811 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.3986364059999996, 2024-09-17T18:16:16.811 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021574645, 2024-09-17T18:16:16.811 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.811 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.812 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.812 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.812 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.812 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338441+0000", 2024-09-17T18:16:16.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.812 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.812 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338441+0000", 2024-09-17T18:16:16.812 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.812 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.813 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338442+0000", 2024-09-17T18:16:16.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2559999999999999e-06 2024-09-17T18:16:16.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.813 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.813 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338483+0000", 2024-09-17T18:16:16.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1044999999999998e-05 2024-09-17T18:16:16.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.813 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.813 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338517+0000", 2024-09-17T18:16:16.813 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.4038999999999997e-05 2024-09-17T18:16:16.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338542+0000", 2024-09-17T18:16:16.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5267999999999999e-05 2024-09-17T18:16:16.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.347311+0000", 2024-09-17T18:16:16.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0087685430000000002 2024-09-17T18:16:16.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.814 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.814 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.347337+0000", 2024-09-17T18:16:16.814 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6188999999999999e-05 2024-09-17T18:16:16.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.359957+0000", 2024-09-17T18:16:16.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012619587 2024-09-17T18:16:16.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.815 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.815 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.360015+0000", 2024-09-17T18:16:16.815 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8718000000000003e-05 2024-09-17T18:16:16.815 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.815 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.815 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.815 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.816 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.2s5 75/31 ECSubWrite(tid=54, reqid=osd.14.0:54, at_version=75'48, trim_to=0'0, roll_forward_to=73'46))", 2024-09-17T18:16:16.816 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.340349+0000", 2024-09-17T18:16:16.816 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.3967275179999996, 2024-09-17T18:16:16.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017713395999999999, 2024-09-17T18:16:16.816 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.816 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.816 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.816 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.816 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.816 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.816 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.340349+0000", 2024-09-17T18:16:16.816 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.340349+0000", 2024-09-17T18:16:16.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.340350+0000", 2024-09-17T18:16:16.817 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1299999999999998e-07 2024-09-17T18:16:16.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.817 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.817 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.817 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.340435+0000", 2024-09-17T18:16:16.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4259999999999996e-05 2024-09-17T18:16:16.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.340480+0000", 2024-09-17T18:16:16.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.5101000000000001e-05 2024-09-17T18:16:16.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.818 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.818 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.340560+0000", 2024-09-17T18:16:16.818 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0292999999999998e-05 2024-09-17T18:16:16.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.818 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.819 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.340942+0000", 2024-09-17T18:16:16.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00038153800000000001 2024-09-17T18:16:16.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.819 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.340968+0000", 2024-09-17T18:16:16.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6129e-05 2024-09-17T18:16:16.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.819 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.819 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.357992+0000", 2024-09-17T18:16:16.819 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017024779 2024-09-17T18:16:16.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.819 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.820 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.820 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.358063+0000", 2024-09-17T18:16:16.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.0382999999999993e-05 2024-09-17T18:16:16.820 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.820 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.820 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.820 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.820 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs2 75/31 ECSubWrite(tid=249, reqid=client.4565.0:764, at_version=75'126, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:16.820 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.342439+0000", 2024-09-17T18:16:16.820 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.3946378639999999, 2024-09-17T18:16:16.820 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017814416, 2024-09-17T18:16:16.821 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.821 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.821 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:16.821 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.821 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.821 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.342439+0000", 2024-09-17T18:16:16.821 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.821 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.821 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.821 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.342439+0000", 2024-09-17T18:16:16.821 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.822 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.822 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.342441+0000", 2024-09-17T18:16:16.822 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.906e-06 2024-09-17T18:16:16.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.822 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.822 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.342809+0000", 2024-09-17T18:16:16.822 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000368141 2024-09-17T18:16:16.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.822 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.822 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.822 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.342851+0000", 2024-09-17T18:16:16.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2058000000000003e-05 2024-09-17T18:16:16.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.823 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.823 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.342876+0000", 2024-09-17T18:16:16.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4456000000000001e-05 2024-09-17T18:16:16.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.823 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.823 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.348353+0000", 2024-09-17T18:16:16.823 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0054768539999999998 2024-09-17T18:16:16.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.823 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.823 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.348368+0000", 2024-09-17T18:16:16.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5529999999999999e-05 2024-09-17T18:16:16.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.360193+0000", 2024-09-17T18:16:16.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011825217000000001 2024-09-17T18:16:16.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.824 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.824 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.360254+0000", 2024-09-17T18:16:16.824 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0254000000000003e-05 2024-09-17T18:16:16.824 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.825 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.825 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.825 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.825 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:869 3.3s0 3:c1415c7c:::smithi15432074-9:head [copy-from ver 204] snapc 1c=[1c,18,17,16,15,11,8,7] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-17T18:16:16.825 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:15.497716+0000", 2024-09-17T18:16:16.825 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 1.2393609720000001, 2024-09-17T18:16:16.825 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.220510599, 2024-09-17T18:16:16.825 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.825 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.825 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:16.825 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.825 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:16.826 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:16.826 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 869 2024-09-17T18:16:16.826 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.826 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.826 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.826 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.826 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.497716+0000", 2024-09-17T18:16:16.826 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.826 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.826 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.826 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.826 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.497716+0000", 2024-09-17T18:16:16.826 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.497717+0000", 2024-09-17T18:16:16.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.297e-06 2024-09-17T18:16:16.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.827 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.497723+0000", 2024-09-17T18:16:16.827 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6339999999999998e-06 2024-09-17T18:16:16.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.827 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.497734+0000", 2024-09-17T18:16:16.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0678e-05 2024-09-17T18:16:16.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.828 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.497740+0000", 2024-09-17T18:16:16.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.7499999999999997e-06 2024-09-17T18:16:16.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.828 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.828 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.497805+0000", 2024-09-17T18:16:16.828 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4932999999999996e-05 2024-09-17T18:16:16.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.829 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.829 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.497898+0000", 2024-09-17T18:16:16.829 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2697999999999999e-05 2024-09-17T18:16:16.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.829 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:16.829 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.712811+0000", 2024-09-17T18:16:16.829 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.21491337999999999 2024-09-17T18:16:16.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.829 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:16.829 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.715087+0000", 2024-09-17T18:16:16.830 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.002275329 2024-09-17T18:16:16.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.830 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:16.830 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.718097+0000", 2024-09-17T18:16:16.830 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0030098490000000002 2024-09-17T18:16:16.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.830 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.830 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.718227+0000", 2024-09-17T18:16:16.830 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013005100000000001 2024-09-17T18:16:16.830 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.830 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.831 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.831 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.831 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.831 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:870 3.3s0 3:c1415c7c:::smithi15432074-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e80)", 2024-09-17T18:16:16.831 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:15.497758+0000", 2024-09-17T18:16:16.831 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 1.2393193339999999, 2024-09-17T18:16:16.831 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.217069401, 2024-09-17T18:16:16.831 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:16.831 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:16.831 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-17T18:16:16.831 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:16.831 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:16.831 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:16.832 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 870 2024-09-17T18:16:16.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.832 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:16.832 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.832 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:16.832 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.497758+0000", 2024-09-17T18:16:16.832 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.832 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.832 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:16.832 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.497758+0000", 2024-09-17T18:16:16.832 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:16.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.832 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:16.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.497758+0000", 2024-09-17T18:16:16.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5300000000000004e-07 2024-09-17T18:16:16.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:16.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.497762+0000", 2024-09-17T18:16:16.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6830000000000001e-06 2024-09-17T18:16:16.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.833 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:16.833 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.497771+0000", 2024-09-17T18:16:16.833 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3279999999999995e-06 2024-09-17T18:16:16.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:16.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.497779+0000", 2024-09-17T18:16:16.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.9179999999999994e-06 2024-09-17T18:16:16.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.498101+0000", 2024-09-17T18:16:16.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00032155699999999998 2024-09-17T18:16:16.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.834 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for blocked object", 2024-09-17T18:16:16.834 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.498148+0000", 2024-09-17T18:16:16.834 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.7326000000000001e-05 2024-09-17T18:16:16.835 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.835 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.835 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:16.835 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.714645+0000", 2024-09-17T18:16:16.835 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.21649734700000001 2024-09-17T18:16:16.835 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.835 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.835 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:16.835 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.714728+0000", 2024-09-17T18:16:16.835 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2341000000000003e-05 2024-09-17T18:16:16.835 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:16.835 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:16.835 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:16.835 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:15.714827+0000", 2024-09-17T18:16:16.836 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9247999999999996e-05 2024-09-17T18:16:16.836 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.836 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.836 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.836 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:16.836 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:16.836 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:16.836 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T18:16:16.838 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T18:16:16.839 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:16.833+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:16.939 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:16:16.934+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:16:16.966 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:16.967 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:16:16.967 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:16:16.967 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:16.985 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T18:16:16.992 INFO:tasks.rados.rados.0.smithi154.stdout:334: expect (ObjNum 129 snap 26 seq_num 129) 2024-09-17T18:16:16.992 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:16.998 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:16:16.999 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:16:17.022 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1912030 2024-09-17T18:16:17.022 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:16:17.022 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:16:17.024 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:17.040 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:17.038+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:17.041 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:16:17.041 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:16:17.044 INFO:tasks.rados.rados.0.smithi154.stdout:332: finishing copy_from racing read to smithi15432074-28 2024-09-17T18:16:17.044 INFO:tasks.rados.rados.0.smithi154.stdout:332: finishing copy_from to smithi15432074-28 2024-09-17T18:16:17.045 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 28 v 82 (ObjNum 97 snap 16 seq_num 97) dirty exists 2024-09-17T18:16:17.063 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:16:17.064 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:16:17.085 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:16:17.086 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:16:17.108 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:16:17.108 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:16:17.119 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:17.119 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:16:17.120 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:16:17.120 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:16:17.120 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:17.121 INFO:tasks.rados.rados.0.smithi154.stdout:339: finishing copy_from racing read to smithi15432074-2 2024-09-17T18:16:17.125 INFO:tasks.rados.rados.0.smithi154.stdout:339: finishing copy_from to smithi15432074-2 2024-09-17T18:16:17.125 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 2 v 27 (ObjNum 109 snap 23 seq_num 109) dirty exists 2024-09-17T18:16:17.127 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:16:17.127 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:16:17.135 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T18:16:17.141 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:17.137+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:17.149 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:16:17.149 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:16:17.170 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:16:17.170 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:16:17.197 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:16:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:16:17.216 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:16:17.216 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:16:17.239 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:16:17.240 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:16:17.242 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:17.237+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:17.262 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:17.263 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:16:17.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:16:17.263 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-17T18:16:17.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.263 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:259 3.2s0 3:412841d6:::smithi15432074-31:head [copy-from ver 6] snapc 5=[5,4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:16:17.263 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:33.723621+0000", 2024-09-17T18:16:17.263 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.537303270999999, 2024-09-17T18:16:17.263 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.023930903999999999, 2024-09-17T18:16:17.263 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.263 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.263 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:17.263 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:17.264 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:17.264 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:17.264 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 259 2024-09-17T18:16:17.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.264 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723621+0000", 2024-09-17T18:16:17.264 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.264 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.264 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.264 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723621+0000", 2024-09-17T18:16:17.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723624+0000", 2024-09-17T18:16:17.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7329999999999999e-06 2024-09-17T18:16:17.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.265 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.265 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723650+0000", 2024-09-17T18:16:17.265 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.635e-05 2024-09-17T18:16:17.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723679+0000", 2024-09-17T18:16:17.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9471999999999998e-05 2024-09-17T18:16:17.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723697+0000", 2024-09-17T18:16:17.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7499999999999998e-05 2024-09-17T18:16:17.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.266 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.266 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723856+0000", 2024-09-17T18:16:17.266 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015885699999999999 2024-09-17T18:16:17.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-17T18:16:17.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723876+0000", 2024-09-17T18:16:17.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0672000000000001e-05 2024-09-17T18:16:17.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725096+0000", 2024-09-17T18:16:17.267 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001219749 2024-09-17T18:16:17.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.267 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.267 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:17.267 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725238+0000", 2024-09-17T18:16:17.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014202299999999999 2024-09-17T18:16:17.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.742960+0000", 2024-09-17T18:16:17.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017721959999999998 2024-09-17T18:16:17.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.268 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.268 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.746486+0000", 2024-09-17T18:16:17.268 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035262169999999999 2024-09-17T18:16:17.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:17.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.747419+0000", 2024-09-17T18:16:17.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00093307999999999998 2024-09-17T18:16:17.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.269 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.269 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.747552+0000", 2024-09-17T18:16:17.269 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013229100000000001 2024-09-17T18:16:17.269 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.269 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.269 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.269 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.269 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:260 3.2s0 3:412841d6:::smithi15432074-31:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:16:17.270 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:33.723741+0000", 2024-09-17T18:16:17.270 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 43.537183249999998, 2024-09-17T18:16:17.270 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022041903000000002, 2024-09-17T18:16:17.270 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.270 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.270 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-17T18:16:17.270 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:17.270 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:17.270 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:17.270 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 260 2024-09-17T18:16:17.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.270 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723741+0000", 2024-09-17T18:16:17.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723741+0000", 2024-09-17T18:16:17.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.271 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.271 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723742+0000", 2024-09-17T18:16:17.271 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0130000000000001e-06 2024-09-17T18:16:17.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723747+0000", 2024-09-17T18:16:17.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1499999999999998e-06 2024-09-17T18:16:17.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723773+0000", 2024-09-17T18:16:17.272 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6389000000000001e-05 2024-09-17T18:16:17.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.272 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.272 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.272 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723788+0000", 2024-09-17T18:16:17.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4843e-05 2024-09-17T18:16:17.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.724014+0000", 2024-09-17T18:16:17.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000225539 2024-09-17T18:16:17.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:17.273 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.724024+0000", 2024-09-17T18:16:17.273 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0246e-05 2024-09-17T18:16:17.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.273 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725543+0000", 2024-09-17T18:16:17.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001519149 2024-09-17T18:16:17.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for blocked object", 2024-09-17T18:16:17.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725732+0000", 2024-09-17T18:16:17.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018853300000000001 2024-09-17T18:16:17.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.274 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.274 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.745290+0000", 2024-09-17T18:16:17.274 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019558507999999999 2024-09-17T18:16:17.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.274 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:17.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.745513+0000", 2024-09-17T18:16:17.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022266500000000001 2024-09-17T18:16:17.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.275 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.275 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.745783+0000", 2024-09-17T18:16:17.275 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00026986799999999999 2024-09-17T18:16:17.275 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.275 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.275 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.275 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:285 3.2s0 3:45e539c6:::smithi15432074-16:head [rollback 6] snapc 6=[6,5,4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T18:16:17.276 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:34.763617+0000", 2024-09-17T18:16:17.276 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 42.497306946000002, 2024-09-17T18:16:17.276 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0122197, 2024-09-17T18:16:17.276 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.276 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.276 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:17.276 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:17.276 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:17.276 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:17.276 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 285 2024-09-17T18:16:17.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.276 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.276 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763617+0000", 2024-09-17T18:16:17.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763617+0000", 2024-09-17T18:16:17.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.277 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.277 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763618+0000", 2024-09-17T18:16:17.277 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5799999999999998e-07 2024-09-17T18:16:17.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763622+0000", 2024-09-17T18:16:17.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0949999999999998e-06 2024-09-17T18:16:17.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763636+0000", 2024-09-17T18:16:17.278 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4297000000000001e-05 2024-09-17T18:16:17.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.278 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.278 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.763644+0000", 2024-09-17T18:16:17.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.7039999999999994e-06 2024-09-17T18:16:17.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.765578+0000", 2024-09-17T18:16:17.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001933733 2024-09-17T18:16:17.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:17.279 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.765683+0000", 2024-09-17T18:16:17.279 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105232 2024-09-17T18:16:17.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.279 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.279 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.766235+0000", 2024-09-17T18:16:17.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00055237199999999998 2024-09-17T18:16:17.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.769096+0000", 2024-09-17T18:16:17.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0028609410000000001 2024-09-17T18:16:17.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.280 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:17.280 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.775767+0000", 2024-09-17T18:16:17.280 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0066707240000000003 2024-09-17T18:16:17.280 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.280 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.281 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.281 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:34.775837+0000", 2024-09-17T18:16:17.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9844000000000004e-05 2024-09-17T18:16:17.281 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.281 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.281 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.281 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.281 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 42/31 ECSubWrite(tid=87, reqid=client.4565.0:358, at_version=42'26, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:17.281 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.771744+0000", 2024-09-17T18:16:17.281 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.489180107000003, 2024-09-17T18:16:17.281 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015670561, 2024-09-17T18:16:17.281 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.281 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.282 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:17.282 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771744+0000", 2024-09-17T18:16:17.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.282 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.282 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771744+0000", 2024-09-17T18:16:17.282 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.282 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771746+0000", 2024-09-17T18:16:17.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.81e-06 2024-09-17T18:16:17.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771798+0000", 2024-09-17T18:16:17.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2142999999999999e-05 2024-09-17T18:16:17.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.283 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.283 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.283 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771824+0000", 2024-09-17T18:16:17.283 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6052999999999999e-05 2024-09-17T18:16:17.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.771853+0000", 2024-09-17T18:16:17.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8716000000000001e-05 2024-09-17T18:16:17.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773108+0000", 2024-09-17T18:16:17.284 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0012554829999999999 2024-09-17T18:16:17.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.284 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.284 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773139+0000", 2024-09-17T18:16:17.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1003000000000001e-05 2024-09-17T18:16:17.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.786900+0000", 2024-09-17T18:16:17.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013761175 2024-09-17T18:16:17.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.285 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.285 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.285 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787415+0000", 2024-09-17T18:16:17.285 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00051417800000000001 2024-09-17T18:16:17.285 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.285 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.286 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.286 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.286 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 42/31 ECSubWrite(tid=89, reqid=client.4565.0:345, at_version=42'23, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:17.286 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.773988+0000", 2024-09-17T18:16:17.286 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.486935944999999, 2024-09-17T18:16:17.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013188996, 2024-09-17T18:16:17.287 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.287 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.287 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:17.287 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.287 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.287 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.287 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773988+0000", 2024-09-17T18:16:17.287 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773988+0000", 2024-09-17T18:16:17.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.288 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.288 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.773990+0000", 2024-09-17T18:16:17.288 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8360000000000001e-06 2024-09-17T18:16:17.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774050+0000", 2024-09-17T18:16:17.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9735999999999999e-05 2024-09-17T18:16:17.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774085+0000", 2024-09-17T18:16:17.289 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5031999999999999e-05 2024-09-17T18:16:17.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.289 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.289 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774108+0000", 2024-09-17T18:16:17.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3067000000000001e-05 2024-09-17T18:16:17.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775952+0000", 2024-09-17T18:16:17.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018443450000000001 2024-09-17T18:16:17.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.290 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775975+0000", 2024-09-17T18:16:17.290 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2793e-05 2024-09-17T18:16:17.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.290 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.786570+0000", 2024-09-17T18:16:17.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010595099 2024-09-17T18:16:17.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.291 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.291 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787177+0000", 2024-09-17T18:16:17.291 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00060708799999999999 2024-09-17T18:16:17.291 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.291 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.291 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.291 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.291 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 42/31 ECSubWrite(tid=90, reqid=client.4565.0:359, at_version=42'27, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:17.291 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.774176+0000", 2024-09-17T18:16:17.292 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.486747938999997, 2024-09-17T18:16:17.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013323531, 2024-09-17T18:16:17.292 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.292 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.292 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:17.292 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.292 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.292 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774176+0000", 2024-09-17T18:16:17.292 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774176+0000", 2024-09-17T18:16:17.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774177+0000", 2024-09-17T18:16:17.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.2270000000000001e-06 2024-09-17T18:16:17.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.293 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.293 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774218+0000", 2024-09-17T18:16:17.293 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0448999999999998e-05 2024-09-17T18:16:17.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774241+0000", 2024-09-17T18:16:17.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3646e-05 2024-09-17T18:16:17.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.294 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.774265+0000", 2024-09-17T18:16:17.294 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4012999999999999e-05 2024-09-17T18:16:17.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.294 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.294 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.777483+0000", 2024-09-17T18:16:17.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00321712 2024-09-17T18:16:17.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.777498+0000", 2024-09-17T18:16:17.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5566e-05 2024-09-17T18:16:17.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.295 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.295 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787425+0000", 2024-09-17T18:16:17.295 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0099264049999999993 2024-09-17T18:16:17.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.296 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.296 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.787500+0000", 2024-09-17T18:16:17.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5104999999999993e-05 2024-09-17T18:16:17.296 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.296 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.296 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.296 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 42/31 ECSubWrite(tid=91, reqid=client.4565.0:352, at_version=42'25, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:17.296 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.775835+0000", 2024-09-17T18:16:17.296 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.485089017, 2024-09-17T18:16:17.296 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013769896, 2024-09-17T18:16:17.296 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.297 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.297 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:17.297 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775835+0000", 2024-09-17T18:16:17.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.297 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.297 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775835+0000", 2024-09-17T18:16:17.297 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775836+0000", 2024-09-17T18:16:17.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.04e-06 2024-09-17T18:16:17.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775890+0000", 2024-09-17T18:16:17.298 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4225999999999999e-05 2024-09-17T18:16:17.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.298 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.298 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775914+0000", 2024-09-17T18:16:17.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3646e-05 2024-09-17T18:16:17.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.775932+0000", 2024-09-17T18:16:17.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8043e-05 2024-09-17T18:16:17.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.299 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776905+0000", 2024-09-17T18:16:17.299 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00097315499999999996 2024-09-17T18:16:17.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.299 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776926+0000", 2024-09-17T18:16:17.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1322999999999999e-05 2024-09-17T18:16:17.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789505+0000", 2024-09-17T18:16:17.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012578768000000001 2024-09-17T18:16:17.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.300 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.300 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789605+0000", 2024-09-17T18:16:17.300 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9695e-05 2024-09-17T18:16:17.301 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.301 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.301 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.301 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 42/31 ECSubWrite(tid=94, reqid=client.4565.0:353, at_version=42'26, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:17.301 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779073+0000", 2024-09-17T18:16:17.301 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.481850584, 2024-09-17T18:16:17.301 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013251409, 2024-09-17T18:16:17.301 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.301 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.301 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:17.301 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779073+0000", 2024-09-17T18:16:17.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779073+0000", 2024-09-17T18:16:17.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.302 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.302 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779075+0000", 2024-09-17T18:16:17.302 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.734e-06 2024-09-17T18:16:17.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779118+0000", 2024-09-17T18:16:17.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2719000000000002e-05 2024-09-17T18:16:17.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779145+0000", 2024-09-17T18:16:17.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6740000000000001e-05 2024-09-17T18:16:17.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.303 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.303 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779166+0000", 2024-09-17T18:16:17.303 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1029000000000001e-05 2024-09-17T18:16:17.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783908+0000", 2024-09-17T18:16:17.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047425669999999996 2024-09-17T18:16:17.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.304 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.783931+0000", 2024-09-17T18:16:17.304 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2484e-05 2024-09-17T18:16:17.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.304 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792232+0000", 2024-09-17T18:16:17.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0083012639999999992 2024-09-17T18:16:17.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.305 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.305 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792325+0000", 2024-09-17T18:16:17.305 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2872000000000001e-05 2024-09-17T18:16:17.305 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.305 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.305 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.305 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 42/31 ECSubWrite(tid=95, reqid=client.4565.0:354, at_version=42'27, trim_to=0'0, roll_forward_to=39'19))", 2024-09-17T18:16:17.305 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.779371+0000", 2024-09-17T18:16:17.306 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 39.481552686000001, 2024-09-17T18:16:17.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013017299, 2024-09-17T18:16:17.306 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.306 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.306 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:17.306 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.306 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779371+0000", 2024-09-17T18:16:17.306 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.306 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779371+0000", 2024-09-17T18:16:17.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779372+0000", 2024-09-17T18:16:17.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.017e-06 2024-09-17T18:16:17.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.307 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.307 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.307 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779414+0000", 2024-09-17T18:16:17.307 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1862e-05 2024-09-17T18:16:17.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779436+0000", 2024-09-17T18:16:17.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1946e-05 2024-09-17T18:16:17.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.308 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.779452+0000", 2024-09-17T18:16:17.308 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6263999999999999e-05 2024-09-17T18:16:17.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.308 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785966+0000", 2024-09-17T18:16:17.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0065139439999999998 2024-09-17T18:16:17.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.785990+0000", 2024-09-17T18:16:17.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3598999999999999e-05 2024-09-17T18:16:17.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.309 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.309 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792332+0000", 2024-09-17T18:16:17.309 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0063415720000000002 2024-09-17T18:16:17.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.310 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.310 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792389+0000", 2024-09-17T18:16:17.310 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7095000000000001e-05 2024-09-17T18:16:17.310 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.310 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.310 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.310 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 43/31 ECSubWrite(tid=105, reqid=osd.4.0:105, at_version=43'38, trim_to=0'0, roll_forward_to=42'34))", 2024-09-17T18:16:17.310 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:38.770201+0000", 2024-09-17T18:16:17.310 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 38.490722955999999, 2024-09-17T18:16:17.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013112386, 2024-09-17T18:16:17.311 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.311 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.311 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:17.311 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770201+0000", 2024-09-17T18:16:17.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.311 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.311 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.311 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770201+0000", 2024-09-17T18:16:17.311 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770203+0000", 2024-09-17T18:16:17.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3969999999999999e-06 2024-09-17T18:16:17.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.312 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770256+0000", 2024-09-17T18:16:17.312 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3615000000000001e-05 2024-09-17T18:16:17.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.312 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770288+0000", 2024-09-17T18:16:17.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.218e-05 2024-09-17T18:16:17.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.770310+0000", 2024-09-17T18:16:17.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1386000000000002e-05 2024-09-17T18:16:17.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.313 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.313 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.771914+0000", 2024-09-17T18:16:17.313 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001604556 2024-09-17T18:16:17.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.771940+0000", 2024-09-17T18:16:17.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5514999999999999e-05 2024-09-17T18:16:17.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.783201+0000", 2024-09-17T18:16:17.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011260983 2024-09-17T18:16:17.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.314 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.314 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:38.783313+0000", 2024-09-17T18:16:17.314 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000112754 2024-09-17T18:16:17.315 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.315 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.315 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.315 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:708 3.2s0 3:45e539c6:::smithi15432074-16:head [delete] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-09-17T18:16:17.315 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:06.535476+0000", 2024-09-17T18:16:17.315 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.725447631, 2024-09-17T18:16:17.315 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017019439000000001, 2024-09-17T18:16:17.315 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.315 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.315 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:17.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:17.315 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:17.316 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:17.316 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 708 2024-09-17T18:16:17.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.316 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:06.535476+0000", 2024-09-17T18:16:17.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.316 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.316 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:06.535476+0000", 2024-09-17T18:16:17.316 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:06.535480+0000", 2024-09-17T18:16:17.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6969999999999999e-06 2024-09-17T18:16:17.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:06.535493+0000", 2024-09-17T18:16:17.317 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.3302000000000001e-05 2024-09-17T18:16:17.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.317 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.317 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:06.535531+0000", 2024-09-17T18:16:17.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.7824999999999998e-05 2024-09-17T18:16:17.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:06.535549+0000", 2024-09-17T18:16:17.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7272999999999999e-05 2024-09-17T18:16:17.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.318 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.318 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:06.535700+0000", 2024-09-17T18:16:17.318 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015160299999999999 2024-09-17T18:16:17.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-17T18:16:17.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:06.535716+0000", 2024-09-17T18:16:17.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.6223e-05 2024-09-17T18:16:17.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:06.539762+0000", 2024-09-17T18:16:17.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040454009999999997 2024-09-17T18:16:17.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.319 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:17.319 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:06.539908+0000", 2024-09-17T18:16:17.319 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014651599999999999 2024-09-17T18:16:17.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:06.541346+0000", 2024-09-17T18:16:17.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00143761 2024-09-17T18:16:17.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:06.543500+0000", 2024-09-17T18:16:17.320 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021538320000000001 2024-09-17T18:16:17.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.320 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:17.320 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:06.552372+0000", 2024-09-17T18:16:17.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0088725660000000001 2024-09-17T18:16:17.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.321 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.321 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:06.552496+0000", 2024-09-17T18:16:17.321 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012359099999999999 2024-09-17T18:16:17.321 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.321 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.321 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.321 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 75/31 ECSubWrite(tid=246, reqid=client.4565.0:760, at_version=75'94, trim_to=0'0, roll_forward_to=72'92))", 2024-09-17T18:16:17.321 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.332062+0000", 2024-09-17T18:16:17.321 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.9288618350000002, 2024-09-17T18:16:17.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017811364999999999, 2024-09-17T18:16:17.322 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.322 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.322 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:17.322 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.332062+0000", 2024-09-17T18:16:17.322 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.322 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.322 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.332062+0000", 2024-09-17T18:16:17.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.332070+0000", 2024-09-17T18:16:17.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1629999999999996e-06 2024-09-17T18:16:17.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.323 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.323 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.332704+0000", 2024-09-17T18:16:17.323 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00063376999999999997 2024-09-17T18:16:17.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.332734+0000", 2024-09-17T18:16:17.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9737999999999999e-05 2024-09-17T18:16:17.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.332756+0000", 2024-09-17T18:16:17.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2399e-05 2024-09-17T18:16:17.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.324 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.324 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.334281+0000", 2024-09-17T18:16:17.324 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015245149999999999 2024-09-17T18:16:17.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.334304+0000", 2024-09-17T18:16:17.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3385000000000001e-05 2024-09-17T18:16:17.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.349768+0000", 2024-09-17T18:16:17.325 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015463503999999999 2024-09-17T18:16:17.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.325 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.325 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.349874+0000", 2024-09-17T18:16:17.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010589100000000001 2024-09-17T18:16:17.326 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.326 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.326 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.326 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.326 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 75/31 ECSubWrite(tid=245, reqid=client.4565.0:761, at_version=75'123, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:17.326 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.335411+0000", 2024-09-17T18:16:17.326 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.9255133779999998, 2024-09-17T18:16:17.326 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019764741999999998, 2024-09-17T18:16:17.326 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.326 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.326 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:17.327 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335411+0000", 2024-09-17T18:16:17.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.327 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335411+0000", 2024-09-17T18:16:17.327 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.327 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.327 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335412+0000", 2024-09-17T18:16:17.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.423e-06 2024-09-17T18:16:17.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335461+0000", 2024-09-17T18:16:17.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9237999999999999e-05 2024-09-17T18:16:17.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.328 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.328 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.328 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335488+0000", 2024-09-17T18:16:17.328 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6968999999999999e-05 2024-09-17T18:16:17.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335866+0000", 2024-09-17T18:16:17.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00037801000000000002 2024-09-17T18:16:17.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.329 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.329 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.336026+0000", 2024-09-17T18:16:17.329 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015991700000000001 2024-09-17T18:16:17.329 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.329 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.336051+0000", 2024-09-17T18:16:17.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4791999999999999e-05 2024-09-17T18:16:17.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.355078+0000", 2024-09-17T18:16:17.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019027174000000001 2024-09-17T18:16:17.330 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.330 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.330 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.330 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.355175+0000", 2024-09-17T18:16:17.330 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7219000000000005e-05 2024-09-17T18:16:17.330 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.331 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.331 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.331 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.331 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.331 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 75/31 ECSubWrite(tid=247, reqid=client.4565.0:762, at_version=75'124, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:17.331 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.337234+0000", 2024-09-17T18:16:17.331 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.9236898360000003, 2024-09-17T18:16:17.331 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019217306, 2024-09-17T18:16:17.331 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.331 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.331 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:17.331 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.337234+0000", 2024-09-17T18:16:17.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.337234+0000", 2024-09-17T18:16:17.332 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.332 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.332 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.332 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.332 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.337244+0000", 2024-09-17T18:16:17.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4499999999999993e-06 2024-09-17T18:16:17.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.337288+0000", 2024-09-17T18:16:17.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4604000000000002e-05 2024-09-17T18:16:17.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.333 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338683+0000", 2024-09-17T18:16:17.333 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0013942410000000001 2024-09-17T18:16:17.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.333 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.333 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338709+0000", 2024-09-17T18:16:17.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6971999999999999e-05 2024-09-17T18:16:17.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.340821+0000", 2024-09-17T18:16:17.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021112230000000002 2024-09-17T18:16:17.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.334 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.334 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.334 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.340845+0000", 2024-09-17T18:16:17.334 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4516e-05 2024-09-17T18:16:17.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.356360+0000", 2024-09-17T18:16:17.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015515057000000001 2024-09-17T18:16:17.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.335 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.335 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.356452+0000", 2024-09-17T18:16:17.335 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1242999999999994e-05 2024-09-17T18:16:17.335 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.335 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.335 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.335 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.335 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.336 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 75/31 ECSubWrite(tid=248, reqid=client.4565.0:763, at_version=75'125, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:17.336 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.338824+0000", 2024-09-17T18:16:17.336 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.9221001639999997, 2024-09-17T18:16:17.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017707374000000001, 2024-09-17T18:16:17.336 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.336 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.336 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:17.336 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.336 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.336 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.336 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338824+0000", 2024-09-17T18:16:17.336 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.336 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338824+0000", 2024-09-17T18:16:17.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338826+0000", 2024-09-17T18:16:17.337 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7069999999999999e-06 2024-09-17T18:16:17.337 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.337 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.337 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338868+0000", 2024-09-17T18:16:17.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2811000000000001e-05 2024-09-17T18:16:17.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338901+0000", 2024-09-17T18:16:17.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2135000000000003e-05 2024-09-17T18:16:17.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.338 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338922+0000", 2024-09-17T18:16:17.338 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1029000000000001e-05 2024-09-17T18:16:17.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.338 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.338 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.345685+0000", 2024-09-17T18:16:17.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0067631150000000001 2024-09-17T18:16:17.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.345711+0000", 2024-09-17T18:16:17.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6389000000000001e-05 2024-09-17T18:16:17.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.339 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.339 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.356460+0000", 2024-09-17T18:16:17.339 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010748781000000001 2024-09-17T18:16:17.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.340 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.340 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.356531+0000", 2024-09-17T18:16:17.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1407000000000003e-05 2024-09-17T18:16:17.340 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.340 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.340 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.340 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.340 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 75/31 ECSubWrite(tid=249, reqid=client.4565.0:764, at_version=75'126, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:17.340 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.341182+0000", 2024-09-17T18:16:17.340 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.9197417449999996, 2024-09-17T18:16:17.340 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015416912, 2024-09-17T18:16:17.341 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.341 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.341 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:17.341 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.341182+0000", 2024-09-17T18:16:17.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.341 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.341 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.341 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.341182+0000", 2024-09-17T18:16:17.341 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.341191+0000", 2024-09-17T18:16:17.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0799999999999995e-06 2024-09-17T18:16:17.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.342 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.341612+0000", 2024-09-17T18:16:17.342 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000420278 2024-09-17T18:16:17.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.342 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.342 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.341645+0000", 2024-09-17T18:16:17.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3503000000000001e-05 2024-09-17T18:16:17.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.341668+0000", 2024-09-17T18:16:17.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2565000000000002e-05 2024-09-17T18:16:17.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.343 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.343 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.346378+0000", 2024-09-17T18:16:17.343 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047098089999999997 2024-09-17T18:16:17.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.343 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.346410+0000", 2024-09-17T18:16:17.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2752000000000001e-05 2024-09-17T18:16:17.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.356541+0000", 2024-09-17T18:16:17.344 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010130508 2024-09-17T18:16:17.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.344 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.344 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.344 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.356599+0000", 2024-09-17T18:16:17.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8417e-05 2024-09-17T18:16:17.345 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.345 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.345 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.345 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.345 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.345 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.es1 75/31 ECSubWrite(tid=35, reqid=osd.11.0:34, at_version=0'0, trim_to=0'0, roll_forward_to=75'23))", 2024-09-17T18:16:17.345 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.343503+0000", 2024-09-17T18:16:17.345 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.9174214110000003, 2024-09-17T18:16:17.345 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012564864, 2024-09-17T18:16:17.345 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.345 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.346 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:17.346 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.343503+0000", 2024-09-17T18:16:17.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.346 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.346 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.343503+0000", 2024-09-17T18:16:17.346 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.346 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.343505+0000", 2024-09-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1600000000000001e-06 2024-09-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.343535+0000", 2024-09-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0378999999999998e-05 2024-09-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.343593+0000", 2024-09-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7976999999999997e-05 2024-09-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.347 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.343618+0000", 2024-09-17T18:16:17.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4436000000000001e-05 2024-09-17T18:16:17.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.343823+0000", 2024-09-17T18:16:17.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020495800000000001 2024-09-17T18:16:17.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.348 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.348 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.348 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.343848+0000", 2024-09-17T18:16:17.348 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5505000000000001e-05 2024-09-17T18:16:17.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.355807+0000", 2024-09-17T18:16:17.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0119589 2024-09-17T18:16:17.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.349 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.349 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.349 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.356068+0000", 2024-09-17T18:16:17.349 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000260549 2024-09-17T18:16:17.349 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.349 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.349 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.350 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 75/31 ECSubWrite(tid=250, reqid=client.4565.0:765, at_version=75'127, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:17.350 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.345492+0000", 2024-09-17T18:16:17.350 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 6.9154325390000002, 2024-09-17T18:16:17.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013084625000000001, 2024-09-17T18:16:17.350 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.350 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.350 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:17.350 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.350 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.350 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.350 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.345492+0000", 2024-09-17T18:16:17.350 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.345492+0000", 2024-09-17T18:16:17.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.345494+0000", 2024-09-17T18:16:17.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1169999999999998e-06 2024-09-17T18:16:17.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.351 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.351 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.351 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.345818+0000", 2024-09-17T18:16:17.351 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00032445899999999998 2024-09-17T18:16:17.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.345863+0000", 2024-09-17T18:16:17.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4662e-05 2024-09-17T18:16:17.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.352 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.345889+0000", 2024-09-17T18:16:17.352 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6444999999999998e-05 2024-09-17T18:16:17.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.352 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.352 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.347772+0000", 2024-09-17T18:16:17.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0018825529999999999 2024-09-17T18:16:17.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.347811+0000", 2024-09-17T18:16:17.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.8878000000000003e-05 2024-09-17T18:16:17.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.353 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.353 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.358491+0000", 2024-09-17T18:16:17.353 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010680646 2024-09-17T18:16:17.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.353 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.354 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.354 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.358576+0000", 2024-09-17T18:16:17.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4864999999999995e-05 2024-09-17T18:16:17.354 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.354 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.354 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.354 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.354 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.354 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:778 3.2s0 3:4d1a0b53:::smithi15432074-38:head [copy-from ver 27] snapc 1c=[1c,19,18,17,16,15,13,11,10,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T18:16:17.354 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:11.384083+0000", 2024-09-17T18:16:17.354 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.8768408040000004, 2024-09-17T18:16:17.354 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042878652000000003, 2024-09-17T18:16:17.354 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.354 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.355 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:17.355 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:17.355 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:17.355 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:17.355 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 778 2024-09-17T18:16:17.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.355 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.355 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.355 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384083+0000", 2024-09-17T18:16:17.355 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.355 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.355 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384083+0000", 2024-09-17T18:16:17.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384087+0000", 2024-09-17T18:16:17.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2890000000000002e-06 2024-09-17T18:16:17.356 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.356 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.356 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384101+0000", 2024-09-17T18:16:17.356 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4630999999999999e-05 2024-09-17T18:16:17.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384133+0000", 2024-09-17T18:16:17.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1792999999999999e-05 2024-09-17T18:16:17.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384152+0000", 2024-09-17T18:16:17.357 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9023999999999999e-05 2024-09-17T18:16:17.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.357 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.357 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384304+0000", 2024-09-17T18:16:17.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015227099999999999 2024-09-17T18:16:17.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:17.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384581+0000", 2024-09-17T18:16:17.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027697799999999999 2024-09-17T18:16:17.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:17.358 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.417138+0000", 2024-09-17T18:16:17.358 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.032556278000000001 2024-09-17T18:16:17.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.358 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:17.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.425666+0000", 2024-09-17T18:16:17.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0085287820000000004 2024-09-17T18:16:17.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:17.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.426814+0000", 2024-09-17T18:16:17.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011479369999999999 2024-09-17T18:16:17.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.359 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.359 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.426962+0000", 2024-09-17T18:16:17.359 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014766900000000001 2024-09-17T18:16:17.359 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.359 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.360 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.360 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.360 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.360 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:779 3.2s0 3:4d1a0b53:::smithi15432074-38:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-09-17T18:16:17.360 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:11.384204+0000", 2024-09-17T18:16:17.360 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.8767198540000001, 2024-09-17T18:16:17.360 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039332700999999998, 2024-09-17T18:16:17.360 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:17.360 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:17.360 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-17T18:16:17.360 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:17.360 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:17.360 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:17.360 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 779 2024-09-17T18:16:17.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.361 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:17.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:17.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384204+0000", 2024-09-17T18:16:17.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.361 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:17.361 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384204+0000", 2024-09-17T18:16:17.361 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:17.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:17.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384206+0000", 2024-09-17T18:16:17.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5740000000000001e-06 2024-09-17T18:16:17.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:17.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384213+0000", 2024-09-17T18:16:17.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1049999999999997e-06 2024-09-17T18:16:17.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.362 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:17.362 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384236+0000", 2024-09-17T18:16:17.362 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2991000000000001e-05 2024-09-17T18:16:17.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:17.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384255+0000", 2024-09-17T18:16:17.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9256e-05 2024-09-17T18:16:17.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384960+0000", 2024-09-17T18:16:17.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00070503600000000003 2024-09-17T18:16:17.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.363 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for blocked object", 2024-09-17T18:16:17.363 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.385064+0000", 2024-09-17T18:16:17.363 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103724 2024-09-17T18:16:17.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:17.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.422933+0000", 2024-09-17T18:16:17.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037868952999999997 2024-09-17T18:16:17.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:17.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.423214+0000", 2024-09-17T18:16:17.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00028103200000000002 2024-09-17T18:16:17.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:17.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:17.364 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:17.364 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.423537+0000", 2024-09-17T18:16:17.364 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00032302999999999998 2024-09-17T18:16:17.365 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.365 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.365 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.365 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:17.365 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:17.365 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:17.366 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:16:17.366 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:16:17.367 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:16:17.367 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:16:17.368 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T18:16:17.368 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:17.362+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:17.368 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:16:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:16:17.369 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:16:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:16:17.467 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:17.462+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:17.501 INFO:tasks.rados.rados.0.smithi154.stdout:332: done (3 left) 2024-09-17T18:16:17.501 INFO:tasks.rados.rados.0.smithi154.stdout:334: done (2 left) 2024-09-17T18:16:17.501 INFO:tasks.rados.rados.0.smithi154.stdout:339: done (1 left) 2024-09-17T18:16:17.501 INFO:tasks.rados.rados.0.smithi154.stdout:341: done (0 left) 2024-09-17T18:16:17.501 INFO:tasks.rados.rados.0.smithi154.stdout:342: rollback oid 3 current snap is 29 2024-09-17T18:16:17.502 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 3 to 20 2024-09-17T18:16:17.502 INFO:tasks.rados.rados.0.smithi154.stdout:343: read oid 50 snap -1 2024-09-17T18:16:17.502 INFO:tasks.rados.rados.0.smithi154.stdout:343: expect (ObjNum 101 snap 20 seq_num 101) 2024-09-17T18:16:17.502 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 1 current snap is 29 2024-09-17T18:16:17.502 INFO:tasks.rados.rados.0.smithi154.stdout:344: seq_num 143 ranges {32768=458752,491520=475136,966656=655360,1622016=671744,2293760=147456} 2024-09-17T18:16:17.503 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:17.503 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:17.511 INFO:tasks.rados.rados.0.smithi154.stdout:344: writing smithi15432074-1 from 32768 to 491520 tid 1 2024-09-17T18:16:17.515 INFO:tasks.rados.rados.0.smithi154.stdout:344: writing smithi15432074-1 from 491520 to 966656 tid 2 2024-09-17T18:16:17.522 INFO:tasks.rados.rados.0.smithi154.stdout:344: writing smithi15432074-1 from 966656 to 1622016 tid 3 2024-09-17T18:16:17.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T18:16:17.528 INFO:tasks.rados.rados.0.smithi154.stdout:344: writing smithi15432074-1 from 1622016 to 2293760 tid 4 2024-09-17T18:16:17.529 INFO:tasks.rados.rados.0.smithi154.stdout:344: writing smithi15432074-1 from 2293760 to 2441216 tid 5 2024-09-17T18:16:17.529 INFO:tasks.rados.rados.0.smithi154.stdout:345: read oid 22 snap 6 2024-09-17T18:16:17.529 INFO:tasks.rados.rados.0.smithi154.stdout:345: expect (ObjNum 57 snap 1 seq_num 57) 2024-09-17T18:16:17.529 INFO:tasks.rados.rados.0.smithi154.stdout:346: setattr oid 27 current snap is 29 2024-09-17T18:16:17.529 INFO:tasks.rados.rados.0.smithi154.stdout:342: finishing rollback tid 1 to smithi15432074-3 2024-09-17T18:16:17.529 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 3 v 13 (ObjNum 65 snap 0 seq_num 4036851216) dirty dne 2024-09-17T18:16:17.530 INFO:tasks.rados.rados.0.smithi154.stdout:343: expect (ObjNum 101 snap 20 seq_num 101) 2024-09-17T18:16:17.530 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:17.541 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T18:16:17.592 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:17.589+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:17.599 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 954212 2024-09-17T18:16:17.643 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:17.644 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:17.658 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T18:16:17.659 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 3330056 2024-09-17T18:16:17.661 INFO:tasks.rados.rados.0.smithi154.stdout:344: finishing write tid 1 to smithi15432074-1 2024-09-17T18:16:17.661 INFO:tasks.rados.rados.0.smithi154.stdout:344: finishing write tid 2 to smithi15432074-1 2024-09-17T18:16:17.661 INFO:tasks.rados.rados.0.smithi154.stdout:344: finishing write tid 3 to smithi15432074-1 2024-09-17T18:16:17.661 INFO:tasks.rados.rados.0.smithi154.stdout:344: finishing write tid 4 to smithi15432074-1 2024-09-17T18:16:17.661 INFO:tasks.rados.rados.0.smithi154.stdout:344: finishing write tid 5 to smithi15432074-1 2024-09-17T18:16:17.661 INFO:tasks.rados.rados.0.smithi154.stdout:344: finishing write tid 6 to smithi15432074-1 2024-09-17T18:16:17.661 INFO:tasks.rados.rados.0.smithi154.stdout:344: finishing write tid 7 to smithi15432074-1 2024-09-17T18:16:17.661 INFO:tasks.rados.rados.0.smithi154.stdout:344: oid 1 updating version 0 to 93 2024-09-17T18:16:17.662 INFO:tasks.rados.rados.0.smithi154.stdout:344: oid 1 updating version 93 to 98 2024-09-17T18:16:17.662 INFO:tasks.rados.rados.0.smithi154.stdout:344: oid 1 version 98 is already newer than 94 2024-09-17T18:16:17.662 INFO:tasks.rados.rados.0.smithi154.stdout:344: oid 1 version 98 is already newer than 97 2024-09-17T18:16:17.662 INFO:tasks.rados.rados.0.smithi154.stdout:344: oid 1 version 98 is already newer than 95 2024-09-17T18:16:17.662 INFO:tasks.rados.rados.0.smithi154.stdout:344: oid 1 version 98 is already newer than 96 2024-09-17T18:16:17.662 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 1 v 98 (ObjNum 143 snap 29 seq_num 143) dirty exists 2024-09-17T18:16:17.662 INFO:tasks.rados.rados.0.smithi154.stdout:344: left oid 1 (ObjNum 143 snap 29 seq_num 143) 2024-09-17T18:16:17.662 INFO:tasks.rados.rados.0.smithi154.stdout:342: done (4 left) 2024-09-17T18:16:17.662 INFO:tasks.rados.rados.0.smithi154.stdout:343: done (3 left) 2024-09-17T18:16:17.662 INFO:tasks.rados.rados.0.smithi154.stdout:344: done (2 left) 2024-09-17T18:16:17.663 INFO:tasks.rados.rados.0.smithi154.stdout:347: snap_create 2024-09-17T18:16:17.668 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 27 v 132 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-09-17T18:16:17.670 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:17.665+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:17.769 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:17.766+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:17.780 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:17.780 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:17.794 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T18:16:17.870 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:17.866+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:17.957 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:17.957 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:17.971 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T18:16:17.972 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:17.969+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:18.073 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:16:18.070+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:16:18.090 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:18.090 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:18.104 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T18:16:18.173 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:18.170+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:18.228 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:18.228 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:18.244 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T18:16:18.275 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:18.273+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:18.314 INFO:teuthology.orchestra.run.smithi087.stderr:noscrub is unset 2024-09-17T18:16:18.321 INFO:tasks.rados.rados.0.smithi154.stdout:346: done (2 left) 2024-09-17T18:16:18.321 INFO:tasks.rados.rados.0.smithi154.stdout:347: done (1 left) 2024-09-17T18:16:18.321 INFO:tasks.rados.rados.0.smithi154.stdout:348: rollback oid 29 current snap is 30 2024-09-17T18:16:18.321 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 29 to 27 2024-09-17T18:16:18.321 INFO:tasks.rados.rados.0.smithi154.stdout:349: snap_remove snap 21 2024-09-17T18:16:18.375 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:18.375 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:18.387 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:18.385+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:18.392 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T18:16:18.477 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:18.473+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:18.520 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:18.520 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:18.534 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T18:16:18.625 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:18.621+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:18.678 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:18.674+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:18.698 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:18.698 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:18.711 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T18:16:18.779 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:18.773+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:18.879 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:18.880 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:18.880 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:18.877+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:18.894 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T18:16:18.981 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:18.977+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:19.015 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:19.016 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:19.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T18:16:19.082 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:19.077+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:19.151 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:19.151 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:19.165 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T18:16:19.182 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:19.177+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:19.284 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:19.282+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:19.296 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:19.296 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:19.310 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T18:16:19.323 INFO:tasks.rados.rados.0.smithi154.stdout:349: done (2 left) 2024-09-17T18:16:19.323 INFO:tasks.rados.rados.0.smithi154.stdout:350: snap_remove snap 5 2024-09-17T18:16:19.370 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T18:16:19.384 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:19.381+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:19.442 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:19.443 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:19.458 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T18:16:19.508 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:19.505+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:19.510 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:16:19.510 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:16:19.512 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T18:16:19.512 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T18:16:19.512 INFO:tasks.thrashosds.thrasher:Shrinking pool unique_pool_0 2024-09-17T18:16:19.512 INFO:tasks.ceph.ceph_manager.ceph:contract_pool unique_pool_0 by 10 min 16 2024-09-17T18:16:19.512 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:16:19.533 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:16:19.533 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:16:19.554 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:16:19.555 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:16:19.585 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:19.582+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:19.589 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:16:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:16:19.598 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:19.598 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-17T18:16:19.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-17T18:16:19.598 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-17T18:16:19.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.598 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 42/31 ECSubWrite(tid=87, reqid=client.4565.0:358, at_version=42'26, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:19.598 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.771519+0000", 2024-09-17T18:16:19.598 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.823980941000002, 2024-09-17T18:16:19.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090010019999999993, 2024-09-17T18:16:19.598 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.599 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.599 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:19.599 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771519+0000", 2024-09-17T18:16:19.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771519+0000", 2024-09-17T18:16:19.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771521+0000", 2024-09-17T18:16:19.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.528e-06 2024-09-17T18:16:19.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771559+0000", 2024-09-17T18:16:19.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7567000000000001e-05 2024-09-17T18:16:19.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771587+0000", 2024-09-17T18:16:19.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8561e-05 2024-09-17T18:16:19.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771603+0000", 2024-09-17T18:16:19.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5654e-05 2024-09-17T18:16:19.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771678+0000", 2024-09-17T18:16:19.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630999999999995e-05 2024-09-17T18:16:19.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:19.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771687+0000", 2024-09-17T18:16:19.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9809999999999992e-06 2024-09-17T18:16:19.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:19.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780476+0000", 2024-09-17T18:16:19.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087883019999999996 2024-09-17T18:16:19.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.780520+0000", 2024-09-17T18:16:19.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4777999999999997e-05 2024-09-17T18:16:19.603 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.603 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.603 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.603 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.8s1 42/31 ECSubWrite(tid=134, reqid=osd.6.0:133, at_version=0'0, trim_to=0'0, roll_forward_to=42'17))", 2024-09-17T18:16:19.603 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.773401+0000", 2024-09-17T18:16:19.603 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.822099152, 2024-09-17T18:16:19.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0098034449999999992, 2024-09-17T18:16:19.603 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.603 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.603 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:19.604 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773401+0000", 2024-09-17T18:16:19.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773401+0000", 2024-09-17T18:16:19.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773403+0000", 2024-09-17T18:16:19.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.75e-06 2024-09-17T18:16:19.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773424+0000", 2024-09-17T18:16:19.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1339e-05 2024-09-17T18:16:19.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773455+0000", 2024-09-17T18:16:19.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0539e-05 2024-09-17T18:16:19.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773471+0000", 2024-09-17T18:16:19.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6453e-05 2024-09-17T18:16:19.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773629+0000", 2024-09-17T18:16:19.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015783099999999999 2024-09-17T18:16:19.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:19.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773645+0000", 2024-09-17T18:16:19.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5882000000000001e-05 2024-09-17T18:16:19.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:19.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783144+0000", 2024-09-17T18:16:19.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094992210000000004 2024-09-17T18:16:19.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.783205+0000", 2024-09-17T18:16:19.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0430000000000002e-05 2024-09-17T18:16:19.608 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.608 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.608 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.608 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:376 3.6s0 3:6126409b:::smithi15432074-43:head [append 0~671744] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:16:19.608 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.069257+0000", 2024-09-17T18:16:19.608 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.526243411999999, 2024-09-17T18:16:19.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0097659919999999994, 2024-09-17T18:16:19.608 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.608 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.608 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:19.609 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:19.609 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:19.609 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:19.609 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 376 2024-09-17T18:16:19.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.609 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.069257+0000", 2024-09-17T18:16:19.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.069257+0000", 2024-09-17T18:16:19.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.069258+0000", 2024-09-17T18:16:19.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.347e-06 2024-09-17T18:16:19.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070218+0000", 2024-09-17T18:16:19.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00095974999999999999 2024-09-17T18:16:19.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070230+0000", 2024-09-17T18:16:19.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1867e-05 2024-09-17T18:16:19.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070237+0000", 2024-09-17T18:16:19.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630000000000003e-06 2024-09-17T18:16:19.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.071273+0000", 2024-09-17T18:16:19.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010355329999999999 2024-09-17T18:16:19.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:19.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.071421+0000", 2024-09-17T18:16:19.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000147596 2024-09-17T18:16:19.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:19.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.073068+0000", 2024-09-17T18:16:19.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016475859999999999 2024-09-17T18:16:19.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:19.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.076443+0000", 2024-09-17T18:16:19.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033753059999999998 2024-09-17T18:16:19.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:19.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.078917+0000", 2024-09-17T18:16:19.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002473931 2024-09-17T18:16:19.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.079023+0000", 2024-09-17T18:16:19.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105513 2024-09-17T18:16:19.613 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.613 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.614 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.614 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:377 3.6s0 3:6126409b:::smithi15432074-43:head [append 0~98304] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:16:19.614 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.070254+0000", 2024-09-17T18:16:19.614 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.525246498000001, 2024-09-17T18:16:19.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011803045, 2024-09-17T18:16:19.614 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.614 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.614 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:19.614 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:19.614 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:19.615 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:19.615 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 377 2024-09-17T18:16:19.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.615 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070254+0000", 2024-09-17T18:16:19.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070254+0000", 2024-09-17T18:16:19.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070255+0000", 2024-09-17T18:16:19.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.23e-07 2024-09-17T18:16:19.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070295+0000", 2024-09-17T18:16:19.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0540999999999997e-05 2024-09-17T18:16:19.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070306+0000", 2024-09-17T18:16:19.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0564000000000001e-05 2024-09-17T18:16:19.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070313+0000", 2024-09-17T18:16:19.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8979999999999999e-06 2024-09-17T18:16:19.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.074474+0000", 2024-09-17T18:16:19.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004161718 2024-09-17T18:16:19.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:19.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.074608+0000", 2024-09-17T18:16:19.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013348599999999999 2024-09-17T18:16:19.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:19.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.075463+0000", 2024-09-17T18:16:19.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085558400000000005 2024-09-17T18:16:19.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:19.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.076770+0000", 2024-09-17T18:16:19.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013061839999999999 2024-09-17T18:16:19.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:19.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.081960+0000", 2024-09-17T18:16:19.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005190643 2024-09-17T18:16:19.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.082057+0000", 2024-09-17T18:16:19.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6603999999999999e-05 2024-09-17T18:16:19.620 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.620 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.620 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.620 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:378 3.6s0 3:6126409b:::smithi15432074-43:head [setxattr _header (56) in=7b] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:16:19.620 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.070324+0000", 2024-09-17T18:16:19.620 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.525176801999997, 2024-09-17T18:16:19.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013464016000000001, 2024-09-17T18:16:19.621 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.621 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.621 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:19.621 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:19.621 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:19.621 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:19.621 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 378 2024-09-17T18:16:19.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.621 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070324+0000", 2024-09-17T18:16:19.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070324+0000", 2024-09-17T18:16:19.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070324+0000", 2024-09-17T18:16:19.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.82e-07 2024-09-17T18:16:19.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070327+0000", 2024-09-17T18:16:19.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.101e-06 2024-09-17T18:16:19.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070334+0000", 2024-09-17T18:16:19.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.922e-06 2024-09-17T18:16:19.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070340+0000", 2024-09-17T18:16:19.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4750000000000001e-06 2024-09-17T18:16:19.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.076926+0000", 2024-09-17T18:16:19.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065863370000000003 2024-09-17T18:16:19.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:19.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.077071+0000", 2024-09-17T18:16:19.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014542799999999999 2024-09-17T18:16:19.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:19.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.077737+0000", 2024-09-17T18:16:19.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00066590699999999998 2024-09-17T18:16:19.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:19.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.078436+0000", 2024-09-17T18:16:19.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00069889500000000005 2024-09-17T18:16:19.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:19.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.083638+0000", 2024-09-17T18:16:19.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052022270000000002 2024-09-17T18:16:19.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.083788+0000", 2024-09-17T18:16:19.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000149142 2024-09-17T18:16:19.626 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.626 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.626 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.626 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:379 3.6s0 3:6126409b:::smithi15432074-43:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:16:19.626 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:39.070348+0000", 2024-09-17T18:16:19.626 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.525152638999998, 2024-09-17T18:16:19.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015030777, 2024-09-17T18:16:19.626 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.627 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.627 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:16:19.627 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:19.627 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:19.627 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:19.627 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 379 2024-09-17T18:16:19.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.627 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070348+0000", 2024-09-17T18:16:19.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070348+0000", 2024-09-17T18:16:19.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070348+0000", 2024-09-17T18:16:19.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3799999999999997e-07 2024-09-17T18:16:19.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070351+0000", 2024-09-17T18:16:19.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0170000000000001e-06 2024-09-17T18:16:19.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070359+0000", 2024-09-17T18:16:19.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2160000000000006e-06 2024-09-17T18:16:19.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.070366+0000", 2024-09-17T18:16:19.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8129999999999998e-06 2024-09-17T18:16:19.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.078205+0000", 2024-09-17T18:16:19.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007839047 2024-09-17T18:16:19.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:19.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.078327+0000", 2024-09-17T18:16:19.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012210000000000001 2024-09-17T18:16:19.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.084385+0000", 2024-09-17T18:16:19.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060574699999999997 2024-09-17T18:16:19.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:19.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.084512+0000", 2024-09-17T18:16:19.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000127086 2024-09-17T18:16:19.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:39.085378+0000", 2024-09-17T18:16:19.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086649000000000003 2024-09-17T18:16:19.632 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.632 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.632 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.632 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:505 3.6s0 3:6f149d43:::smithi15432074-47:head [read 0~2244608,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:19.632 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310195+0000", 2024-09-17T18:16:19.632 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.285305640000001, 2024-09-17T18:16:19.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024697646, 2024-09-17T18:16:19.632 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.632 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.633 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:16:19.633 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:19.633 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:19.633 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:19.633 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 505 2024-09-17T18:16:19.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.633 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310195+0000", 2024-09-17T18:16:19.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310195+0000", 2024-09-17T18:16:19.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310199+0000", 2024-09-17T18:16:19.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0600000000000001e-06 2024-09-17T18:16:19.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310216+0000", 2024-09-17T18:16:19.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6728999999999999e-05 2024-09-17T18:16:19.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310259+0000", 2024-09-17T18:16:19.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3915999999999998e-05 2024-09-17T18:16:19.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310286+0000", 2024-09-17T18:16:19.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6990000000000001e-05 2024-09-17T18:16:19.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310531+0000", 2024-09-17T18:16:19.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024485099999999998 2024-09-17T18:16:19.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-17T18:16:19.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310552+0000", 2024-09-17T18:16:19.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0954999999999998e-05 2024-09-17T18:16:19.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.316293+0000", 2024-09-17T18:16:19.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057404810000000004 2024-09-17T18:16:19.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:19.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.316555+0000", 2024-09-17T18:16:19.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026257100000000002 2024-09-17T18:16:19.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.334892+0000", 2024-09-17T18:16:19.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018337092999999999 2024-09-17T18:16:19.637 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.637 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.637 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.638 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:506 3.6s0 3:6f149d43:::smithi15432074-47:head [read 970914~1273694,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:19.638 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310344+0000", 2024-09-17T18:16:19.638 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.285156697000001, 2024-09-17T18:16:19.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025596168999999998, 2024-09-17T18:16:19.638 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.638 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.638 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:16:19.638 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:19.638 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:19.638 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:19.638 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 506 2024-09-17T18:16:19.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.639 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310344+0000", 2024-09-17T18:16:19.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310344+0000", 2024-09-17T18:16:19.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310345+0000", 2024-09-17T18:16:19.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.443e-06 2024-09-17T18:16:19.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310354+0000", 2024-09-17T18:16:19.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5799999999999992e-06 2024-09-17T18:16:19.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310380+0000", 2024-09-17T18:16:19.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6556000000000001e-05 2024-09-17T18:16:19.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310401+0000", 2024-09-17T18:16:19.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0667000000000001e-05 2024-09-17T18:16:19.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310820+0000", 2024-09-17T18:16:19.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00041894300000000002 2024-09-17T18:16:19.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:19.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310838+0000", 2024-09-17T18:16:19.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8156e-05 2024-09-17T18:16:19.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.317663+0000", 2024-09-17T18:16:19.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068248120000000004 2024-09-17T18:16:19.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:19.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.317905+0000", 2024-09-17T18:16:19.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024252400000000001 2024-09-17T18:16:19.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.335940+0000", 2024-09-17T18:16:19.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018034488000000001 2024-09-17T18:16:19.643 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.643 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.643 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.644 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:507 3.6s0 3:6f149d43:::smithi15432074-47:head [read 0~2244608,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:19.644 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310509+0000", 2024-09-17T18:16:19.644 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.284991071, 2024-09-17T18:16:19.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028949084999999999, 2024-09-17T18:16:19.644 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.644 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.644 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:16:19.644 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:19.644 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:19.644 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:19.644 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 507 2024-09-17T18:16:19.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.645 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310509+0000", 2024-09-17T18:16:19.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310509+0000", 2024-09-17T18:16:19.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310511+0000", 2024-09-17T18:16:19.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5629999999999999e-06 2024-09-17T18:16:19.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310520+0000", 2024-09-17T18:16:19.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3940000000000002e-06 2024-09-17T18:16:19.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310545+0000", 2024-09-17T18:16:19.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4892000000000002e-05 2024-09-17T18:16:19.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310561+0000", 2024-09-17T18:16:19.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6157000000000001e-05 2024-09-17T18:16:19.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310936+0000", 2024-09-17T18:16:19.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00037458400000000002 2024-09-17T18:16:19.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:19.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310952+0000", 2024-09-17T18:16:19.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.592e-05 2024-09-17T18:16:19.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.318680+0000", 2024-09-17T18:16:19.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077277200000000004 2024-09-17T18:16:19.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:19.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.318909+0000", 2024-09-17T18:16:19.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000229714 2024-09-17T18:16:19.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339458+0000", 2024-09-17T18:16:19.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020549141 2024-09-17T18:16:19.652 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.652 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.652 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.652 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpReadReply(3.6s0 53/31 ECSubReadReply(tid=44, attrs_read=0))", 2024-09-17T18:16:19.652 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.322520+0000", 2024-09-17T18:16:19.652 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.272980738000001, 2024-09-17T18:16:19.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01243506, 2024-09-17T18:16:19.652 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.653 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.654 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:19.654 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.322520+0000", 2024-09-17T18:16:19.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.322520+0000", 2024-09-17T18:16:19.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.322521+0000", 2024-09-17T18:16:19.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2529999999999999e-06 2024-09-17T18:16:19.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.331725+0000", 2024-09-17T18:16:19.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092041380000000006 2024-09-17T18:16:19.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.331750+0000", 2024-09-17T18:16:19.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5086e-05 2024-09-17T18:16:19.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.331767+0000", 2024-09-17T18:16:19.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6736e-05 2024-09-17T18:16:19.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.332185+0000", 2024-09-17T18:16:19.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00041827699999999999 2024-09-17T18:16:19.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.334955+0000", 2024-09-17T18:16:19.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0027695699999999998 2024-09-17T18:16:19.657 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.657 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.657 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.657 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 75/31 ECSubWrite(tid=247, reqid=client.4565.0:762, at_version=75'124, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:19.657 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.337519+0000", 2024-09-17T18:16:19.657 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.2579818389999993, 2024-09-17T18:16:19.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010234076999999999, 2024-09-17T18:16:19.657 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.657 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.657 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:19.658 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337519+0000", 2024-09-17T18:16:19.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337519+0000", 2024-09-17T18:16:19.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337519+0000", 2024-09-17T18:16:19.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8299999999999997e-07 2024-09-17T18:16:19.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337545+0000", 2024-09-17T18:16:19.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6203999999999998e-05 2024-09-17T18:16:19.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337561+0000", 2024-09-17T18:16:19.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5483000000000001e-05 2024-09-17T18:16:19.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337570+0000", 2024-09-17T18:16:19.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7499999999999998e-06 2024-09-17T18:16:19.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.338890+0000", 2024-09-17T18:16:19.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001319333 2024-09-17T18:16:19.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:19.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.338902+0000", 2024-09-17T18:16:19.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2629999999999999e-05 2024-09-17T18:16:19.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:19.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.347685+0000", 2024-09-17T18:16:19.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087828660000000003 2024-09-17T18:16:19.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.347753+0000", 2024-09-17T18:16:19.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7328000000000003e-05 2024-09-17T18:16:19.661 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.662 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.662 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.662 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs1 75/31 ECSubWrite(tid=248, reqid=client.4565.0:763, at_version=75'125, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:19.662 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.337586+0000", 2024-09-17T18:16:19.662 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.2579139270000006, 2024-09-17T18:16:19.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010196818, 2024-09-17T18:16:19.662 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.662 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.662 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:19.662 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337586+0000", 2024-09-17T18:16:19.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337586+0000", 2024-09-17T18:16:19.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337587+0000", 2024-09-17T18:16:19.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.51e-07 2024-09-17T18:16:19.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337629+0000", 2024-09-17T18:16:19.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2330999999999998e-05 2024-09-17T18:16:19.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337641+0000", 2024-09-17T18:16:19.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1742e-05 2024-09-17T18:16:19.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337650+0000", 2024-09-17T18:16:19.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0219999999999993e-06 2024-09-17T18:16:19.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.341046+0000", 2024-09-17T18:16:19.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003395936 2024-09-17T18:16:19.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:19.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.341090+0000", 2024-09-17T18:16:19.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3826999999999999e-05 2024-09-17T18:16:19.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:19.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.347758+0000", 2024-09-17T18:16:19.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006667872 2024-09-17T18:16:19.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.347783+0000", 2024-09-17T18:16:19.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5537e-05 2024-09-17T18:16:19.666 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.666 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.667 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.667 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.8s1 75/31 ECSubWrite(tid=180, reqid=osd.6.0:180, at_version=75'64, trim_to=0'0, roll_forward_to=73'60))", 2024-09-17T18:16:19.667 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.339285+0000", 2024-09-17T18:16:19.667 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.2562153620000007, 2024-09-17T18:16:19.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099829429999999993, 2024-09-17T18:16:19.667 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.667 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.667 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:19.667 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.339285+0000", 2024-09-17T18:16:19.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.339285+0000", 2024-09-17T18:16:19.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.339286+0000", 2024-09-17T18:16:19.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5000000000000003e-07 2024-09-17T18:16:19.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.339307+0000", 2024-09-17T18:16:19.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1233000000000002e-05 2024-09-17T18:16:19.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.339317+0000", 2024-09-17T18:16:19.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0271e-05 2024-09-17T18:16:19.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.339325+0000", 2024-09-17T18:16:19.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6860000000000006e-06 2024-09-17T18:16:19.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.340205+0000", 2024-09-17T18:16:19.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00088022600000000001 2024-09-17T18:16:19.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:19.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.340219+0000", 2024-09-17T18:16:19.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3942e-05 2024-09-17T18:16:19.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:19.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.349237+0000", 2024-09-17T18:16:19.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090176149999999997 2024-09-17T18:16:19.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.349268+0000", 2024-09-17T18:16:19.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1420000000000001e-05 2024-09-17T18:16:19.671 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.671 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.671 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.672 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:772 3.6s0 3:66d3fbbd:::smithi15432074-29:head [append 0~688128] snapc 1c=[1c,19,18,17,16,15,13,11,10,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T18:16:19.672 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:11.365678+0000", 2024-09-17T18:16:19.672 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2298218970000008, 2024-09-17T18:16:19.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094427820000000003, 2024-09-17T18:16:19.672 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.672 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.672 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:19.672 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:19.672 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:19.672 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:19.672 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 772 2024-09-17T18:16:19.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.673 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.365678+0000", 2024-09-17T18:16:19.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.365678+0000", 2024-09-17T18:16:19.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.365680+0000", 2024-09-17T18:16:19.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.517e-06 2024-09-17T18:16:19.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.366836+0000", 2024-09-17T18:16:19.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011555370000000001 2024-09-17T18:16:19.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.366848+0000", 2024-09-17T18:16:19.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2359e-05 2024-09-17T18:16:19.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.366856+0000", 2024-09-17T18:16:19.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5599999999999994e-06 2024-09-17T18:16:19.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.366916+0000", 2024-09-17T18:16:19.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9624999999999999e-05 2024-09-17T18:16:19.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:19.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.367008+0000", 2024-09-17T18:16:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2008000000000004e-05 2024-09-17T18:16:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.368127+0000", 2024-09-17T18:16:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011192660000000001 2024-09-17T18:16:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.370416+0000", 2024-09-17T18:16:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022884279999999999 2024-09-17T18:16:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.375009+0000", 2024-09-17T18:16:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045928380000000001 2024-09-17T18:16:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.375121+0000", 2024-09-17T18:16:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000112644 2024-09-17T18:16:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.678 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:775 3.6s0 3:66d3fbbd:::smithi15432074-29:head [append 0~360448] snapc 1c=[1c,19,18,17,16,15,13,11,10,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T18:16:19.678 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:11.383607+0000", 2024-09-17T18:16:19.678 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2118929279999993, 2024-09-17T18:16:19.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014587482000000001, 2024-09-17T18:16:19.678 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.678 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.678 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:19.678 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:19.678 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:19.678 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:19.678 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 775 2024-09-17T18:16:19.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.679 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.383607+0000", 2024-09-17T18:16:19.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.383607+0000", 2024-09-17T18:16:19.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.383608+0000", 2024-09-17T18:16:19.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1600000000000001e-07 2024-09-17T18:16:19.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.383994+0000", 2024-09-17T18:16:19.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000385666 2024-09-17T18:16:19.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384002+0000", 2024-09-17T18:16:19.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1030000000000002e-06 2024-09-17T18:16:19.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384010+0000", 2024-09-17T18:16:19.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.644e-06 2024-09-17T18:16:19.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384057+0000", 2024-09-17T18:16:19.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7253999999999999e-05 2024-09-17T18:16:19.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:19.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384150+0000", 2024-09-17T18:16:19.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3200000000000002e-05 2024-09-17T18:16:19.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:19.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384894+0000", 2024-09-17T18:16:19.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00074393699999999996 2024-09-17T18:16:19.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:19.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.386347+0000", 2024-09-17T18:16:19.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001452781 2024-09-17T18:16:19.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:19.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.398089+0000", 2024-09-17T18:16:19.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011742107999999999 2024-09-17T18:16:19.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.398195+0000", 2024-09-17T18:16:19.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000106073 2024-09-17T18:16:19.683 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.684 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.684 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.684 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:776 3.6s0 3:66d3fbbd:::smithi15432074-29:head [setxattr _header (57) in=7b] snapc 1c=[1c,19,18,17,16,15,13,11,10,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T18:16:19.684 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:11.384022+0000", 2024-09-17T18:16:19.684 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2114781109999999, 2024-09-17T18:16:19.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014671544, 2024-09-17T18:16:19.684 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.684 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.684 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:19.684 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:19.684 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:19.685 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:19.685 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 776 2024-09-17T18:16:19.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.685 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384022+0000", 2024-09-17T18:16:19.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384022+0000", 2024-09-17T18:16:19.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384023+0000", 2024-09-17T18:16:19.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-17T18:16:19.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384028+0000", 2024-09-17T18:16:19.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9509999999999997e-06 2024-09-17T18:16:19.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384032+0000", 2024-09-17T18:16:19.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.51e-06 2024-09-17T18:16:19.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384044+0000", 2024-09-17T18:16:19.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2118e-05 2024-09-17T18:16:19.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.385459+0000", 2024-09-17T18:16:19.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001415026 2024-09-17T18:16:19.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:19.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.385558+0000", 2024-09-17T18:16:19.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8709000000000006e-05 2024-09-17T18:16:19.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:19.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.386038+0000", 2024-09-17T18:16:19.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00047938899999999999 2024-09-17T18:16:19.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:19.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.387057+0000", 2024-09-17T18:16:19.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010196269999999999 2024-09-17T18:16:19.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:19.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.398420+0000", 2024-09-17T18:16:19.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011362993 2024-09-17T18:16:19.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.398694+0000", 2024-09-17T18:16:19.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000273632 2024-09-17T18:16:19.689 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.689 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.690 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.690 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:777 3.6s0 3:66d3fbbd:::smithi15432074-29:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-09-17T18:16:19.690 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:11.384054+0000", 2024-09-17T18:16:19.690 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2114467700000002, 2024-09-17T18:16:19.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016440097000000001, 2024-09-17T18:16:19.690 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.690 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.690 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:16:19.690 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:19.690 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:19.690 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:19.690 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 777 2024-09-17T18:16:19.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.691 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384054+0000", 2024-09-17T18:16:19.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384054+0000", 2024-09-17T18:16:19.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384054+0000", 2024-09-17T18:16:19.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4899999999999995e-07 2024-09-17T18:16:19.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384057+0000", 2024-09-17T18:16:19.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4449999999999999e-06 2024-09-17T18:16:19.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384063+0000", 2024-09-17T18:16:19.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7549999999999997e-06 2024-09-17T18:16:19.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.384067+0000", 2024-09-17T18:16:19.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.585e-06 2024-09-17T18:16:19.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.386523+0000", 2024-09-17T18:16:19.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0024560110000000001 2024-09-17T18:16:19.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:19.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.386588+0000", 2024-09-17T18:16:19.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5017000000000004e-05 2024-09-17T18:16:19.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.399539+0000", 2024-09-17T18:16:19.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012951335 2024-09-17T18:16:19.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:19.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.399632+0000", 2024-09-17T18:16:19.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2893000000000007e-05 2024-09-17T18:16:19.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.400494+0000", 2024-09-17T18:16:19.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086140700000000001 2024-09-17T18:16:19.695 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.695 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.695 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.696 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:874 3.6s0 3:6126409b:::smithi15432074-43:head [read 0~2048000,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-17T18:16:19.696 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:15.497692+0000", 2024-09-17T18:16:19.696 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.0978082420000002, 2024-09-17T18:16:19.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020394925000000001, 2024-09-17T18:16:19.696 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.696 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.696 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:16:19.696 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:19.696 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:19.696 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:19.697 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 874 2024-09-17T18:16:19.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.697 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497692+0000", 2024-09-17T18:16:19.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497692+0000", 2024-09-17T18:16:19.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497696+0000", 2024-09-17T18:16:19.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1160000000000001e-06 2024-09-17T18:16:19.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497713+0000", 2024-09-17T18:16:19.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6685999999999999e-05 2024-09-17T18:16:19.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497761+0000", 2024-09-17T18:16:19.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8063999999999999e-05 2024-09-17T18:16:19.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497779+0000", 2024-09-17T18:16:19.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7546000000000001e-05 2024-09-17T18:16:19.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497963+0000", 2024-09-17T18:16:19.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00018432799999999999 2024-09-17T18:16:19.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-17T18:16:19.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497976+0000", 2024-09-17T18:16:19.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3319000000000001e-05 2024-09-17T18:16:19.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.507633+0000", 2024-09-17T18:16:19.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0096572059999999998 2024-09-17T18:16:19.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:19.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.507891+0000", 2024-09-17T18:16:19.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00025721799999999998 2024-09-17T18:16:19.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.518087+0000", 2024-09-17T18:16:19.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010196442 2024-09-17T18:16:19.701 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.701 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.701 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.702 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:875 3.6s0 3:6126409b:::smithi15432074-43:head [read 0~2048000,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-17T18:16:19.702 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:15.497839+0000", 2024-09-17T18:16:19.702 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.0976616090000002, 2024-09-17T18:16:19.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022129914000000001, 2024-09-17T18:16:19.702 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.702 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.702 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:16:19.702 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:19.702 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:19.702 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:19.702 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 875 2024-09-17T18:16:19.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.703 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497839+0000", 2024-09-17T18:16:19.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497839+0000", 2024-09-17T18:16:19.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497840+0000", 2024-09-17T18:16:19.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.573e-06 2024-09-17T18:16:19.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497850+0000", 2024-09-17T18:16:19.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0159e-05 2024-09-17T18:16:19.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497874+0000", 2024-09-17T18:16:19.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3272999999999999e-05 2024-09-17T18:16:19.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497891+0000", 2024-09-17T18:16:19.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6909e-05 2024-09-17T18:16:19.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.498130+0000", 2024-09-17T18:16:19.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000239762 2024-09-17T18:16:19.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:19.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.498149+0000", 2024-09-17T18:16:19.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8329e-05 2024-09-17T18:16:19.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.508880+0000", 2024-09-17T18:16:19.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010731683000000001 2024-09-17T18:16:19.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:19.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.509079+0000", 2024-09-17T18:16:19.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00019905500000000001 2024-09-17T18:16:19.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.519969+0000", 2024-09-17T18:16:19.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010889171 2024-09-17T18:16:19.707 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.707 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.707 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.707 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:876 3.6s0 3:6126409b:::smithi15432074-43:head [read 0~2048000,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-17T18:16:19.707 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:15.497919+0000", 2024-09-17T18:16:19.707 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.0975814560000003, 2024-09-17T18:16:19.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023675983000000001, 2024-09-17T18:16:19.707 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:19.707 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:19.708 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:16:19.708 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:19.708 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:19.708 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:19.708 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 876 2024-09-17T18:16:19.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.708 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:19.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:19.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497919+0000", 2024-09-17T18:16:19.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:19.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497919+0000", 2024-09-17T18:16:19.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:19.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:19.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497920+0000", 2024-09-17T18:16:19.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.24e-06 2024-09-17T18:16:19.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:19.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497929+0000", 2024-09-17T18:16:19.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3149999999999998e-06 2024-09-17T18:16:19.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:19.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497945+0000", 2024-09-17T18:16:19.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5967000000000001e-05 2024-09-17T18:16:19.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:19.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.497954+0000", 2024-09-17T18:16:19.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0019999999999995e-06 2024-09-17T18:16:19.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.498468+0000", 2024-09-17T18:16:19.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00051338299999999996 2024-09-17T18:16:19.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:19.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.498482+0000", 2024-09-17T18:16:19.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4266e-05 2024-09-17T18:16:19.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:19.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.509958+0000", 2024-09-17T18:16:19.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011475558 2024-09-17T18:16:19.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:19.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.510062+0000", 2024-09-17T18:16:19.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104505 2024-09-17T18:16:19.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:19.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:19.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:19.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.521595+0000", 2024-09-17T18:16:19.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011532746999999999 2024-09-17T18:16:19.712 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.712 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.712 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.712 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:19.713 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:19.713 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:19.714 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T18:16:19.715 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:16:19.715 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:16:19.715 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:16:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:16:19.716 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:16:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:16:19.716 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:16:19.717 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:16:19.717 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:19.709+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:19.729 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:16:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:16:19.750 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:16:19.750 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:16:19.771 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:16:19.771 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:16:19.792 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:16:19.793 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:16:19.810 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:16:19.810 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:16:19.815 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:19.810+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:19.837 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:16:19.837 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:16:19.844 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:16:19.845 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:16:19.856 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-17T18:16:19.514221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":153453107,"num_objects":143,"num_object_clones":89,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":8,"num_read":488,"num_read_kb":175572,"num_write":935,"num_write_kb":167538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":46055424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1730,"ondisk_log_size":1730,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":813980,"kb_used_data":295452,"kb_used_omap":24,"kb_used_meta":518119,"kb_avail":1509135460,"statfs":{"total":1546188226560,"available":1545354711040,"internally_reserved":0,"allocated":302542848,"data_stored":412847524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":530553937},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19742720,"num_objects":-3,"num_object_clones":-4,"num_object_copies":-21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3,"num_whiteouts":-1,"num_read":50,"num_read_kb":71749,"num_write":75,"num_write_kb":24976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":46055424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001156"},"pg_stats":[{"pgid":"3.f","version":"80'38","reported_seq":290,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T18:16:17.508908+0000","last_change":"2024-09-17T18:16:15.520310+0000","last_active":"2024-09-17T18:16:17.508908+0000","last_peered":"2024-09-17T18:16:17.508908+0000","last_clean":"2024-09-17T18:16:17.508908+0000","last_became_active":"2024-09-17T18:15:28.090920+0000","last_became_peered":"2024-09-17T18:15:28.090920+0000","last_unstale":"2024-09-17T18:16:17.508908+0000","last_undegraded":"2024-09-17T18:16:17.508908+0000","last_fullsized":"2024-09-17T18:16:17.508908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:42.619980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023832435999999999,"stat_sum":{"num_bytes":9879552,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":26814,"num_write":18,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3,15,14,2,11,0],"acting":[13,3,15,14,2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"5","length":"2"},{"start":"10","length":"1"},{"start":"13","length":"2"},{"start":"19","length":"3"}]},{"pgid":"3.e","version":"82'36","reported_seq":282,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T18:16:17.503636+0000","last_change":"2024-09-17T18:16:15.516221+0000","last_active":"2024-09-17T18:16:17.503636+0000","last_peered":"2024-09-17T18:16:17.503636+0000","last_clean":"2024-09-17T18:16:17.503636+0000","last_became_active":"2024-09-17T18:15:28.110648+0000","last_became_peered":"2024-09-17T18:15:28.110648+0000","last_unstale":"2024-09-17T18:16:17.503636+0000","last_undegraded":"2024-09-17T18:16:17.503636+0000","last_fullsized":"2024-09-17T18:16:17.503636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:31.140934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020079070000000001,"stat_sum":{"num_bytes":1982464,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":14,"num_read_kb":946,"num_write":30,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14,6,13,8,3,12],"acting":[11,14,6,13,8,3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"5","length":"2"},{"start":"10","length":"1"},{"start":"13","length":"2"},{"start":"19","length":"3"}]},{"pgid":"3.d","version":"81'302","reported_seq":600,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-09-17T18:16:17.266183+0000","last_change":"2024-09-17T18:16:17.538516+0000","last_active":"2024-09-17T18:16:17.538516+0000","last_peered":"2024-09-17T18:16:17.266183+0000","last_clean":"2024-09-17T18:16:13.978648+0000","last_became_active":"2024-09-17T18:16:16.936100+0000","last_became_peered":"2024-09-17T18:16:16.936100+0000","last_unstale":"2024-09-17T18:16:17.266183+0000","last_undegraded":"2024-09-17T18:16:17.266183+0000","last_fullsized":"2024-09-17T18:16:16.494572+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038972917000000003,"stat_sum":{"num_bytes":33341440,"num_objects":31,"num_object_clones":22,"num_object_copies":217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":95,"num_read_kb":35863,"num_write":178,"num_write_kb":35056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":46055424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,3,15,9,12,4],"acting":[10,1,3,15,9,12,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"5","length":"1"},{"start":"13","length":"2"},{"start":"19","length":"3"}]},{"pgid":"3.c","version":"80'102","reported_seq":335,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T18:16:16.917311+0000","last_change":"2024-09-17T18:16:15.547701+0000","last_active":"2024-09-17T18:16:16.917311+0000","last_peered":"2024-09-17T18:16:16.917311+0000","last_clean":"2024-09-17T18:16:16.917311+0000","last_became_active":"2024-09-17T18:15:28.112093+0000","last_became_peered":"2024-09-17T18:15:28.112093+0000","last_unstale":"2024-09-17T18:16:16.917311+0000","last_undegraded":"2024-09-17T18:16:16.917311+0000","last_fullsized":"2024-09-17T18:16:16.917311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:50.035017+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.049478332,"stat_sum":{"num_bytes":4096000,"num_objects":7,"num_object_clones":3,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":20,"num_read_kb":7966,"num_write":29,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,3,7,12,14],"acting":[5,8,13,3,7,12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"2"},{"start":"10","length":"1"},{"start":"13","length":"2"},{"start":"19","length":"3"}]},{"pgid":"3.b","version":"80'164","reported_seq":387,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T18:16:18.327555+0000","last_change":"2024-09-17T18:16:15.538821+0000","last_active":"2024-09-17T18:16:18.327555+0000","last_peered":"2024-09-17T18:16:18.327555+0000","last_clean":"2024-09-17T18:16:18.327555+0000","last_became_active":"2024-09-17T18:15:28.111526+0000","last_became_peered":"2024-09-17T18:15:28.111526+0000","last_unstale":"2024-09-17T18:16:18.327555+0000","last_undegraded":"2024-09-17T18:16:18.327555+0000","last_fullsized":"2024-09-17T18:16:18.327555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.936115+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.040236372999999999,"stat_sum":{"num_bytes":16564224,"num_objects":13,"num_object_clones":8,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":1,"num_read":21,"num_read_kb":12,"num_write":115,"num_write_kb":17248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,10,12,11,1,14],"acting":[4,0,10,12,11,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"1"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.a","version":"80'222","reported_seq":450,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T18:16:17.508421+0000","last_change":"2024-09-17T18:16:15.546192+0000","last_active":"2024-09-17T18:16:17.508421+0000","last_peered":"2024-09-17T18:16:17.508421+0000","last_clean":"2024-09-17T18:16:17.508421+0000","last_became_active":"2024-09-17T18:15:28.089449+0000","last_became_peered":"2024-09-17T18:15:28.089449+0000","last_unstale":"2024-09-17T18:16:17.508421+0000","last_undegraded":"2024-09-17T18:16:17.508421+0000","last_fullsized":"2024-09-17T18:16:17.508421+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:36.699886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.050285622000000002,"stat_sum":{"num_bytes":15597568,"num_objects":16,"num_object_clones":11,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":1,"num_read":50,"num_read_kb":24861,"num_write":59,"num_write_kb":16032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,6,5,3,15,4],"acting":[13,1,6,5,3,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"5","length":"2"},{"start":"10","length":"1"},{"start":"13","length":"2"},{"start":"19","length":"3"}]},{"pgid":"3.9","version":"80'172","reported_seq":402,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T18:16:18.355495+0000","last_change":"2024-09-17T18:16:15.531157+0000","last_active":"2024-09-17T18:16:18.355495+0000","last_peered":"2024-09-17T18:16:18.355495+0000","last_clean":"2024-09-17T18:16:18.355495+0000","last_became_active":"2024-09-17T18:15:28.095114+0000","last_became_peered":"2024-09-17T18:15:28.095114+0000","last_unstale":"2024-09-17T18:16:18.355495+0000","last_undegraded":"2024-09-17T18:16:18.355495+0000","last_fullsized":"2024-09-17T18:16:18.355495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:35.772143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033651065000000001,"stat_sum":{"num_bytes":12615680,"num_objects":12,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":27,"num_read_kb":5061,"num_write":74,"num_write_kb":14144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,10,11,5,8,3],"acting":[7,2,10,11,5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.8","version":"82'98","reported_seq":329,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T18:16:18.332826+0000","last_change":"2024-09-17T18:16:15.523489+0000","last_active":"2024-09-17T18:16:18.332826+0000","last_peered":"2024-09-17T18:16:18.332826+0000","last_clean":"2024-09-17T18:16:18.332826+0000","last_became_active":"2024-09-17T18:15:28.088066+0000","last_became_peered":"2024-09-17T18:15:28.088066+0000","last_unstale":"2024-09-17T18:16:18.332826+0000","last_undegraded":"2024-09-17T18:16:18.332826+0000","last_fullsized":"2024-09-17T18:16:18.332826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:53.587691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022360039000000002,"stat_sum":{"num_bytes":9584640,"num_objects":8,"num_object_clones":5,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":11,"num_read_kb":8,"num_write":33,"num_write_kb":10016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,11,3,15,1,7],"acting":[6,0,11,3,15,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"6","length":"1"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"19","length":"1"}]},{"pgid":"1.0","version":"25'112","reported_seq":262,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T18:16:18.332961+0000","last_change":"2024-09-17T18:15:13.924291+0000","last_active":"2024-09-17T18:16:18.332961+0000","last_peered":"2024-09-17T18:16:18.332961+0000","last_clean":"2024-09-17T18:16:18.332961+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:16:18.332961+0000","last_undegraded":"2024-09-17T18:16:18.332961+0000","last_fullsized":"2024-09-17T18:16:18.332961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:15:12.533086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.379235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":131,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T18:16:18.321335+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:16:18.321335+0000","last_peered":"2024-09-17T18:16:18.321335+0000","last_clean":"2024-09-17T18:16:18.321335+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:16:18.321335+0000","last_undegraded":"2024-09-17T18:16:18.321335+0000","last_fullsized":"2024-09-17T18:16:18.321335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"80'73","reported_seq":312,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T18:16:18.321523+0000","last_change":"2024-09-17T18:16:15.510331+0000","last_active":"2024-09-17T18:16:18.321523+0000","last_peered":"2024-09-17T18:16:18.321523+0000","last_clean":"2024-09-17T18:16:18.321523+0000","last_became_active":"2024-09-17T18:15:28.089102+0000","last_became_peered":"2024-09-17T18:15:28.089102+0000","last_unstale":"2024-09-17T18:16:18.321523+0000","last_undegraded":"2024-09-17T18:16:18.321523+0000","last_fullsized":"2024-09-17T18:16:18.321523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.704299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020238094000000002,"stat_sum":{"num_bytes":6504448,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":115,"num_write":36,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3,13,1,5,10,7],"acting":[14,3,13,1,5,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"6","length":"1"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T18:16:16.509764+0000","last_change":"2024-09-17T18:15:16.990099+0000","last_active":"2024-09-17T18:16:16.509764+0000","last_peered":"2024-09-17T18:16:16.509764+0000","last_clean":"2024-09-17T18:16:16.509764+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:16:16.509764+0000","last_undegraded":"2024-09-17T18:16:16.509764+0000","last_fullsized":"2024-09-17T18:16:16.509764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.933228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":238,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T18:16:18.327308+0000","last_change":"2024-09-17T18:16:15.500057+0000","last_active":"2024-09-17T18:16:18.327308+0000","last_peered":"2024-09-17T18:16:18.327308+0000","last_clean":"2024-09-17T18:16:18.327308+0000","last_became_active":"2024-09-17T18:15:28.094455+0000","last_became_peered":"2024-09-17T18:15:28.094455+0000","last_unstale":"2024-09-17T18:16:18.327308+0000","last_undegraded":"2024-09-17T18:16:18.327308+0000","last_fullsized":"2024-09-17T18:16:18.327308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:28.639802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016038630000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,14,10,7,3,2],"acting":[4,13,14,10,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"1"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T18:16:18.320707+0000","last_change":"2024-09-17T18:15:17.499886+0000","last_active":"2024-09-17T18:16:18.320707+0000","last_peered":"2024-09-17T18:16:18.320707+0000","last_clean":"2024-09-17T18:16:18.320707+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:16:18.320707+0000","last_undegraded":"2024-09-17T18:16:18.320707+0000","last_fullsized":"2024-09-17T18:16:18.320707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.366017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"80'65","reported_seq":315,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T18:16:18.328735+0000","last_change":"2024-09-17T18:16:15.535921+0000","last_active":"2024-09-17T18:16:18.328735+0000","last_peered":"2024-09-17T18:16:18.328735+0000","last_clean":"2024-09-17T18:16:18.328735+0000","last_became_active":"2024-09-17T18:15:28.273637+0000","last_became_peered":"2024-09-17T18:15:28.273637+0000","last_unstale":"2024-09-17T18:16:18.328735+0000","last_undegraded":"2024-09-17T18:16:18.328735+0000","last_fullsized":"2024-09-17T18:16:18.328735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:53.286146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036443149000000001,"stat_sum":{"num_bytes":9797632,"num_objects":6,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":32071,"num_write":26,"num_write_kb":11424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,9,2,6,15,4],"acting":[3,7,9,2,6,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"6","length":"1"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":131,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T18:16:17.508393+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:16:17.508393+0000","last_peered":"2024-09-17T18:16:17.508393+0000","last_clean":"2024-09-17T18:16:17.508393+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:16:17.508393+0000","last_undegraded":"2024-09-17T18:16:17.508393+0000","last_fullsized":"2024-09-17T18:16:17.508393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:19.851941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"81'59","reported_seq":308,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T18:16:17.502939+0000","last_change":"2024-09-17T18:16:15.524258+0000","last_active":"2024-09-17T18:16:17.502939+0000","last_peered":"2024-09-17T18:16:17.502939+0000","last_clean":"2024-09-17T18:16:17.502939+0000","last_became_active":"2024-09-17T18:15:28.272974+0000","last_became_peered":"2024-09-17T18:15:28.272974+0000","last_unstale":"2024-09-17T18:16:17.502939+0000","last_undegraded":"2024-09-17T18:16:17.502939+0000","last_fullsized":"2024-09-17T18:16:17.502939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:47.370125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030770100000000002,"stat_sum":{"num_bytes":10698752,"num_objects":6,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":9399,"num_write":18,"num_write_kb":10448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4,13,11,2,5],"acting":[10,9,4,13,11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"5","length":"2"},{"start":"10","length":"1"},{"start":"13","length":"2"},{"start":"19","length":"3"}]},{"pgid":"3.5","version":"80'54","reported_seq":298,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T18:16:16.917446+0000","last_change":"2024-09-17T18:16:15.525259+0000","last_active":"2024-09-17T18:16:16.917446+0000","last_peered":"2024-09-17T18:16:16.917446+0000","last_clean":"2024-09-17T18:16:16.917446+0000","last_became_active":"2024-09-17T18:15:28.275306+0000","last_became_peered":"2024-09-17T18:15:28.275306+0000","last_unstale":"2024-09-17T18:16:16.917446+0000","last_undegraded":"2024-09-17T18:16:16.917446+0000","last_fullsized":"2024-09-17T18:16:16.917446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:45.830372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025664132999999999,"stat_sum":{"num_bytes":6914048,"num_objects":3,"num_object_clones":2,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":8243,"num_write":33,"num_write_kb":8560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,11],"acting":[5,8,4,9,12,0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"2"},{"start":"10","length":"1"},{"start":"13","length":"2"},{"start":"19","length":"3"}]},{"pgid":"2.4","version":"0'0","reported_seq":129,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T18:16:18.326923+0000","last_change":"2024-09-17T18:15:16.605178+0000","last_active":"2024-09-17T18:16:18.326923+0000","last_peered":"2024-09-17T18:16:18.326923+0000","last_clean":"2024-09-17T18:16:18.326923+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:16:18.326923+0000","last_undegraded":"2024-09-17T18:16:18.326923+0000","last_fullsized":"2024-09-17T18:16:18.326923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:20.443841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":239,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T18:16:17.510192+0000","last_change":"2024-09-17T18:16:15.511247+0000","last_active":"2024-09-17T18:16:17.510192+0000","last_peered":"2024-09-17T18:16:17.510192+0000","last_clean":"2024-09-17T18:16:17.510192+0000","last_became_active":"2024-09-17T18:15:28.090551+0000","last_became_peered":"2024-09-17T18:15:28.090551+0000","last_unstale":"2024-09-17T18:16:17.510192+0000","last_undegraded":"2024-09-17T18:16:17.510192+0000","last_fullsized":"2024-09-17T18:16:17.510192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:51.971636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090209000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15,4,2,6,10,7],"acting":[8,15,4,2,6,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"5","length":"2"},{"start":"10","length":"1"},{"start":"13","length":"2"},{"start":"19","length":"3"}]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T18:16:18.354348+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:16:18.354348+0000","last_peered":"2024-09-17T18:16:18.354348+0000","last_clean":"2024-09-17T18:16:18.354348+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:16:18.354348+0000","last_undegraded":"2024-09-17T18:16:18.354348+0000","last_fullsized":"2024-09-17T18:16:18.354348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:15.290413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"82'132","reported_seq":379,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T18:16:18.327067+0000","last_change":"2024-09-17T18:16:15.545767+0000","last_active":"2024-09-17T18:16:18.327067+0000","last_peered":"2024-09-17T18:16:18.327067+0000","last_clean":"2024-09-17T18:16:18.327067+0000","last_became_active":"2024-09-17T18:15:27.692814+0000","last_became_peered":"2024-09-17T18:15:27.692814+0000","last_unstale":"2024-09-17T18:16:18.327067+0000","last_undegraded":"2024-09-17T18:16:18.327067+0000","last_fullsized":"2024-09-17T18:16:18.327067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:50.920434+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.043116789000000003,"stat_sum":{"num_bytes":6144000,"num_objects":13,"num_object_clones":8,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":1,"num_read":46,"num_read_kb":10979,"num_write":108,"num_write_kb":7264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,0,14,10,13],"acting":[4,11,6,0,14,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"1"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":129,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T18:16:17.510936+0000","last_change":"2024-09-17T18:15:17.502621+0000","last_active":"2024-09-17T18:16:17.510936+0000","last_peered":"2024-09-17T18:16:17.510936+0000","last_clean":"2024-09-17T18:16:17.510936+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:16:17.510936+0000","last_undegraded":"2024-09-17T18:16:17.510936+0000","last_fullsized":"2024-09-17T18:16:17.510936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.990534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"80'98","reported_seq":331,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-17T18:16:15.534849+0000","last_change":"2024-09-17T18:16:15.536041+0000","last_active":"2024-09-17T18:16:15.534849+0000","last_peered":"2024-09-17T18:16:15.534849+0000","last_clean":"2024-09-17T18:16:15.534849+0000","last_became_active":"2024-09-17T18:15:28.272963+0000","last_became_peered":"2024-09-17T18:15:28.272963+0000","last_unstale":"2024-09-17T18:16:15.534849+0000","last_undegraded":"2024-09-17T18:16:15.534849+0000","last_fullsized":"2024-09-17T18:16:15.534849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:47.450606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028705436000000001,"stat_sum":{"num_bytes":9142272,"num_objects":10,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":24,"num_read_kb":13161,"num_write":31,"num_write_kb":8928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14,6,2,5,9,15],"acting":[0,14,6,2,5,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"5","length":"2"},{"start":"10","length":"1"},{"start":"13","length":"2"},{"start":"19","length":"3"}]},{"pgid":"2.7","version":"0'0","reported_seq":129,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T18:16:17.509363+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:16:17.509363+0000","last_peered":"2024-09-17T18:16:17.509363+0000","last_clean":"2024-09-17T18:16:17.509363+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:16:17.509363+0000","last_undegraded":"2024-09-17T18:16:17.509363+0000","last_fullsized":"2024-09-17T18:16:17.509363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":152862720,"num_objects":139,"num_object_clones":89,"num_object_copies":973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":8,"num_read":402,"num_read_kb":175499,"num_write":788,"num_write_kb":164864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":46055424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296730624,"data_stored":414273536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1615,"ondisk_log_size":1615,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247825,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54040,"kb_used_data":22844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94317800,"statfs":{"total":96636764160,"available":96581427200,"internally_reserved":0,"allocated":23392256,"data_stored":34660306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247825,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45600,"kb_used_data":14412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326240,"statfs":{"total":96636764160,"available":96590069760,"internally_reserved":0,"allocated":14757888,"data_stored":19176882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280529,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47416,"kb_used_data":20384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94324424,"statfs":{"total":96636764160,"available":96588210176,"internally_reserved":0,"allocated":20873216,"data_stored":22750416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313233,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45932,"kb_used_data":14740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94325908,"statfs":{"total":96636764160,"available":96589729792,"internally_reserved":0,"allocated":15093760,"data_stored":20290526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280529,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51728,"kb_used_data":20536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94320112,"statfs":{"total":96636764160,"available":96583794688,"internally_reserved":0,"allocated":21028864,"data_stored":28730576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313233,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43208,"kb_used_data":16180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94328632,"statfs":{"total":96636764160,"available":96592519168,"internally_reserved":0,"allocated":16568320,"data_stored":24280030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280527,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48176,"kb_used_data":16984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94323664,"statfs":{"total":96636764160,"available":96587431936,"internally_reserved":0,"allocated":17391616,"data_stored":23127229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,3,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280528,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39736,"kb_used_data":12708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94332104,"statfs":{"total":96636764160,"available":96596074496,"internally_reserved":0,"allocated":13012992,"data_stored":16923614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,4,5,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313232,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75276,"kb_used_data":26040,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94296564,"statfs":{"total":96636764160,"available":96559681536,"internally_reserved":0,"allocated":26664960,"data_stored":36287677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280528,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52116,"kb_used_data":20920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94319724,"statfs":{"total":96636764160,"available":96583397376,"internally_reserved":0,"allocated":21422080,"data_stored":30547378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280528,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40880,"kb_used_data":13848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330960,"statfs":{"total":96636764160,"available":96594903040,"internally_reserved":0,"allocated":14180352,"data_stored":19621053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247823,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61312,"kb_used_data":30116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94310528,"statfs":{"total":96636764160,"available":96573980672,"internally_reserved":0,"allocated":30838784,"data_stored":38612402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247825,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74428,"kb_used_data":25192,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94297412,"statfs":{"total":96636764160,"available":96560549888,"internally_reserved":0,"allocated":25796608,"data_stored":36908466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247825,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45488,"kb_used_data":14292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326352,"statfs":{"total":96636764160,"available":96590184448,"internally_reserved":0,"allocated":14635008,"data_stored":23607594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247824,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42724,"kb_used_data":11528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329116,"statfs":{"total":96636764160,"available":96593014784,"internally_reserved":0,"allocated":11804672,"data_stored":16780722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280527,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45920,"kb_used_data":14728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94325920,"statfs":{"total":96636764160,"available":96589742080,"internally_reserved":0,"allocated":15081472,"data_stored":20542653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13946880,"data_stored":19632128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20152320,"data_stored":28676096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13017088,"data_stored":18952192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28467200,"data_stored":36741120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24526848,"data_stored":35192832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16228352,"data_stored":22458368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":22388736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10625024,"data_stored":16101376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":13918208,"data_stored":19873792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":15421440,"data_stored":23621632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":25432064,"data_stored":29831168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":26103808,"data_stored":36229120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":19705856,"data_stored":22081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":21110784,"data_stored":29310976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":13578240,"data_stored":19709952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":21590016,"data_stored":33472512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:16:19.857 INFO:tasks.ceph.ceph_manager.ceph:too many creating 2024-09-17T18:16:19.859 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:19.859 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:16:19.859 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-17T18:16:19.859 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:19.866 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:16:19.866 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:16:19.873 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T18:16:19.887 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:16:19.887 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:16:19.916 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:16:19.914+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:16:20.001 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:20.001 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:16:20.001 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-17T18:16:20.001 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-17T18:16:20.002 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:20.015 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T18:16:20.017 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:20.013+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:20.118 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:20.113+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:20.133 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:20.133 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-17T18:16:20.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-17T18:16:20.134 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-17T18:16:20.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.134 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:343 3.7s0 3:ef12b1fb:::smithi15432074-35:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:20.134 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763631+0000", 2024-09-17T18:16:20.134 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.367370516999998, 2024-09-17T18:16:20.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028740952, 2024-09-17T18:16:20.134 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.134 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.134 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.134 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.134 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.134 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.134 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 343 2024-09-17T18:16:20.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.135 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763631+0000", 2024-09-17T18:16:20.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763631+0000", 2024-09-17T18:16:20.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763634+0000", 2024-09-17T18:16:20.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8700000000000001e-06 2024-09-17T18:16:20.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763644+0000", 2024-09-17T18:16:20.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4800000000000007e-06 2024-09-17T18:16:20.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763670+0000", 2024-09-17T18:16:20.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6499000000000002e-05 2024-09-17T18:16:20.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763684+0000", 2024-09-17T18:16:20.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.342e-05 2024-09-17T18:16:20.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763779+0000", 2024-09-17T18:16:20.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5001999999999996e-05 2024-09-17T18:16:20.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-17T18:16:20.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763788+0000", 2024-09-17T18:16:20.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4490000000000005e-06 2024-09-17T18:16:20.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.768186+0000", 2024-09-17T18:16:20.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043976350000000004 2024-09-17T18:16:20.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.768335+0000", 2024-09-17T18:16:20.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014973800000000001 2024-09-17T18:16:20.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.769389+0000", 2024-09-17T18:16:20.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010536409999999999 2024-09-17T18:16:20.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778459+0000", 2024-09-17T18:16:20.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090703020000000006 2024-09-17T18:16:20.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792276+0000", 2024-09-17T18:16:20.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013816716 2024-09-17T18:16:20.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792372+0000", 2024-09-17T18:16:20.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6199999999999994e-05 2024-09-17T18:16:20.140 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.140 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.140 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.141 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:344 3.7s0 3:ef12b1fb:::smithi15432074-35:head [rollback 6] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:20.141 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763714+0000", 2024-09-17T18:16:20.141 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.367288121999998, 2024-09-17T18:16:20.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.031319132999999999, 2024-09-17T18:16:20.141 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.141 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.141 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.141 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.141 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.141 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.141 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 344 2024-09-17T18:16:20.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.142 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763714+0000", 2024-09-17T18:16:20.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763714+0000", 2024-09-17T18:16:20.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763714+0000", 2024-09-17T18:16:20.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5099999999999999e-07 2024-09-17T18:16:20.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763718+0000", 2024-09-17T18:16:20.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4970000000000001e-06 2024-09-17T18:16:20.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763729+0000", 2024-09-17T18:16:20.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0736e-05 2024-09-17T18:16:20.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763735+0000", 2024-09-17T18:16:20.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8229999999999997e-06 2024-09-17T18:16:20.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763871+0000", 2024-09-17T18:16:20.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013522100000000001 2024-09-17T18:16:20.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:20.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763876+0000", 2024-09-17T18:16:20.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.558e-06 2024-09-17T18:16:20.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.770394+0000", 2024-09-17T18:16:20.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065179189999999996 2024-09-17T18:16:20.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.770558+0000", 2024-09-17T18:16:20.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016384900000000001 2024-09-17T18:16:20.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771591+0000", 2024-09-17T18:16:20.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001033525 2024-09-17T18:16:20.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778461+0000", 2024-09-17T18:16:20.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068693390000000003 2024-09-17T18:16:20.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.794971+0000", 2024-09-17T18:16:20.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016509751 2024-09-17T18:16:20.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795033+0000", 2024-09-17T18:16:20.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2263999999999999e-05 2024-09-17T18:16:20.149 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.149 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.149 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.149 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:345 3.7s0 3:ef12b1fb:::smithi15432074-35:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:20.149 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763766+0000", 2024-09-17T18:16:20.149 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.367235962999999, 2024-09-17T18:16:20.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.031400627, 2024-09-17T18:16:20.149 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.150 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.150 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.150 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.150 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.150 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.150 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 345 2024-09-17T18:16:20.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.150 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763766+0000", 2024-09-17T18:16:20.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763766+0000", 2024-09-17T18:16:20.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763766+0000", 2024-09-17T18:16:20.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-17T18:16:20.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763780+0000", 2024-09-17T18:16:20.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3183000000000001e-05 2024-09-17T18:16:20.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763809+0000", 2024-09-17T18:16:20.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9167999999999999e-05 2024-09-17T18:16:20.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763816+0000", 2024-09-17T18:16:20.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7700000000000004e-06 2024-09-17T18:16:20.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763948+0000", 2024-09-17T18:16:20.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013241500000000001 2024-09-17T18:16:20.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:20.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763952+0000", 2024-09-17T18:16:20.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9949999999999999e-06 2024-09-17T18:16:20.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772256+0000", 2024-09-17T18:16:20.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0083035609999999992 2024-09-17T18:16:20.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772431+0000", 2024-09-17T18:16:20.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000175864 2024-09-17T18:16:20.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773218+0000", 2024-09-17T18:16:20.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00078638500000000001 2024-09-17T18:16:20.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778464+0000", 2024-09-17T18:16:20.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052463689999999999 2024-09-17T18:16:20.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795129+0000", 2024-09-17T18:16:20.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016664447999999998 2024-09-17T18:16:20.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795166+0000", 2024-09-17T18:16:20.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7880000000000003e-05 2024-09-17T18:16:20.156 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.156 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.156 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.156 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:352 3.7s0 3:e2d87ed6:::smithi15432074-32:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:20.156 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763830+0000", 2024-09-17T18:16:20.156 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.367171569, 2024-09-17T18:16:20.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.031647704999999998, 2024-09-17T18:16:20.157 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.157 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.157 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.157 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.157 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.157 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.157 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 352 2024-09-17T18:16:20.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.157 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763830+0000", 2024-09-17T18:16:20.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763830+0000", 2024-09-17T18:16:20.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763831+0000", 2024-09-17T18:16:20.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3300000000000002e-07 2024-09-17T18:16:20.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763834+0000", 2024-09-17T18:16:20.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1480000000000002e-06 2024-09-17T18:16:20.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763844+0000", 2024-09-17T18:16:20.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8740000000000007e-06 2024-09-17T18:16:20.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763861+0000", 2024-09-17T18:16:20.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7380999999999998e-05 2024-09-17T18:16:20.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763994+0000", 2024-09-17T18:16:20.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013322900000000001 2024-09-17T18:16:20.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:20.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763998+0000", 2024-09-17T18:16:20.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6770000000000001e-06 2024-09-17T18:16:20.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773657+0000", 2024-09-17T18:16:20.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0096587779999999998 2024-09-17T18:16:20.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773769+0000", 2024-09-17T18:16:20.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000112469 2024-09-17T18:16:20.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.775181+0000", 2024-09-17T18:16:20.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00141125 2024-09-17T18:16:20.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.782500+0000", 2024-09-17T18:16:20.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0073196290000000002 2024-09-17T18:16:20.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795418+0000", 2024-09-17T18:16:20.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012917699 2024-09-17T18:16:20.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795478+0000", 2024-09-17T18:16:20.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0037999999999997e-05 2024-09-17T18:16:20.163 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.163 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.163 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.163 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:353 3.7s0 3:e2d87ed6:::smithi15432074-32:head [rollback 5] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:20.163 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763899+0000", 2024-09-17T18:16:20.163 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.367102672999998, 2024-09-17T18:16:20.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.037287898, 2024-09-17T18:16:20.164 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.164 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.164 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.164 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 353 2024-09-17T18:16:20.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.164 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763899+0000", 2024-09-17T18:16:20.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763899+0000", 2024-09-17T18:16:20.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763900+0000", 2024-09-17T18:16:20.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6499999999999999e-07 2024-09-17T18:16:20.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763903+0000", 2024-09-17T18:16:20.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4089999999999999e-06 2024-09-17T18:16:20.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763915+0000", 2024-09-17T18:16:20.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1377e-05 2024-09-17T18:16:20.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763921+0000", 2024-09-17T18:16:20.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6619999999999999e-06 2024-09-17T18:16:20.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764038+0000", 2024-09-17T18:16:20.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117268 2024-09-17T18:16:20.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:20.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764045+0000", 2024-09-17T18:16:20.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2519999999999996e-06 2024-09-17T18:16:20.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776881+0000", 2024-09-17T18:16:20.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012836683999999999 2024-09-17T18:16:20.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.776973+0000", 2024-09-17T18:16:20.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1181999999999995e-05 2024-09-17T18:16:20.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.777499+0000", 2024-09-17T18:16:20.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052648199999999999 2024-09-17T18:16:20.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.782503+0000", 2024-09-17T18:16:20.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0050035330000000001 2024-09-17T18:16:20.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801117+0000", 2024-09-17T18:16:20.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018614557 2024-09-17T18:16:20.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801187+0000", 2024-09-17T18:16:20.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9926999999999996e-05 2024-09-17T18:16:20.170 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.170 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.170 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.171 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:354 3.7s0 3:e2d87ed6:::smithi15432074-32:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:20.171 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.763944+0000", 2024-09-17T18:16:20.171 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.367058147000002, 2024-09-17T18:16:20.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.037407294000000001, 2024-09-17T18:16:20.171 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.171 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.171 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.171 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.171 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.171 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.171 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 354 2024-09-17T18:16:20.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.172 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763944+0000", 2024-09-17T18:16:20.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763944+0000", 2024-09-17T18:16:20.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763944+0000", 2024-09-17T18:16:20.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0699999999999997e-07 2024-09-17T18:16:20.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763947+0000", 2024-09-17T18:16:20.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1379999999999999e-06 2024-09-17T18:16:20.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763956+0000", 2024-09-17T18:16:20.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3340000000000002e-06 2024-09-17T18:16:20.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.763962+0000", 2024-09-17T18:16:20.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9070000000000004e-06 2024-09-17T18:16:20.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764112+0000", 2024-09-17T18:16:20.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000150359 2024-09-17T18:16:20.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:20.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764120+0000", 2024-09-17T18:16:20.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9300000000000003e-06 2024-09-17T18:16:20.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778500+0000", 2024-09-17T18:16:20.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014380469 2024-09-17T18:16:20.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778584+0000", 2024-09-17T18:16:20.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3978000000000001e-05 2024-09-17T18:16:20.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.778997+0000", 2024-09-17T18:16:20.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000413075 2024-09-17T18:16:20.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.782506+0000", 2024-09-17T18:16:20.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035086150000000001 2024-09-17T18:16:20.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801311+0000", 2024-09-17T18:16:20.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018804647000000001 2024-09-17T18:16:20.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801351+0000", 2024-09-17T18:16:20.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0334999999999999e-05 2024-09-17T18:16:20.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.177 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.177 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:358 3.bs0 3:df05abfe:::smithi15432074-30:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:20.177 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.764224+0000", 2024-09-17T18:16:20.177 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.366777706000001, 2024-09-17T18:16:20.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028742235000000001, 2024-09-17T18:16:20.177 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.177 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.177 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.178 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.178 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.178 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.178 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 358 2024-09-17T18:16:20.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.178 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764224+0000", 2024-09-17T18:16:20.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764224+0000", 2024-09-17T18:16:20.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764226+0000", 2024-09-17T18:16:20.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7439999999999999e-06 2024-09-17T18:16:20.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764233+0000", 2024-09-17T18:16:20.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.294e-06 2024-09-17T18:16:20.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764251+0000", 2024-09-17T18:16:20.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8096000000000001e-05 2024-09-17T18:16:20.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764261+0000", 2024-09-17T18:16:20.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5089999999999999e-06 2024-09-17T18:16:20.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764381+0000", 2024-09-17T18:16:20.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000119911 2024-09-17T18:16:20.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-17T18:16:20.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764389+0000", 2024-09-17T18:16:20.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1489999999999994e-06 2024-09-17T18:16:20.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.770178+0000", 2024-09-17T18:16:20.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057893149999999997 2024-09-17T18:16:20.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.770354+0000", 2024-09-17T18:16:20.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017578200000000001 2024-09-17T18:16:20.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771556+0000", 2024-09-17T18:16:20.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012016399999999999 2024-09-17T18:16:20.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773874+0000", 2024-09-17T18:16:20.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023185810000000001 2024-09-17T18:16:20.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792865+0000", 2024-09-17T18:16:20.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018991340999999998 2024-09-17T18:16:20.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792966+0000", 2024-09-17T18:16:20.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010087299999999999 2024-09-17T18:16:20.183 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.183 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.183 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.184 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:359 3.bs0 3:df05abfe:::smithi15432074-30:head [rollback 4] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:20.184 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.764292+0000", 2024-09-17T18:16:20.184 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.366709780000001, 2024-09-17T18:16:20.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028870689000000001, 2024-09-17T18:16:20.184 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.184 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.184 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.184 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.184 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.184 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.184 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 359 2024-09-17T18:16:20.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.185 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764292+0000", 2024-09-17T18:16:20.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764292+0000", 2024-09-17T18:16:20.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764293+0000", 2024-09-17T18:16:20.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8000000000000004e-07 2024-09-17T18:16:20.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764299+0000", 2024-09-17T18:16:20.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0719999999999996e-06 2024-09-17T18:16:20.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764325+0000", 2024-09-17T18:16:20.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6489e-05 2024-09-17T18:16:20.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764337+0000", 2024-09-17T18:16:20.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1096e-05 2024-09-17T18:16:20.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764445+0000", 2024-09-17T18:16:20.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000108256 2024-09-17T18:16:20.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:20.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764453+0000", 2024-09-17T18:16:20.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5799999999999992e-06 2024-09-17T18:16:20.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772725+0000", 2024-09-17T18:16:20.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082712089999999999 2024-09-17T18:16:20.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772821+0000", 2024-09-17T18:16:20.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6620999999999995e-05 2024-09-17T18:16:20.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773493+0000", 2024-09-17T18:16:20.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00067135899999999995 2024-09-17T18:16:20.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781853+0000", 2024-09-17T18:16:20.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0083605039999999995 2024-09-17T18:16:20.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.793103+0000", 2024-09-17T18:16:20.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011249687 2024-09-17T18:16:20.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.793163+0000", 2024-09-17T18:16:20.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9935999999999997e-05 2024-09-17T18:16:20.190 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.190 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.190 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.190 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:360 3.bs0 3:df05abfe:::smithi15432074-30:head [append 0~0] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:20.190 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.764354+0000", 2024-09-17T18:16:20.190 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.366647823999998, 2024-09-17T18:16:20.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.030712617000000001, 2024-09-17T18:16:20.191 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.191 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.191 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.191 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.191 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.191 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.191 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 360 2024-09-17T18:16:20.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.191 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764354+0000", 2024-09-17T18:16:20.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764354+0000", 2024-09-17T18:16:20.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764355+0000", 2024-09-17T18:16:20.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1200000000000001e-07 2024-09-17T18:16:20.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764359+0000", 2024-09-17T18:16:20.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5179999999999998e-06 2024-09-17T18:16:20.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764372+0000", 2024-09-17T18:16:20.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2284e-05 2024-09-17T18:16:20.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764383+0000", 2024-09-17T18:16:20.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1687e-05 2024-09-17T18:16:20.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764511+0000", 2024-09-17T18:16:20.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012773799999999999 2024-09-17T18:16:20.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:20.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.764522+0000", 2024-09-17T18:16:20.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0898e-05 2024-09-17T18:16:20.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774059+0000", 2024-09-17T18:16:20.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0095365880000000004 2024-09-17T18:16:20.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774152+0000", 2024-09-17T18:16:20.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3352999999999999e-05 2024-09-17T18:16:20.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.774946+0000", 2024-09-17T18:16:20.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00079374800000000004 2024-09-17T18:16:20.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.781856+0000", 2024-09-17T18:16:20.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006910406 2024-09-17T18:16:20.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795004+0000", 2024-09-17T18:16:20.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01314805 2024-09-17T18:16:20.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795067+0000", 2024-09-17T18:16:20.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2434999999999994e-05 2024-09-17T18:16:20.196 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.196 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.196 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.197 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:508 3.7s0 3:ef12b1fb:::smithi15432074-35:head [copy-from ver 49] snapc 10=[10,e,d,c,b,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:20.197 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310195+0000", 2024-09-17T18:16:20.197 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.820806763, 2024-09-17T18:16:20.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.056996193000000001, 2024-09-17T18:16:20.197 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.197 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.197 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.197 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.197 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.198 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.198 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 508 2024-09-17T18:16:20.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.198 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310195+0000", 2024-09-17T18:16:20.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310195+0000", 2024-09-17T18:16:20.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310199+0000", 2024-09-17T18:16:20.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.777e-06 2024-09-17T18:16:20.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310215+0000", 2024-09-17T18:16:20.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6648999999999999e-05 2024-09-17T18:16:20.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310262+0000", 2024-09-17T18:16:20.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6885000000000003e-05 2024-09-17T18:16:20.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310286+0000", 2024-09-17T18:16:20.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4029999999999999e-05 2024-09-17T18:16:20.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310465+0000", 2024-09-17T18:16:20.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017908900000000001 2024-09-17T18:16:20.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-17T18:16:20.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310488+0000", 2024-09-17T18:16:20.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2370000000000001e-05 2024-09-17T18:16:20.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.318449+0000", 2024-09-17T18:16:20.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0079614909999999994 2024-09-17T18:16:20.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.318706+0000", 2024-09-17T18:16:20.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00025651999999999999 2024-09-17T18:16:20.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.349677+0000", 2024-09-17T18:16:20.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.030971423000000001 2024-09-17T18:16:20.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.358861+0000", 2024-09-17T18:16:20.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0091838010000000001 2024-09-17T18:16:20.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.367112+0000", 2024-09-17T18:16:20.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082507459999999998 2024-09-17T18:16:20.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.367191+0000", 2024-09-17T18:16:20.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9412000000000005e-05 2024-09-17T18:16:20.206 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.206 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.206 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.206 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:509 3.7s0 3:ef12b1fb:::smithi15432074-35:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:20.206 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310343+0000", 2024-09-17T18:16:20.206 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.820658739999999, 2024-09-17T18:16:20.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.044603753000000003, 2024-09-17T18:16:20.206 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.206 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.207 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:16:20.207 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.207 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.207 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.207 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 509 2024-09-17T18:16:20.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.207 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310343+0000", 2024-09-17T18:16:20.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310343+0000", 2024-09-17T18:16:20.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310345+0000", 2024-09-17T18:16:20.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.646e-06 2024-09-17T18:16:20.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310355+0000", 2024-09-17T18:16:20.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0094e-05 2024-09-17T18:16:20.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310377+0000", 2024-09-17T18:16:20.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2402e-05 2024-09-17T18:16:20.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310395+0000", 2024-09-17T18:16:20.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7706999999999998e-05 2024-09-17T18:16:20.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310659+0000", 2024-09-17T18:16:20.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026424 2024-09-17T18:16:20.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:20.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310678+0000", 2024-09-17T18:16:20.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8573e-05 2024-09-17T18:16:20.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320109+0000", 2024-09-17T18:16:20.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094309330000000007 2024-09-17T18:16:20.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for blocked object", 2024-09-17T18:16:20.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320251+0000", 2024-09-17T18:16:20.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014214300000000001 2024-09-17T18:16:20.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354626+0000", 2024-09-17T18:16:20.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.034374926 2024-09-17T18:16:20.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354762+0000", 2024-09-17T18:16:20.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013625900000000001 2024-09-17T18:16:20.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354947+0000", 2024-09-17T18:16:20.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00018483 2024-09-17T18:16:20.215 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.215 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.215 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.215 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:515 3.bs0 3:d6f6dcd5:::smithi15432074-7:head [copy-from ver 28] snapc 10=[10,e,d,c,b,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:20.215 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.339764+0000", 2024-09-17T18:16:20.216 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.791238032999999, 2024-09-17T18:16:20.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.055974778000000003, 2024-09-17T18:16:20.216 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.216 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.216 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.216 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.216 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.216 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.216 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 515 2024-09-17T18:16:20.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.217 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339764+0000", 2024-09-17T18:16:20.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339764+0000", 2024-09-17T18:16:20.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339767+0000", 2024-09-17T18:16:20.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.54e-06 2024-09-17T18:16:20.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339783+0000", 2024-09-17T18:16:20.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5460000000000001e-05 2024-09-17T18:16:20.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339828+0000", 2024-09-17T18:16:20.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4776e-05 2024-09-17T18:16:20.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339849+0000", 2024-09-17T18:16:20.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1319e-05 2024-09-17T18:16:20.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.339954+0000", 2024-09-17T18:16:20.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105138 2024-09-17T18:16:20.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340099+0000", 2024-09-17T18:16:20.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014509500000000001 2024-09-17T18:16:20.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.386415+0000", 2024-09-17T18:16:20.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.046316261999999997 2024-09-17T18:16:20.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.392450+0000", 2024-09-17T18:16:20.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060346050000000002 2024-09-17T18:16:20.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.395617+0000", 2024-09-17T18:16:20.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031672219999999999 2024-09-17T18:16:20.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.395739+0000", 2024-09-17T18:16:20.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012136100000000001 2024-09-17T18:16:20.223 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.223 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.224 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.224 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:516 3.bs0 3:d6f6dcd5:::smithi15432074-7:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:20.225 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.340134+0000", 2024-09-17T18:16:20.225 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.790867469999998, 2024-09-17T18:16:20.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.050807849000000002, 2024-09-17T18:16:20.225 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.225 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.225 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-17T18:16:20.225 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.225 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.225 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.225 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 516 2024-09-17T18:16:20.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.226 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340134+0000", 2024-09-17T18:16:20.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340134+0000", 2024-09-17T18:16:20.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340136+0000", 2024-09-17T18:16:20.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.951e-06 2024-09-17T18:16:20.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340145+0000", 2024-09-17T18:16:20.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4630000000000001e-06 2024-09-17T18:16:20.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340170+0000", 2024-09-17T18:16:20.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4805000000000001e-05 2024-09-17T18:16:20.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340190+0000", 2024-09-17T18:16:20.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0761999999999999e-05 2024-09-17T18:16:20.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340326+0000", 2024-09-17T18:16:20.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013571500000000001 2024-09-17T18:16:20.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for blocked object", 2024-09-17T18:16:20.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.340392+0000", 2024-09-17T18:16:20.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6311999999999998e-05 2024-09-17T18:16:20.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.390622+0000", 2024-09-17T18:16:20.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.050229577999999997 2024-09-17T18:16:20.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.390771+0000", 2024-09-17T18:16:20.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000149271 2024-09-17T18:16:20.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.390942+0000", 2024-09-17T18:16:20.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017099199999999999 2024-09-17T18:16:20.232 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.232 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.232 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.233 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:760 3.7s0 3:e2d87ed6:::smithi15432074-32:head [create,setxattr Vp`QZsifs[S]Ps]Ve\\l^ikkgcpWh[^bgZssrlk_d (277) in=40b,setxattr ttjU^kaRo[sc[nb\\geSjcf^TZilfcSPYqgo`gskb (9120) in=40b,setxattr ifTWkhtZodotiqgmafZ^STksmd`Y`afgq`Y[m (18524) in=37b,setxattr diloiOlqoSkalapWRcs\\`N]rOaWjqYts_edk^e__ (1470) in=40b,setxattr sV\\`QYTdV]i]ngU_RYX__Tq_Y_WVqf^irracU]ng (66) in=40b,setxattr gOfXTYjacYnYWjTlab (18524) in=18b,setxattr RS\\SabqhtkXqQ_glcg^oUlca`tYfTjfalokt[PfT (6736) in=40b,setxattr ]fc_fn[WqWjUqZ]U^jomWdZqhc[OSYYPci_hrSfc (18032) in=40b,setxattr ehSP[dOq[ekQ[T[VVgaTSPcXjNqapcORWXcPmVZX (593) in=40b,setxattr hsRllbSlZXp]nmh^[lit\\nfjsjjUc[gWQ_YgRaqb (1857) in=40b,setxattr tQgR\\PeljiOb_eb[bOeP\\pafWohtbgn[d`fO`TSQ (1470) in=40b,setxattr snRdWV]`innXhTdOpbRVVjSVjnbjtWmt`arq^`a` (1822) in=40b,setxattr oggspga`Oog]aiWp_NWfP (18524) in=21b,setxattr ihZTSmmf_b]WmmWrbj]Ug_OeXqlSb_kNrahPSeNi (842) in=40b,setxattr [rceos\\OUqP[gWrsPshYd`]iQe[idhee_td_XOn` (6736) in=40b,setxattr ]`QZ\\bUWpjjZfUZhcm]hj^tYeQoj_^aOWOgYYcbc (1682) in=40b,setxattr [YpiekXebfb[geeNoSsR_hNclbNj^qVmaaaRadem (1786) in=40b,setxattr g`ordk[jmUZ^UbkSscPYlZPn]Z[iQ^Xf[gk]hgZN (1226) in=40b,setxattr SiNl\\ZscQ\\ecTj\\Ue]_`XY^SWpsaYlaqoUNpYW]a (209) in=40b,setxattr \\Vqe]`ra^dgf_\\cUPONbVhboTbN[TpNna]r^ZXOo (803) in=40b] snapc 1c=[1c,1b,19,18,17,16,15,13,11,10,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-17T18:16:20.233 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.327755+0000", 2024-09-17T18:16:20.233 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.8032471050000005, 2024-09-17T18:16:20.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.030520747000000001, 2024-09-17T18:16:20.233 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.234 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.234 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.234 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.234 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.234 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.234 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 760 2024-09-17T18:16:20.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.235 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.327755+0000", 2024-09-17T18:16:20.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.327755+0000", 2024-09-17T18:16:20.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.327757+0000", 2024-09-17T18:16:20.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.491e-06 2024-09-17T18:16:20.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328635+0000", 2024-09-17T18:16:20.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00087768199999999996 2024-09-17T18:16:20.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328662+0000", 2024-09-17T18:16:20.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7233000000000002e-05 2024-09-17T18:16:20.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328675+0000", 2024-09-17T18:16:20.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2875e-05 2024-09-17T18:16:20.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328777+0000", 2024-09-17T18:16:20.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000101925 2024-09-17T18:16:20.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.330111+0000", 2024-09-17T18:16:20.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013336070000000001 2024-09-17T18:16:20.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.331541+0000", 2024-09-17T18:16:20.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0014308599999999999 2024-09-17T18:16:20.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.334450+0000", 2024-09-17T18:16:20.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002909015 2024-09-17T18:16:20.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.358207+0000", 2024-09-17T18:16:20.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023756599 2024-09-17T18:16:20.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.358275+0000", 2024-09-17T18:16:20.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8460000000000005e-05 2024-09-17T18:16:20.242 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.242 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.242 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.242 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:761 3.bs0 3:d0999786:::smithi15432074-33:head [append 0~0] snapc 1c=[1c,1b,19,18,17,16,15,13,11,10,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-17T18:16:20.242 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.328714+0000", 2024-09-17T18:16:20.242 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.8022883200000006, 2024-09-17T18:16:20.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.030084783, 2024-09-17T18:16:20.243 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.243 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.243 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.243 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.243 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.244 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.244 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 761 2024-09-17T18:16:20.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.244 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328714+0000", 2024-09-17T18:16:20.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328714+0000", 2024-09-17T18:16:20.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328715+0000", 2024-09-17T18:16:20.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3149999999999999e-06 2024-09-17T18:16:20.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328720+0000", 2024-09-17T18:16:20.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9030000000000003e-06 2024-09-17T18:16:20.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328732+0000", 2024-09-17T18:16:20.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2048000000000001e-05 2024-09-17T18:16:20.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328741+0000", 2024-09-17T18:16:20.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7609999999999996e-06 2024-09-17T18:16:20.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.329500+0000", 2024-09-17T18:16:20.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075907999999999998 2024-09-17T18:16:20.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.329632+0000", 2024-09-17T18:16:20.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013219100000000001 2024-09-17T18:16:20.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.332787+0000", 2024-09-17T18:16:20.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031555440000000001 2024-09-17T18:16:20.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337909+0000", 2024-09-17T18:16:20.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051212840000000003 2024-09-17T18:16:20.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.358672+0000", 2024-09-17T18:16:20.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020762872000000002 2024-09-17T18:16:20.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.358798+0000", 2024-09-17T18:16:20.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000126785 2024-09-17T18:16:20.251 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.252 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.252 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.252 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:762 3.bs0 3:d0999786:::smithi15432074-33:head [rollback 1c] snapc 1c=[1c,1b,19,18,17,16,15,13,11,10,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-17T18:16:20.252 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.328763+0000", 2024-09-17T18:16:20.252 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.8022387129999995, 2024-09-17T18:16:20.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.036138908999999997, 2024-09-17T18:16:20.252 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.252 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.252 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.252 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.252 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.253 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.253 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 762 2024-09-17T18:16:20.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.253 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328763+0000", 2024-09-17T18:16:20.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328763+0000", 2024-09-17T18:16:20.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328764+0000", 2024-09-17T18:16:20.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9999999999999996e-07 2024-09-17T18:16:20.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328768+0000", 2024-09-17T18:16:20.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9140000000000001e-06 2024-09-17T18:16:20.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328779+0000", 2024-09-17T18:16:20.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0721e-05 2024-09-17T18:16:20.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328786+0000", 2024-09-17T18:16:20.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8890000000000002e-06 2024-09-17T18:16:20.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.334592+0000", 2024-09-17T18:16:20.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058055909999999997 2024-09-17T18:16:20.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.334734+0000", 2024-09-17T18:16:20.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014166800000000001 2024-09-17T18:16:20.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335671+0000", 2024-09-17T18:16:20.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00093747299999999997 2024-09-17T18:16:20.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.345806+0000", 2024-09-17T18:16:20.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010134433 2024-09-17T18:16:20.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.364803+0000", 2024-09-17T18:16:20.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018997482 2024-09-17T18:16:20.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.364902+0000", 2024-09-17T18:16:20.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8937999999999994e-05 2024-09-17T18:16:20.261 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.261 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.261 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.262 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:763 3.bs0 3:d0999786:::smithi15432074-33:head [append 0~0] snapc 1c=[1c,1b,19,18,17,16,15,13,11,10,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-17T18:16:20.262 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.328800+0000", 2024-09-17T18:16:20.262 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.8022022579999994, 2024-09-17T18:16:20.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.036323992999999999, 2024-09-17T18:16:20.262 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.262 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.262 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.262 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.262 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.262 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.262 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 763 2024-09-17T18:16:20.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.262 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328800+0000", 2024-09-17T18:16:20.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328800+0000", 2024-09-17T18:16:20.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328800+0000", 2024-09-17T18:16:20.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6899999999999996e-07 2024-09-17T18:16:20.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328804+0000", 2024-09-17T18:16:20.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2610000000000002e-06 2024-09-17T18:16:20.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328813+0000", 2024-09-17T18:16:20.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5149999999999995e-06 2024-09-17T18:16:20.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.328820+0000", 2024-09-17T18:16:20.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0910000000000004e-06 2024-09-17T18:16:20.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.336849+0000", 2024-09-17T18:16:20.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080287770000000008 2024-09-17T18:16:20.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.336951+0000", 2024-09-17T18:16:20.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010191699999999999 2024-09-17T18:16:20.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337429+0000", 2024-09-17T18:16:20.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00047811899999999999 2024-09-17T18:16:20.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.345808+0000", 2024-09-17T18:16:20.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0083786820000000001 2024-09-17T18:16:20.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.365037+0000", 2024-09-17T18:16:20.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019228906 2024-09-17T18:16:20.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.365124+0000", 2024-09-17T18:16:20.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6955999999999999e-05 2024-09-17T18:16:20.267 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.267 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.267 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.267 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:764 3.bs0 3:df05abfe:::smithi15432074-30:head [append 0~671744] snapc 1c=[1c,1b,19,18,17,16,15,13,11,10,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-17T18:16:20.267 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.333492+0000", 2024-09-17T18:16:20.268 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.7975097249999994, 2024-09-17T18:16:20.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.031892678000000001, 2024-09-17T18:16:20.268 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.268 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.268 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.268 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.268 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.268 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.268 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 764 2024-09-17T18:16:20.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.268 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.333492+0000", 2024-09-17T18:16:20.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.333492+0000", 2024-09-17T18:16:20.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.333494+0000", 2024-09-17T18:16:20.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9929999999999998e-06 2024-09-17T18:16:20.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.334233+0000", 2024-09-17T18:16:20.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000739298 2024-09-17T18:16:20.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.334249+0000", 2024-09-17T18:16:20.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5687000000000001e-05 2024-09-17T18:16:20.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.334257+0000", 2024-09-17T18:16:20.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0989999999999999e-06 2024-09-17T18:16:20.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.338570+0000", 2024-09-17T18:16:20.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004312995 2024-09-17T18:16:20.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.338828+0000", 2024-09-17T18:16:20.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00025783300000000001 2024-09-17T18:16:20.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.340339+0000", 2024-09-17T18:16:20.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015107569999999999 2024-09-17T18:16:20.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.345864+0000", 2024-09-17T18:16:20.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055255540000000002 2024-09-17T18:16:20.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.365283+0000", 2024-09-17T18:16:20.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019418853999999999 2024-09-17T18:16:20.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.365385+0000", 2024-09-17T18:16:20.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010160799999999999 2024-09-17T18:16:20.273 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.273 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.273 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.273 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:765 3.bs0 3:df05abfe:::smithi15432074-30:head [append 0~573440] snapc 1c=[1c,1b,19,18,17,16,15,13,11,10,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-17T18:16:20.273 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.337610+0000", 2024-09-17T18:16:20.273 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.7933917669999992, 2024-09-17T18:16:20.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027920378999999999, 2024-09-17T18:16:20.273 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.273 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.274 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.274 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.274 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.274 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.274 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 765 2024-09-17T18:16:20.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.274 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337610+0000", 2024-09-17T18:16:20.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337610+0000", 2024-09-17T18:16:20.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337613+0000", 2024-09-17T18:16:20.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1870000000000001e-06 2024-09-17T18:16:20.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.338225+0000", 2024-09-17T18:16:20.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00061154299999999998 2024-09-17T18:16:20.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.338260+0000", 2024-09-17T18:16:20.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5197999999999997e-05 2024-09-17T18:16:20.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.338281+0000", 2024-09-17T18:16:20.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1192e-05 2024-09-17T18:16:20.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.341484+0000", 2024-09-17T18:16:20.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003203146 2024-09-17T18:16:20.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.341632+0000", 2024-09-17T18:16:20.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014795100000000001 2024-09-17T18:16:20.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.344235+0000", 2024-09-17T18:16:20.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0026028290000000001 2024-09-17T18:16:20.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.348906+0000", 2024-09-17T18:16:20.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046710730000000004 2024-09-17T18:16:20.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.365475+0000", 2024-09-17T18:16:20.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016569181999999998 2024-09-17T18:16:20.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.365530+0000", 2024-09-17T18:16:20.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5077999999999997e-05 2024-09-17T18:16:20.279 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.279 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.279 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.279 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4565.0:766 3.bs0 3:df05abfe:::smithi15432074-30:head [append 0~753664] snapc 1c=[1c,1b,19,18,17,16,15,13,11,10,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-17T18:16:20.279 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.343020+0000", 2024-09-17T18:16:20.279 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.7879814189999994, 2024-09-17T18:16:20.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022636086999999999, 2024-09-17T18:16:20.279 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.280 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.280 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:20.280 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-17T18:16:20.280 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4565", 2024-09-17T18:16:20.280 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:20.280 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 766 2024-09-17T18:16:20.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.280 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.343020+0000", 2024-09-17T18:16:20.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.343020+0000", 2024-09-17T18:16:20.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.343023+0000", 2024-09-17T18:16:20.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8590000000000001e-06 2024-09-17T18:16:20.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.344647+0000", 2024-09-17T18:16:20.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016237619999999999 2024-09-17T18:16:20.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.344681+0000", 2024-09-17T18:16:20.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3674000000000003e-05 2024-09-17T18:16:20.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.344702+0000", 2024-09-17T18:16:20.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1288999999999999e-05 2024-09-17T18:16:20.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.345895+0000", 2024-09-17T18:16:20.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011934059999999999 2024-09-17T18:16:20.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-17T18:16:20.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.346022+0000", 2024-09-17T18:16:20.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000126253 2024-09-17T18:16:20.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.347878+0000", 2024-09-17T18:16:20.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001856307 2024-09-17T18:16:20.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.352982+0000", 2024-09-17T18:16:20.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051041359999999996 2024-09-17T18:16:20.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-17T18:16:20.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.365605+0000", 2024-09-17T18:16:20.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01262338 2024-09-17T18:16:20.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.365656+0000", 2024-09-17T18:16:20.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1020999999999998e-05 2024-09-17T18:16:20.285 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.285 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.285 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.285 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.285 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.285 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:20.286 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T18:16:20.287 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:20.282+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:20.330 INFO:tasks.rados.rados.0.smithi154.stdout:350: done (2 left) 2024-09-17T18:16:20.331 INFO:tasks.rados.rados.0.smithi154.stdout:351: copy_from oid 20 from oid 11 current snap is 30 2024-09-17T18:16:20.331 INFO:tasks.rados.rados.0.smithi154.stdout:348: finishing rollback tid 0 to smithi15432074-29 2024-09-17T18:16:20.331 INFO:tasks.rados.rados.0.smithi154.stdout:348: finishing rollback tid 1 to smithi15432074-29 2024-09-17T18:16:20.331 INFO:tasks.rados.rados.0.smithi154.stdout:348: finishing rollback tid 2 to smithi15432074-29 2024-09-17T18:16:20.331 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 29 v 102 (ObjNum 133 snap 27 seq_num 133) dirty exists 2024-09-17T18:16:20.331 INFO:tasks.rados.rados.0.smithi154.stdout:345: expect (ObjNum 57 snap 1 seq_num 57) 2024-09-17T18:16:20.331 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:20.345 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T18:16:20.387 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:20.381+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:20.412 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 883094 2024-09-17T18:16:20.421 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:20.440 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:16:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-17T18:16:20.440 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:20.443 INFO:tasks.rados.rados.0.smithi154.stdout:351: finishing copy_from racing read to smithi15432074-20 2024-09-17T18:16:20.443 INFO:tasks.rados.rados.0.smithi154.stdout:351: finishing copy_from to smithi15432074-20 2024-09-17T18:16:20.443 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 20 v 148 (ObjNum 120 snap 26 seq_num 120) dirty exists 2024-09-17T18:16:20.443 INFO:tasks.rados.rados.0.smithi154.stdout:345: done (2 left) 2024-09-17T18:16:20.443 INFO:tasks.rados.rados.0.smithi154.stdout:348: done (1 left) 2024-09-17T18:16:20.443 INFO:tasks.rados.rados.0.smithi154.stdout:351: done (0 left) 2024-09-17T18:16:20.443 INFO:tasks.rados.rados.0.smithi154.stdout:352: delete oid 31 current snap is 30 2024-09-17T18:16:20.448 INFO:tasks.rados.rados.0.smithi154.stdout:352: done (0 left) 2024-09-17T18:16:20.448 INFO:tasks.rados.rados.0.smithi154.stdout:353: copy_from oid 15 from oid 38 current snap is 30 2024-09-17T18:16:20.448 INFO:tasks.rados.rados.0.smithi154.stdout:354: rollback oid 45 current snap is 30 2024-09-17T18:16:20.448 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 45 to 29 2024-09-17T18:16:20.448 INFO:tasks.rados.rados.0.smithi154.stdout:355: rmattr oid 1 current snap is 30 2024-09-17T18:16:20.448 INFO:tasks.rados.rados.0.smithi154.stdout:355: done (2 left) 2024-09-17T18:16:20.448 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 48 current snap is 30 2024-09-17T18:16:20.448 INFO:tasks.rados.rados.0.smithi154.stdout:356: seq_num 145 ranges {802816=32768} 2024-09-17T18:16:20.456 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T18:16:20.465 INFO:tasks.rados.rados.0.smithi154.stdout:356: writing smithi15432074-48 from 802816 to 835584 tid 1 2024-09-17T18:16:20.465 INFO:tasks.rados.rados.0.smithi154.stdout:357: rmattr oid 40 current snap is 30 2024-09-17T18:16:20.465 INFO:tasks.rados.rados.0.smithi154.stdout:357: done (3 left) 2024-09-17T18:16:20.465 INFO:tasks.rados.rados.0.smithi154.stdout:358: rollback oid 2 current snap is 30 2024-09-17T18:16:20.466 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 2 to 15 2024-09-17T18:16:20.466 INFO:tasks.rados.rados.0.smithi154.stdout:354: finishing rollback tid 0 to smithi15432074-45 2024-09-17T18:16:20.466 INFO:tasks.rados.rados.0.smithi154.stdout:354: finishing rollback tid 1 to smithi15432074-45 2024-09-17T18:16:20.466 INFO:tasks.rados.rados.0.smithi154.stdout:354: finishing rollback tid 2 to smithi15432074-45 2024-09-17T18:16:20.466 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 45 v 114 (ObjNum 111 snap 24 seq_num 111) dirty exists 2024-09-17T18:16:20.466 INFO:tasks.rados.rados.0.smithi154.stdout:354: done (3 left) 2024-09-17T18:16:20.466 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 37 current snap is 30 2024-09-17T18:16:20.466 INFO:tasks.rados.rados.0.smithi154.stdout:359: seq_num 146 ranges {622592=49152} 2024-09-17T18:16:20.474 INFO:tasks.rados.rados.0.smithi154.stdout:359: writing smithi15432074-37 from 622592 to 671744 tid 1 2024-09-17T18:16:20.475 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 19 current snap is 30 2024-09-17T18:16:20.475 INFO:tasks.rados.rados.0.smithi154.stdout:356: finishing write tid 1 to smithi15432074-48 2024-09-17T18:16:20.475 INFO:tasks.rados.rados.0.smithi154.stdout:360: seq_num 147 ranges {65536=65536} 2024-09-17T18:16:20.477 INFO:tasks.rados.rados.0.smithi154.stdout:360: writing smithi15432074-19 from 65536 to 131072 tid 1 2024-09-17T18:16:20.478 INFO:tasks.rados.rados.0.smithi154.stdout:361: rollback oid 23 current snap is 30 2024-09-17T18:16:20.478 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 23 to 27 2024-09-17T18:16:20.478 INFO:tasks.rados.rados.0.smithi154.stdout:362: snap_remove snap 6 2024-09-17T18:16:20.489 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:20.481+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:20.582 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:20.582 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:16:20.582 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-17T18:16:20.582 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-17T18:16:20.582 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:20.589 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:20.585+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:20.596 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T18:16:20.690 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:20.685+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:20.717 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:20.717 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-17T18:16:20.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-17T18:16:20.717 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-17T18:16:20.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.718 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs1 37/31 ECSubWrite(tid=31, reqid=client.4565.0:242, at_version=37'16, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:16:20.718 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.706489+0000", 2024-09-17T18:16:20.718 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 48.008751146999998, 2024-09-17T18:16:20.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060626710000000004, 2024-09-17T18:16:20.718 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.718 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.718 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.718 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706489+0000", 2024-09-17T18:16:20.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706489+0000", 2024-09-17T18:16:20.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706491+0000", 2024-09-17T18:16:20.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.689e-06 2024-09-17T18:16:20.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706535+0000", 2024-09-17T18:16:20.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3600999999999998e-05 2024-09-17T18:16:20.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706565+0000", 2024-09-17T18:16:20.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0281999999999999e-05 2024-09-17T18:16:20.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706582+0000", 2024-09-17T18:16:20.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6711e-05 2024-09-17T18:16:20.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706778+0000", 2024-09-17T18:16:20.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00019613899999999999 2024-09-17T18:16:20.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706801+0000", 2024-09-17T18:16:20.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3703999999999999e-05 2024-09-17T18:16:20.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.712460+0000", 2024-09-17T18:16:20.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056587479999999999 2024-09-17T18:16:20.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.712552+0000", 2024-09-17T18:16:20.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1797000000000002e-05 2024-09-17T18:16:20.722 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.722 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.722 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.722 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs1 37/31 ECSubWrite(tid=32, reqid=client.4565.0:243, at_version=37'17, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:16:20.723 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.707477+0000", 2024-09-17T18:16:20.723 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 48.007763148000002, 2024-09-17T18:16:20.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005556732, 2024-09-17T18:16:20.723 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.723 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.723 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.723 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707477+0000", 2024-09-17T18:16:20.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707477+0000", 2024-09-17T18:16:20.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707479+0000", 2024-09-17T18:16:20.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.717e-06 2024-09-17T18:16:20.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707515+0000", 2024-09-17T18:16:20.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6501999999999997e-05 2024-09-17T18:16:20.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707541+0000", 2024-09-17T18:16:20.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5113000000000002e-05 2024-09-17T18:16:20.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707562+0000", 2024-09-17T18:16:20.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1585000000000001e-05 2024-09-17T18:16:20.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707638+0000", 2024-09-17T18:16:20.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5597000000000001e-05 2024-09-17T18:16:20.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.707653+0000", 2024-09-17T18:16:20.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4783000000000001e-05 2024-09-17T18:16:20.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.712999+0000", 2024-09-17T18:16:20.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053467159999999996 2024-09-17T18:16:20.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.713034+0000", 2024-09-17T18:16:20.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4718999999999997e-05 2024-09-17T18:16:20.727 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.727 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.727 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.727 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 42/31 ECSubWrite(tid=160, reqid=osd.13.0:160, at_version=42'69, trim_to=0'0, roll_forward_to=40'63))", 2024-09-17T18:16:20.728 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.792028+0000", 2024-09-17T18:16:20.728 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.923212073000002, 2024-09-17T18:16:20.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058500109999999996, 2024-09-17T18:16:20.728 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.728 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.728 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.728 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792028+0000", 2024-09-17T18:16:20.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792028+0000", 2024-09-17T18:16:20.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792029+0000", 2024-09-17T18:16:20.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8999999999999997e-07 2024-09-17T18:16:20.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792053+0000", 2024-09-17T18:16:20.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4172000000000002e-05 2024-09-17T18:16:20.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792062+0000", 2024-09-17T18:16:20.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2e-06 2024-09-17T18:16:20.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792071+0000", 2024-09-17T18:16:20.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6880000000000005e-06 2024-09-17T18:16:20.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792774+0000", 2024-09-17T18:16:20.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00070302699999999995 2024-09-17T18:16:20.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.792790+0000", 2024-09-17T18:16:20.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6093e-05 2024-09-17T18:16:20.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797821+0000", 2024-09-17T18:16:20.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0050305710000000002 2024-09-17T18:16:20.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797878+0000", 2024-09-17T18:16:20.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7769999999999997e-05 2024-09-17T18:16:20.732 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.732 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.732 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.732 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.9s5 42/31 ECSubWrite(tid=43, reqid=osd.7.0:42, at_version=0'0, trim_to=0'0, roll_forward_to=42'30))", 2024-09-17T18:16:20.732 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.795617+0000", 2024-09-17T18:16:20.732 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.919623715999997, 2024-09-17T18:16:20.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054555130000000004, 2024-09-17T18:16:20.733 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.733 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.733 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.733 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795617+0000", 2024-09-17T18:16:20.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795617+0000", 2024-09-17T18:16:20.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795617+0000", 2024-09-17T18:16:20.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3799999999999996e-07 2024-09-17T18:16:20.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795628+0000", 2024-09-17T18:16:20.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0868e-05 2024-09-17T18:16:20.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795640+0000", 2024-09-17T18:16:20.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1327e-05 2024-09-17T18:16:20.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795646+0000", 2024-09-17T18:16:20.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9089999999999997e-06 2024-09-17T18:16:20.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795702+0000", 2024-09-17T18:16:20.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6654999999999999e-05 2024-09-17T18:16:20.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.795710+0000", 2024-09-17T18:16:20.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.43e-06 2024-09-17T18:16:20.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801022+0000", 2024-09-17T18:16:20.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005311975 2024-09-17T18:16:20.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.801072+0000", 2024-09-17T18:16:20.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0611e-05 2024-09-17T18:16:20.737 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.737 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.737 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.737 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.9s5 42/31 ECSubWrite(tid=45, reqid=osd.7.0:45, at_version=42'32, trim_to=0'0, roll_forward_to=42'30))", 2024-09-17T18:16:20.737 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.797426+0000", 2024-09-17T18:16:20.737 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.917814174999997, 2024-09-17T18:16:20.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063823029999999998, 2024-09-17T18:16:20.738 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.738 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.738 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.738 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797426+0000", 2024-09-17T18:16:20.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797426+0000", 2024-09-17T18:16:20.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797427+0000", 2024-09-17T18:16:20.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2099999999999997e-07 2024-09-17T18:16:20.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797440+0000", 2024-09-17T18:16:20.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3254e-05 2024-09-17T18:16:20.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797448+0000", 2024-09-17T18:16:20.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4239999999999993e-06 2024-09-17T18:16:20.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797453+0000", 2024-09-17T18:16:20.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4440000000000001e-06 2024-09-17T18:16:20.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797511+0000", 2024-09-17T18:16:20.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8357999999999999e-05 2024-09-17T18:16:20.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.797522+0000", 2024-09-17T18:16:20.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.08e-05 2024-09-17T18:16:20.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.803773+0000", 2024-09-17T18:16:20.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062510480000000004 2024-09-17T18:16:20.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.803809+0000", 2024-09-17T18:16:20.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5454000000000003e-05 2024-09-17T18:16:20.742 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.742 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.742 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.742 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 42/31 ECSubWrite(tid=163, reqid=osd.13.0:163, at_version=42'73, trim_to=0'0, roll_forward_to=42'69))", 2024-09-17T18:16:20.742 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.809504+0000", 2024-09-17T18:16:20.742 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.905736451000003, 2024-09-17T18:16:20.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058964129999999997, 2024-09-17T18:16:20.743 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.743 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.743 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.743 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809504+0000", 2024-09-17T18:16:20.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809504+0000", 2024-09-17T18:16:20.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809505+0000", 2024-09-17T18:16:20.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.114e-06 2024-09-17T18:16:20.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809538+0000", 2024-09-17T18:16:20.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3356999999999999e-05 2024-09-17T18:16:20.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809562+0000", 2024-09-17T18:16:20.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3407000000000001e-05 2024-09-17T18:16:20.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809579+0000", 2024-09-17T18:16:20.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7048e-05 2024-09-17T18:16:20.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809633+0000", 2024-09-17T18:16:20.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4338000000000001e-05 2024-09-17T18:16:20.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.809638+0000", 2024-09-17T18:16:20.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8899999999999998e-06 2024-09-17T18:16:20.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.815347+0000", 2024-09-17T18:16:20.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057087709999999996 2024-09-17T18:16:20.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.815400+0000", 2024-09-17T18:16:20.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3488e-05 2024-09-17T18:16:20.747 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.747 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.747 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.747 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.5s1 54/31 ECSubWrite(tid=81, reqid=osd.5.0:81, at_version=54'21, trim_to=0'0, roll_forward_to=53'19))", 2024-09-17T18:16:20.748 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310843+0000", 2024-09-17T18:16:20.748 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.404397190000001, 2024-09-17T18:16:20.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013234032, 2024-09-17T18:16:20.748 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.748 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.748 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.748 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310843+0000", 2024-09-17T18:16:20.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310843+0000", 2024-09-17T18:16:20.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310844+0000", 2024-09-17T18:16:20.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8299999999999996e-07 2024-09-17T18:16:20.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310928+0000", 2024-09-17T18:16:20.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4201000000000002e-05 2024-09-17T18:16:20.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310977+0000", 2024-09-17T18:16:20.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9376000000000003e-05 2024-09-17T18:16:20.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.311003+0000", 2024-09-17T18:16:20.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5123e-05 2024-09-17T18:16:20.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.313724+0000", 2024-09-17T18:16:20.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002721462 2024-09-17T18:16:20.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.313759+0000", 2024-09-17T18:16:20.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4935999999999999e-05 2024-09-17T18:16:20.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.323837+0000", 2024-09-17T18:16:20.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010078129 2024-09-17T18:16:20.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.324077+0000", 2024-09-17T18:16:20.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000240122 2024-09-17T18:16:20.752 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.752 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.752 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.752 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 54/31 ECSubWrite(tid=277, reqid=osd.13.0:277, at_version=54'134, trim_to=0'0, roll_forward_to=53'132))", 2024-09-17T18:16:20.752 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.319173+0000", 2024-09-17T18:16:20.752 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.396067260999999, 2024-09-17T18:16:20.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060233880000000002, 2024-09-17T18:16:20.753 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.753 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.753 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.753 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319173+0000", 2024-09-17T18:16:20.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319173+0000", 2024-09-17T18:16:20.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319174+0000", 2024-09-17T18:16:20.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5300000000000003e-07 2024-09-17T18:16:20.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319245+0000", 2024-09-17T18:16:20.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0905e-05 2024-09-17T18:16:20.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319281+0000", 2024-09-17T18:16:20.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6211999999999998e-05 2024-09-17T18:16:20.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.319355+0000", 2024-09-17T18:16:20.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4004999999999994e-05 2024-09-17T18:16:20.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.321073+0000", 2024-09-17T18:16:20.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001718383 2024-09-17T18:16:20.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.321100+0000", 2024-09-17T18:16:20.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7123000000000001e-05 2024-09-17T18:16:20.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.325137+0000", 2024-09-17T18:16:20.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040366890000000004 2024-09-17T18:16:20.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.325197+0000", 2024-09-17T18:16:20.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9317999999999997e-05 2024-09-17T18:16:20.757 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.757 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.757 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.757 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs1 54/31 ECSubWrite(tid=83, reqid=osd.5.0:83, at_version=54'52, trim_to=0'0, roll_forward_to=53'48))", 2024-09-17T18:16:20.757 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.320258+0000", 2024-09-17T18:16:20.757 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.394981950000002, 2024-09-17T18:16:20.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005694681, 2024-09-17T18:16:20.757 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.757 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.758 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.758 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320258+0000", 2024-09-17T18:16:20.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320258+0000", 2024-09-17T18:16:20.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320260+0000", 2024-09-17T18:16:20.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1260000000000001e-06 2024-09-17T18:16:20.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320311+0000", 2024-09-17T18:16:20.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1808999999999998e-05 2024-09-17T18:16:20.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320342+0000", 2024-09-17T18:16:20.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0176e-05 2024-09-17T18:16:20.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.320360+0000", 2024-09-17T18:16:20.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8899999999999999e-05 2024-09-17T18:16:20.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.322647+0000", 2024-09-17T18:16:20.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002286986 2024-09-17T18:16:20.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.322674+0000", 2024-09-17T18:16:20.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6758999999999999e-05 2024-09-17T18:16:20.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.325866+0000", 2024-09-17T18:16:20.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031921810000000001 2024-09-17T18:16:20.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.325953+0000", 2024-09-17T18:16:20.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6743999999999995e-05 2024-09-17T18:16:20.762 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.762 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.762 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.762 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 54/31 ECSubWrite(tid=286, reqid=osd.13.0:286, at_version=54'138, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:16:20.762 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.347140+0000", 2024-09-17T18:16:20.762 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.368100805000001, 2024-09-17T18:16:20.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005171948, 2024-09-17T18:16:20.762 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.762 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.762 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.763 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347140+0000", 2024-09-17T18:16:20.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347140+0000", 2024-09-17T18:16:20.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347142+0000", 2024-09-17T18:16:20.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4399999999999999e-06 2024-09-17T18:16:20.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347206+0000", 2024-09-17T18:16:20.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3968999999999997e-05 2024-09-17T18:16:20.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347252+0000", 2024-09-17T18:16:20.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6282000000000002e-05 2024-09-17T18:16:20.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347269+0000", 2024-09-17T18:16:20.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6486000000000001e-05 2024-09-17T18:16:20.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347410+0000", 2024-09-17T18:16:20.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000140877 2024-09-17T18:16:20.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347434+0000", 2024-09-17T18:16:20.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4399000000000001e-05 2024-09-17T18:16:20.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.352199+0000", 2024-09-17T18:16:20.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047649880000000004 2024-09-17T18:16:20.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.352312+0000", 2024-09-17T18:16:20.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000112507 2024-09-17T18:16:20.766 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.766 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.766 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.767 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 54/31 ECSubWrite(tid=287, reqid=osd.13.0:287, at_version=54'140, trim_to=0'0, roll_forward_to=54'136))", 2024-09-17T18:16:20.767 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.347311+0000", 2024-09-17T18:16:20.767 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.367929609000001, 2024-09-17T18:16:20.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066967789999999999, 2024-09-17T18:16:20.767 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.767 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.767 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.767 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347311+0000", 2024-09-17T18:16:20.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347311+0000", 2024-09-17T18:16:20.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347312+0000", 2024-09-17T18:16:20.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.04e-06 2024-09-17T18:16:20.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347377+0000", 2024-09-17T18:16:20.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5566000000000002e-05 2024-09-17T18:16:20.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347400+0000", 2024-09-17T18:16:20.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2719000000000001e-05 2024-09-17T18:16:20.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.347420+0000", 2024-09-17T18:16:20.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9633e-05 2024-09-17T18:16:20.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.348462+0000", 2024-09-17T18:16:20.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010427279999999999 2024-09-17T18:16:20.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.348476+0000", 2024-09-17T18:16:20.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3207000000000001e-05 2024-09-17T18:16:20.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.353921+0000", 2024-09-17T18:16:20.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054453970000000003 2024-09-17T18:16:20.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.354008+0000", 2024-09-17T18:16:20.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6489000000000005e-05 2024-09-17T18:16:20.771 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.771 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.771 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.771 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 59/31 ECSubWrite(tid=341, reqid=client.4565.0:547, at_version=59'182, trim_to=0'0, roll_forward_to=58'180))", 2024-09-17T18:16:20.771 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:54.406166+0000", 2024-09-17T18:16:20.771 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.309074066000001, 2024-09-17T18:16:20.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006947717, 2024-09-17T18:16:20.772 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.772 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.772 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.772 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.406166+0000", 2024-09-17T18:16:20.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.406166+0000", 2024-09-17T18:16:20.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.406167+0000", 2024-09-17T18:16:20.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9599999999999999e-07 2024-09-17T18:16:20.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.409059+0000", 2024-09-17T18:16:20.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002891911 2024-09-17T18:16:20.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.409074+0000", 2024-09-17T18:16:20.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5498e-05 2024-09-17T18:16:20.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.409087+0000", 2024-09-17T18:16:20.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2877000000000001e-05 2024-09-17T18:16:20.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.409202+0000", 2024-09-17T18:16:20.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114904 2024-09-17T18:16:20.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.409213+0000", 2024-09-17T18:16:20.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0478e-05 2024-09-17T18:16:20.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.413074+0000", 2024-09-17T18:16:20.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038615429999999998 2024-09-17T18:16:20.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:54.413114+0000", 2024-09-17T18:16:20.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9910000000000002e-05 2024-09-17T18:16:20.776 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.776 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.776 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.776 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 64/31 ECSubWrite(tid=401, reqid=osd.13.0:401, at_version=64'207, trim_to=0'0, roll_forward_to=62'203))", 2024-09-17T18:16:20.776 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:59.318487+0000", 2024-09-17T18:16:20.776 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 21.396753042, 2024-09-17T18:16:20.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060833450000000004, 2024-09-17T18:16:20.776 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.776 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.776 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.777 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.318487+0000", 2024-09-17T18:16:20.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.318487+0000", 2024-09-17T18:16:20.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.318488+0000", 2024-09-17T18:16:20.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7000000000000003e-07 2024-09-17T18:16:20.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.318537+0000", 2024-09-17T18:16:20.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8562e-05 2024-09-17T18:16:20.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.318565+0000", 2024-09-17T18:16:20.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7929e-05 2024-09-17T18:16:20.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.318584+0000", 2024-09-17T18:16:20.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9327e-05 2024-09-17T18:16:20.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.321049+0000", 2024-09-17T18:16:20.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0024648309999999998 2024-09-17T18:16:20.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.321074+0000", 2024-09-17T18:16:20.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4946000000000001e-05 2024-09-17T18:16:20.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.324506+0000", 2024-09-17T18:16:20.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034321680000000002 2024-09-17T18:16:20.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:59.324571+0000", 2024-09-17T18:16:20.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4611999999999997e-05 2024-09-17T18:16:20.780 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.780 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.781 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.781 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs1 65/31 ECSubWrite(tid=112, reqid=osd.5.0:110, at_version=0'0, trim_to=0'0, roll_forward_to=65'73))", 2024-09-17T18:16:20.781 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:00.345352+0000", 2024-09-17T18:16:20.781 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.369888607, 2024-09-17T18:16:20.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055866500000000003, 2024-09-17T18:16:20.781 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.781 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.781 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.781 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345352+0000", 2024-09-17T18:16:20.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345352+0000", 2024-09-17T18:16:20.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345353+0000", 2024-09-17T18:16:20.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0219999999999999e-06 2024-09-17T18:16:20.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345366+0000", 2024-09-17T18:16:20.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3434e-05 2024-09-17T18:16:20.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345400+0000", 2024-09-17T18:16:20.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3702999999999999e-05 2024-09-17T18:16:20.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345410+0000", 2024-09-17T18:16:20.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0074999999999999e-05 2024-09-17T18:16:20.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345470+0000", 2024-09-17T18:16:20.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9676999999999998e-05 2024-09-17T18:16:20.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.345480+0000", 2024-09-17T18:16:20.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0105000000000001e-05 2024-09-17T18:16:20.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.350893+0000", 2024-09-17T18:16:20.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005413597 2024-09-17T18:16:20.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.350938+0000", 2024-09-17T18:16:20.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5037000000000003e-05 2024-09-17T18:16:20.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.785 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.785 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 65/31 ECSubWrite(tid=414, reqid=osd.13.0:414, at_version=65'215, trim_to=0'0, roll_forward_to=65'213))", 2024-09-17T18:16:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:00.353813+0000", 2024-09-17T18:16:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.361427304999999, 2024-09-17T18:16:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005802565, 2024-09-17T18:16:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353813+0000", 2024-09-17T18:16:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353813+0000", 2024-09-17T18:16:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353814+0000", 2024-09-17T18:16:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5300000000000003e-07 2024-09-17T18:16:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353842+0000", 2024-09-17T18:16:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8059e-05 2024-09-17T18:16:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353864+0000", 2024-09-17T18:16:20.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2095000000000001e-05 2024-09-17T18:16:20.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353876+0000", 2024-09-17T18:16:20.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2198000000000001e-05 2024-09-17T18:16:20.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353942+0000", 2024-09-17T18:16:20.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5887000000000001e-05 2024-09-17T18:16:20.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.353950+0000", 2024-09-17T18:16:20.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5650000000000004e-06 2024-09-17T18:16:20.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.359554+0000", 2024-09-17T18:16:20.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056045790000000002 2024-09-17T18:16:20.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.359616+0000", 2024-09-17T18:16:20.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1328999999999995e-05 2024-09-17T18:16:20.790 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.790 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.790 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.790 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 65/31 ECSubWrite(tid=416, reqid=osd.13.0:416, at_version=65'217, trim_to=0'0, roll_forward_to=65'213))", 2024-09-17T18:16:20.790 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:00.356590+0000", 2024-09-17T18:16:20.790 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.358650579999999, 2024-09-17T18:16:20.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055615409999999997, 2024-09-17T18:16:20.790 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.791 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.791 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.791 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356590+0000", 2024-09-17T18:16:20.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356590+0000", 2024-09-17T18:16:20.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356591+0000", 2024-09-17T18:16:20.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7400000000000002e-07 2024-09-17T18:16:20.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356607+0000", 2024-09-17T18:16:20.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6392000000000002e-05 2024-09-17T18:16:20.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356668+0000", 2024-09-17T18:16:20.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1336999999999999e-05 2024-09-17T18:16:20.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356678+0000", 2024-09-17T18:16:20.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8169999999999994e-06 2024-09-17T18:16:20.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356757+0000", 2024-09-17T18:16:20.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8922000000000001e-05 2024-09-17T18:16:20.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.356771+0000", 2024-09-17T18:16:20.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3967e-05 2024-09-17T18:16:20.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.362106+0000", 2024-09-17T18:16:20.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053352060000000003 2024-09-17T18:16:20.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.362151+0000", 2024-09-17T18:16:20.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5126000000000001e-05 2024-09-17T18:16:20.794 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.795 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.795 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.5s1 71/31 ECSubWrite(tid=128, reqid=client.4565.0:709, at_version=71'38, trim_to=0'0, roll_forward_to=68'36))", 2024-09-17T18:16:20.795 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:06.601848+0000", 2024-09-17T18:16:20.795 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.113391976000001, 2024-09-17T18:16:20.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011313545, 2024-09-17T18:16:20.795 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.795 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.795 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.795 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.601848+0000", 2024-09-17T18:16:20.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.601848+0000", 2024-09-17T18:16:20.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.601849+0000", 2024-09-17T18:16:20.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6700000000000003e-07 2024-09-17T18:16:20.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.606858+0000", 2024-09-17T18:16:20.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0050094700000000002 2024-09-17T18:16:20.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.606869+0000", 2024-09-17T18:16:20.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0278000000000001e-05 2024-09-17T18:16:20.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.606879+0000", 2024-09-17T18:16:20.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8109999999999997e-06 2024-09-17T18:16:20.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.606979+0000", 2024-09-17T18:16:20.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100556 2024-09-17T18:16:20.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.606993+0000", 2024-09-17T18:16:20.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3611999999999999e-05 2024-09-17T18:16:20.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.613131+0000", 2024-09-17T18:16:20.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061387000000000004 2024-09-17T18:16:20.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.613162+0000", 2024-09-17T18:16:20.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0550999999999999e-05 2024-09-17T18:16:20.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.799 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.799 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.9s5 76/31 ECSubWrite(tid=156, reqid=osd.7.0:156, at_version=76'145, trim_to=0'0, roll_forward_to=75'141))", 2024-09-17T18:16:20.800 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:11.351846+0000", 2024-09-17T18:16:20.800 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.3633946090000002, 2024-09-17T18:16:20.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058465390000000004, 2024-09-17T18:16:20.800 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.800 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.800 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.800 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.351846+0000", 2024-09-17T18:16:20.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.351846+0000", 2024-09-17T18:16:20.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.351846+0000", 2024-09-17T18:16:20.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3999999999999997e-07 2024-09-17T18:16:20.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.351873+0000", 2024-09-17T18:16:20.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6951999999999999e-05 2024-09-17T18:16:20.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.351882+0000", 2024-09-17T18:16:20.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2180000000000005e-06 2024-09-17T18:16:20.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.351887+0000", 2024-09-17T18:16:20.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6700000000000002e-06 2024-09-17T18:16:20.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.352430+0000", 2024-09-17T18:16:20.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000543518 2024-09-17T18:16:20.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.352441+0000", 2024-09-17T18:16:20.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0685e-05 2024-09-17T18:16:20.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.357649+0000", 2024-09-17T18:16:20.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052082730000000002 2024-09-17T18:16:20.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.357692+0000", 2024-09-17T18:16:20.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2883000000000003e-05 2024-09-17T18:16:20.804 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.804 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.804 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.804 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 76/31 ECSubWrite(tid=539, reqid=osd.13.0:537, at_version=0'0, trim_to=0'0, roll_forward_to=76'279))", 2024-09-17T18:16:20.805 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:11.354670+0000", 2024-09-17T18:16:20.805 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.3605698799999999, 2024-09-17T18:16:20.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054604759999999997, 2024-09-17T18:16:20.805 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.805 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.805 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.805 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.354670+0000", 2024-09-17T18:16:20.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.354670+0000", 2024-09-17T18:16:20.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.354672+0000", 2024-09-17T18:16:20.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0610000000000001e-06 2024-09-17T18:16:20.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.354683+0000", 2024-09-17T18:16:20.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1328999999999999e-05 2024-09-17T18:16:20.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.354697+0000", 2024-09-17T18:16:20.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4263e-05 2024-09-17T18:16:20.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.354705+0000", 2024-09-17T18:16:20.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6459999999999993e-06 2024-09-17T18:16:20.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.354759+0000", 2024-09-17T18:16:20.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4657000000000002e-05 2024-09-17T18:16:20.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.354766+0000", 2024-09-17T18:16:20.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9999999999999999e-06 2024-09-17T18:16:20.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.360097+0000", 2024-09-17T18:16:20.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053305740000000002 2024-09-17T18:16:20.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:11.360131+0000", 2024-09-17T18:16:20.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3946000000000003e-05 2024-09-17T18:16:20.809 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.809 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.809 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.809 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.9s5 80/31 ECSubWrite(tid=179, reqid=osd.7.0:179, at_version=80'170, trim_to=0'0, roll_forward_to=79'168))", 2024-09-17T18:16:20.809 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:15.502152+0000", 2024-09-17T18:16:20.810 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.2130879800000001, 2024-09-17T18:16:20.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063698749999999997, 2024-09-17T18:16:20.810 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:20.810 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:20.810 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:20.810 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:20.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:20.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.502152+0000", 2024-09-17T18:16:20.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:20.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.502152+0000", 2024-09-17T18:16:20.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:20.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:20.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.502153+0000", 2024-09-17T18:16:20.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.23e-07 2024-09-17T18:16:20.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:20.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.502263+0000", 2024-09-17T18:16:20.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010983499999999999 2024-09-17T18:16:20.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:20.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.502308+0000", 2024-09-17T18:16:20.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5380999999999998e-05 2024-09-17T18:16:20.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:20.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.502334+0000", 2024-09-17T18:16:20.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5191999999999999e-05 2024-09-17T18:16:20.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:20.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.502498+0000", 2024-09-17T18:16:20.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016427600000000001 2024-09-17T18:16:20.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:20.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.502521+0000", 2024-09-17T18:16:20.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2833e-05 2024-09-17T18:16:20.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:20.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.508473+0000", 2024-09-17T18:16:20.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059527340000000003 2024-09-17T18:16:20.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:20.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:20.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:20.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.508522+0000", 2024-09-17T18:16:20.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8801000000000003e-05 2024-09-17T18:16:20.815 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.815 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.815 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.815 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:20.815 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:20.815 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:20.817 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T18:16:20.817 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:20.813+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:20.918 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:20.913+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:20.986 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:20.986 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:16:20.986 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-17T18:16:20.986 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:21.001 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T18:16:21.048 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:21.045+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:21.119 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:21.117+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:21.133 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:21.133 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-17T18:16:21.133 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-17T18:16:21.133 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-17T18:16:21.134 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:21.148 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T18:16:21.220 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:21.218+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:21.315 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:21.315 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-17T18:16:21.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-17T18:16:21.316 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-17T18:16:21.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.316 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs5 37/31 ECSubWrite(tid=31, reqid=client.4565.0:242, at_version=37'16, trim_to=0'0, roll_forward_to=35'13))", 2024-09-17T18:16:21.316 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:32.706509+0000", 2024-09-17T18:16:21.316 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 48.604905795999997, 2024-09-17T18:16:21.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062454279999999999, 2024-09-17T18:16:21.317 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.317 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.317 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.317 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706509+0000", 2024-09-17T18:16:21.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706509+0000", 2024-09-17T18:16:21.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706511+0000", 2024-09-17T18:16:21.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.08e-06 2024-09-17T18:16:21.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706552+0000", 2024-09-17T18:16:21.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0723999999999998e-05 2024-09-17T18:16:21.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706585+0000", 2024-09-17T18:16:21.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3065000000000003e-05 2024-09-17T18:16:21.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706604+0000", 2024-09-17T18:16:21.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8851e-05 2024-09-17T18:16:21.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706701+0000", 2024-09-17T18:16:21.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7831999999999994e-05 2024-09-17T18:16:21.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.706711+0000", 2024-09-17T18:16:21.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4239999999999999e-06 2024-09-17T18:16:21.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.712726+0000", 2024-09-17T18:16:21.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060149699999999997 2024-09-17T18:16:21.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:32.712754+0000", 2024-09-17T18:16:21.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8481999999999999e-05 2024-09-17T18:16:21.324 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.324 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.324 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.324 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 42/31 ECSubWrite(tid=87, reqid=client.4565.0:358, at_version=42'26, trim_to=0'0, roll_forward_to=39'24))", 2024-09-17T18:16:21.324 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:37.771952+0000", 2024-09-17T18:16:21.324 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.539462995000001, 2024-09-17T18:16:21.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078941329999999994, 2024-09-17T18:16:21.324 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.324 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.325 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.325 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771952+0000", 2024-09-17T18:16:21.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771952+0000", 2024-09-17T18:16:21.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.771952+0000", 2024-09-17T18:16:21.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4200000000000001e-07 2024-09-17T18:16:21.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772004+0000", 2024-09-17T18:16:21.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2176000000000003e-05 2024-09-17T18:16:21.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772035+0000", 2024-09-17T18:16:21.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0332999999999999e-05 2024-09-17T18:16:21.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.772052+0000", 2024-09-17T18:16:21.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7071e-05 2024-09-17T18:16:21.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773442+0000", 2024-09-17T18:16:21.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00139061 2024-09-17T18:16:21.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.773459+0000", 2024-09-17T18:16:21.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6898e-05 2024-09-17T18:16:21.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.779809+0000", 2024-09-17T18:16:21.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063501199999999999 2024-09-17T18:16:21.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:37.779846+0000", 2024-09-17T18:16:21.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6483000000000003e-05 2024-09-17T18:16:21.329 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.329 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.329 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.329 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 43/31 ECSubWrite(tid=105, reqid=osd.4.0:105, at_version=43'38, trim_to=0'0, roll_forward_to=42'34))", 2024-09-17T18:16:21.330 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:38.771731+0000", 2024-09-17T18:16:21.330 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.539683334999999, 2024-09-17T18:16:21.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057788789999999998, 2024-09-17T18:16:21.330 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.330 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.330 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.330 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771731+0000", 2024-09-17T18:16:21.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771731+0000", 2024-09-17T18:16:21.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771732+0000", 2024-09-17T18:16:21.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8199999999999998e-07 2024-09-17T18:16:21.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771759+0000", 2024-09-17T18:16:21.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7076e-05 2024-09-17T18:16:21.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771772+0000", 2024-09-17T18:16:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2357999999999999e-05 2024-09-17T18:16:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771781+0000", 2024-09-17T18:16:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2380000000000003e-06 2024-09-17T18:16:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771871+0000", 2024-09-17T18:16:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0464999999999995e-05 2024-09-17T18:16:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.771881+0000", 2024-09-17T18:16:21.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9499999999999996e-06 2024-09-17T18:16:21.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.777463+0000", 2024-09-17T18:16:21.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055820150000000001 2024-09-17T18:16:21.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:38.777510+0000", 2024-09-17T18:16:21.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6894999999999997e-05 2024-09-17T18:16:21.334 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.334 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.334 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.334 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.5s4 54/31 ECSubWrite(tid=81, reqid=osd.5.0:81, at_version=54'21, trim_to=0'0, roll_forward_to=53'19))", 2024-09-17T18:16:21.334 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.310887+0000", 2024-09-17T18:16:21.334 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.000527947999998, 2024-09-17T18:16:21.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0073816610000000003, 2024-09-17T18:16:21.335 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.335 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.335 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.335 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310887+0000", 2024-09-17T18:16:21.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310887+0000", 2024-09-17T18:16:21.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310887+0000", 2024-09-17T18:16:21.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3e-07 2024-09-17T18:16:21.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310940+0000", 2024-09-17T18:16:21.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3124999999999997e-05 2024-09-17T18:16:21.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.310979+0000", 2024-09-17T18:16:21.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8452999999999999e-05 2024-09-17T18:16:21.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.311002+0000", 2024-09-17T18:16:21.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3479999999999999e-05 2024-09-17T18:16:21.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.312706+0000", 2024-09-17T18:16:21.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001703539 2024-09-17T18:16:21.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.312732+0000", 2024-09-17T18:16:21.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5982999999999998e-05 2024-09-17T18:16:21.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.318109+0000", 2024-09-17T18:16:21.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053769120000000002 2024-09-17T18:16:21.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.318268+0000", 2024-09-17T18:16:21.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015953899999999999 2024-09-17T18:16:21.339 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.339 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.339 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.339 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 54/31 ECSubWrite(tid=156, reqid=client.4565.0:515, at_version=54'70, trim_to=0'0, roll_forward_to=54'68))", 2024-09-17T18:16:21.339 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:15:49.387529+0000", 2024-09-17T18:16:21.339 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.923885455000001, 2024-09-17T18:16:21.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059270210000000002, 2024-09-17T18:16:21.339 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.340 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.340 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.340 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.387529+0000", 2024-09-17T18:16:21.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.387529+0000", 2024-09-17T18:16:21.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.387532+0000", 2024-09-17T18:16:21.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.039e-06 2024-09-17T18:16:21.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.388695+0000", 2024-09-17T18:16:21.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001162377 2024-09-17T18:16:21.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.388732+0000", 2024-09-17T18:16:21.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7079000000000002e-05 2024-09-17T18:16:21.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.388757+0000", 2024-09-17T18:16:21.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.497e-05 2024-09-17T18:16:21.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.388913+0000", 2024-09-17T18:16:21.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015615799999999999 2024-09-17T18:16:21.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.388932+0000", 2024-09-17T18:16:21.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9270999999999999e-05 2024-09-17T18:16:21.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.393403+0000", 2024-09-17T18:16:21.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044705839999999997 2024-09-17T18:16:21.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:15:49.393456+0000", 2024-09-17T18:16:21.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3542999999999999e-05 2024-09-17T18:16:21.344 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.344 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.344 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.344 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 65/31 ECSubWrite(tid=212, reqid=osd.4.0:212, at_version=65'104, trim_to=0'0, roll_forward_to=62'100))", 2024-09-17T18:16:21.344 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:00.337303+0000", 2024-09-17T18:16:21.344 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.974111329999999, 2024-09-17T18:16:21.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007070855, 2024-09-17T18:16:21.344 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.344 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.344 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.344 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337303+0000", 2024-09-17T18:16:21.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337303+0000", 2024-09-17T18:16:21.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337304+0000", 2024-09-17T18:16:21.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1699999999999997e-07 2024-09-17T18:16:21.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337328+0000", 2024-09-17T18:16:21.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4054999999999999e-05 2024-09-17T18:16:21.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337339+0000", 2024-09-17T18:16:21.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0958000000000001e-05 2024-09-17T18:16:21.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337348+0000", 2024-09-17T18:16:21.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5150000000000006e-06 2024-09-17T18:16:21.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337452+0000", 2024-09-17T18:16:21.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104425 2024-09-17T18:16:21.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.337466+0000", 2024-09-17T18:16:21.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3558e-05 2024-09-17T18:16:21.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.344327+0000", 2024-09-17T18:16:21.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068609509999999997 2024-09-17T18:16:21.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:00.344374+0000", 2024-09-17T18:16:21.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7475999999999997e-05 2024-09-17T18:16:21.348 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.348 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.348 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.349 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.5s4 71/31 ECSubWrite(tid=128, reqid=client.4565.0:709, at_version=71'38, trim_to=0'0, roll_forward_to=68'36))", 2024-09-17T18:16:21.349 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:06.602846+0000", 2024-09-17T18:16:21.349 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.708568770999999, 2024-09-17T18:16:21.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011604071000000001, 2024-09-17T18:16:21.349 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.349 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.349 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.349 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.602846+0000", 2024-09-17T18:16:21.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.602846+0000", 2024-09-17T18:16:21.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.602846+0000", 2024-09-17T18:16:21.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.48e-07 2024-09-17T18:16:21.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.607008+0000", 2024-09-17T18:16:21.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004161568 2024-09-17T18:16:21.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.607030+0000", 2024-09-17T18:16:21.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2137000000000002e-05 2024-09-17T18:16:21.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.607041+0000", 2024-09-17T18:16:21.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0978000000000001e-05 2024-09-17T18:16:21.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.607115+0000", 2024-09-17T18:16:21.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4464999999999999e-05 2024-09-17T18:16:21.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.607126+0000", 2024-09-17T18:16:21.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.117e-05 2024-09-17T18:16:21.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.614404+0000", 2024-09-17T18:16:21.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0072772000000000002 2024-09-17T18:16:21.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:06.614450+0000", 2024-09-17T18:16:21.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6304999999999998e-05 2024-09-17T18:16:21.354 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.354 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.354 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.354 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 75/31 ECSubWrite(tid=245, reqid=client.4565.0:761, at_version=75'123, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:21.355 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.332843+0000", 2024-09-17T18:16:21.355 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.978571923000001, 2024-09-17T18:16:21.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058092639999999997, 2024-09-17T18:16:21.355 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.355 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.355 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.355 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.332843+0000", 2024-09-17T18:16:21.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.332843+0000", 2024-09-17T18:16:21.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.332844+0000", 2024-09-17T18:16:21.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3e-06 2024-09-17T18:16:21.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.332876+0000", 2024-09-17T18:16:21.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1542999999999999e-05 2024-09-17T18:16:21.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.332892+0000", 2024-09-17T18:16:21.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6382999999999999e-05 2024-09-17T18:16:21.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.332903+0000", 2024-09-17T18:16:21.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1291000000000001e-05 2024-09-17T18:16:21.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.333326+0000", 2024-09-17T18:16:21.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000423118 2024-09-17T18:16:21.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.333340+0000", 2024-09-17T18:16:21.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.413e-05 2024-09-17T18:16:21.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.338597+0000", 2024-09-17T18:16:21.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052569720000000004 2024-09-17T18:16:21.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.338652+0000", 2024-09-17T18:16:21.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4527000000000002e-05 2024-09-17T18:16:21.359 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.359 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.359 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.359 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs5 75/31 ECSubWrite(tid=139, reqid=osd.5.0:139, at_version=75'86, trim_to=0'0, roll_forward_to=72'84))", 2024-09-17T18:16:21.359 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.335070+0000", 2024-09-17T18:16:21.359 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.976344279999999, 2024-09-17T18:16:21.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060897720000000002, 2024-09-17T18:16:21.359 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.360 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.360 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.360 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335070+0000", 2024-09-17T18:16:21.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335070+0000", 2024-09-17T18:16:21.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335071+0000", 2024-09-17T18:16:21.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3099999999999999e-07 2024-09-17T18:16:21.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335094+0000", 2024-09-17T18:16:21.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3705000000000001e-05 2024-09-17T18:16:21.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335107+0000", 2024-09-17T18:16:21.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2682e-05 2024-09-17T18:16:21.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335117+0000", 2024-09-17T18:16:21.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6819999999999998e-06 2024-09-17T18:16:21.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335244+0000", 2024-09-17T18:16:21.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012750200000000001 2024-09-17T18:16:21.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335263+0000", 2024-09-17T18:16:21.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8490000000000001e-05 2024-09-17T18:16:21.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.341115+0000", 2024-09-17T18:16:21.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058520730000000002 2024-09-17T18:16:21.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.341160+0000", 2024-09-17T18:16:21.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5306999999999998e-05 2024-09-17T18:16:21.363 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.364 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.364 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.364 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.5s4 75/31 ECSubWrite(tid=140, reqid=osd.5.0:140, at_version=75'44, trim_to=0'0, roll_forward_to=73'42))", 2024-09-17T18:16:21.364 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.335148+0000", 2024-09-17T18:16:21.364 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.976266719, 2024-09-17T18:16:21.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059582200000000002, 2024-09-17T18:16:21.364 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.364 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.364 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.364 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335148+0000", 2024-09-17T18:16:21.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335148+0000", 2024-09-17T18:16:21.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335149+0000", 2024-09-17T18:16:21.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7599999999999997e-07 2024-09-17T18:16:21.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335170+0000", 2024-09-17T18:16:21.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1163999999999999e-05 2024-09-17T18:16:21.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335184+0000", 2024-09-17T18:16:21.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4105e-05 2024-09-17T18:16:21.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335191+0000", 2024-09-17T18:16:21.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8229999999999997e-06 2024-09-17T18:16:21.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335294+0000", 2024-09-17T18:16:21.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000103663 2024-09-17T18:16:21.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.335308+0000", 2024-09-17T18:16:21.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3628000000000001e-05 2024-09-17T18:16:21.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.341038+0000", 2024-09-17T18:16:21.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057296070000000003 2024-09-17T18:16:21.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.341106+0000", 2024-09-17T18:16:21.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8553999999999994e-05 2024-09-17T18:16:21.368 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.368 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.368 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.369 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 75/31 ECSubWrite(tid=248, reqid=client.4565.0:763, at_version=75'125, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:21.369 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:10.337581+0000", 2024-09-17T18:16:21.369 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.973833491000001, 2024-09-17T18:16:21.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063321280000000002, 2024-09-17T18:16:21.369 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.369 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.369 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.369 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337581+0000", 2024-09-17T18:16:21.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337581+0000", 2024-09-17T18:16:21.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337582+0000", 2024-09-17T18:16:21.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2449999999999999e-06 2024-09-17T18:16:21.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337607+0000", 2024-09-17T18:16:21.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4576999999999999e-05 2024-09-17T18:16:21.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337625+0000", 2024-09-17T18:16:21.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8119999999999999e-05 2024-09-17T18:16:21.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.337641+0000", 2024-09-17T18:16:21.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5427999999999999e-05 2024-09-17T18:16:21.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.338265+0000", 2024-09-17T18:16:21.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00062417199999999999 2024-09-17T18:16:21.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.338287+0000", 2024-09-17T18:16:21.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2493e-05 2024-09-17T18:16:21.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.343771+0000", 2024-09-17T18:16:21.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054841200000000003 2024-09-17T18:16:21.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:10.343913+0000", 2024-09-17T18:16:21.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014197299999999999 2024-09-17T18:16:21.373 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.373 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.373 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.374 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 80/31 ECSubWrite(tid=307, reqid=osd.4.0:307, at_version=80'160, trim_to=0'0, roll_forward_to=79'156))", 2024-09-17T18:16:21.374 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:15.502483+0000", 2024-09-17T18:16:21.374 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.8089318780000001, 2024-09-17T18:16:21.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058507899999999998, 2024-09-17T18:16:21.374 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.374 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.374 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.374 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.502483+0000", 2024-09-17T18:16:21.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.502483+0000", 2024-09-17T18:16:21.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.502483+0000", 2024-09-17T18:16:21.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9200000000000001e-07 2024-09-17T18:16:21.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.502515+0000", 2024-09-17T18:16:21.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.146e-05 2024-09-17T18:16:21.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.502527+0000", 2024-09-17T18:16:21.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.22e-05 2024-09-17T18:16:21.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.502534+0000", 2024-09-17T18:16:21.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5739999999999998e-06 2024-09-17T18:16:21.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.505116+0000", 2024-09-17T18:16:21.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0025813110000000002 2024-09-17T18:16:21.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.505129+0000", 2024-09-17T18:16:21.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2829e-05 2024-09-17T18:16:21.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.508276+0000", 2024-09-17T18:16:21.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031472689999999998 2024-09-17T18:16:21.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:15.508334+0000", 2024-09-17T18:16:21.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7655000000000003e-05 2024-09-17T18:16:21.379 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.379 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.379 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.380 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDPGPush(3.ds5 81/80 [PushOp(3:b017d8c2:::smithi15432074-22:16, version: 77'280, data_included: [262144~151552], data_size: 151552, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:b017d8c2:::smithi15432074-22:16@77'280, size: 1654784, copy_subset: [], clone_subset: {}, snapset: 1c={6: [6], 16: [16, 15, 11, 10, 8, 7]}, object_exist: true), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1654784, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false)),PushOp(3:b554fbc1:::smithi15432074-41:head, version: 72'258, data_included: [262144~262144], data_size: 262144, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:b554fbc1:::smithi15432074-41:head@72'258, size: 3244032, copy_subset: [], clone_subset: {}, snapset: 0={}, object_exist: true), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false)),PushOp(3:b6cee097:::smithi15432074-10:14, version: 77'284, data_included: [262144~225280], data_size: 225280, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:b6cee097:::smithi15432074-10:14@77'284, size: 1949696, copy_subset: [], clone_subset: {}, snapset: 14={6: [6], c: [8, 7], 14: [11, 10]}, object_exist: true), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1949696, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-17T18:16:21.380 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:17.194931+0000", 2024-09-17T18:16:21.380 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.1164833019999998, 2024-09-17T18:16:21.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060449730000000004, 2024-09-17T18:16:21.380 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.380 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.381 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.381 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:17.194931+0000", 2024-09-17T18:16:21.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:17.194931+0000", 2024-09-17T18:16:21.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:17.194932+0000", 2024-09-17T18:16:21.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.133e-06 2024-09-17T18:16:21.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:17.196072+0000", 2024-09-17T18:16:21.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011392450000000001 2024-09-17T18:16:21.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:17.196101+0000", 2024-09-17T18:16:21.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.974e-05 2024-09-17T18:16:21.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:17.196134+0000", 2024-09-17T18:16:21.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2064000000000003e-05 2024-09-17T18:16:21.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:17.197614+0000", 2024-09-17T18:16:21.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0014805910000000001 2024-09-17T18:16:21.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:17.200976+0000", 2024-09-17T18:16:21.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033622000000000001 2024-09-17T18:16:21.388 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.388 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.388 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.389 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 85/82 ECSubWrite(tid=108, reqid=osd.10.0:108, at_version=85'340, trim_to=0'0, roll_forward_to=84'338))", 2024-09-17T18:16:21.389 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:20.332375+0000", 2024-09-17T18:16:21.389 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.97904013499999998, 2024-09-17T18:16:21.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071797019999999996, 2024-09-17T18:16:21.389 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.390 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.390 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.390 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.332375+0000", 2024-09-17T18:16:21.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.332375+0000", 2024-09-17T18:16:21.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.332375+0000", 2024-09-17T18:16:21.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2200000000000004e-07 2024-09-17T18:16:21.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.332415+0000", 2024-09-17T18:16:21.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0269999999999999e-05 2024-09-17T18:16:21.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.332432+0000", 2024-09-17T18:16:21.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7102e-05 2024-09-17T18:16:21.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.332445+0000", 2024-09-17T18:16:21.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2794e-05 2024-09-17T18:16:21.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.332586+0000", 2024-09-17T18:16:21.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014084699999999999 2024-09-17T18:16:21.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.332601+0000", 2024-09-17T18:16:21.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4635e-05 2024-09-17T18:16:21.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.339511+0000", 2024-09-17T18:16:21.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069099909999999999 2024-09-17T18:16:21.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.339554+0000", 2024-09-17T18:16:21.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3541000000000002e-05 2024-09-17T18:16:21.397 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.397 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.397 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.397 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 85/31 ECSubWrite(tid=335, reqid=osd.4.0:335, at_version=85'174, trim_to=0'0, roll_forward_to=84'170))", 2024-09-17T18:16:21.397 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:20.333422+0000", 2024-09-17T18:16:21.397 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.97799279500000003, 2024-09-17T18:16:21.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061140819999999999, 2024-09-17T18:16:21.397 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.397 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.397 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.398 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.333422+0000", 2024-09-17T18:16:21.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.333422+0000", 2024-09-17T18:16:21.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.333423+0000", 2024-09-17T18:16:21.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0020000000000001e-06 2024-09-17T18:16:21.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.333463+0000", 2024-09-17T18:16:21.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0643999999999999e-05 2024-09-17T18:16:21.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.333481+0000", 2024-09-17T18:16:21.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7142999999999998e-05 2024-09-17T18:16:21.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.333494+0000", 2024-09-17T18:16:21.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3023000000000001e-05 2024-09-17T18:16:21.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.335451+0000", 2024-09-17T18:16:21.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019574990000000001 2024-09-17T18:16:21.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.335467+0000", 2024-09-17T18:16:21.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5369000000000001e-05 2024-09-17T18:16:21.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.339473+0000", 2024-09-17T18:16:21.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040068279999999996 2024-09-17T18:16:21.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.339536+0000", 2024-09-17T18:16:21.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2574000000000001e-05 2024-09-17T18:16:21.401 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.401 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.401 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.402 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 85/31 ECSubWrite(tid=340, reqid=osd.4.0:335, at_version=0'0, trim_to=0'0, roll_forward_to=85'174))", 2024-09-17T18:16:21.402 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:20.366394+0000", 2024-09-17T18:16:21.402 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.945020419, 2024-09-17T18:16:21.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071363800000000003, 2024-09-17T18:16:21.402 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.402 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.402 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.402 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.366394+0000", 2024-09-17T18:16:21.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.366394+0000", 2024-09-17T18:16:21.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.366396+0000", 2024-09-17T18:16:21.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4810000000000001e-06 2024-09-17T18:16:21.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.366409+0000", 2024-09-17T18:16:21.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3548e-05 2024-09-17T18:16:21.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.366426+0000", 2024-09-17T18:16:21.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7187999999999999e-05 2024-09-17T18:16:21.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.366438+0000", 2024-09-17T18:16:21.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1403000000000001e-05 2024-09-17T18:16:21.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.366525+0000", 2024-09-17T18:16:21.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7074e-05 2024-09-17T18:16:21.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.366538+0000", 2024-09-17T18:16:21.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3521e-05 2024-09-17T18:16:21.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.373491+0000", 2024-09-17T18:16:21.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069526910000000004 2024-09-17T18:16:21.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.373531+0000", 2024-09-17T18:16:21.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9474000000000002e-05 2024-09-17T18:16:21.409 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.409 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.409 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.409 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.cs5 85/31 ECSubWrite(tid=183, reqid=osd.5.0:183, at_version=85'110, trim_to=0'0, roll_forward_to=85'108))", 2024-09-17T18:16:21.409 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:20.367102+0000", 2024-09-17T18:16:21.409 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.94431216100000004, 2024-09-17T18:16:21.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0067931780000000004, 2024-09-17T18:16:21.409 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.409 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.409 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.409 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.367102+0000", 2024-09-17T18:16:21.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.367102+0000", 2024-09-17T18:16:21.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.367103+0000", 2024-09-17T18:16:21.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0699999999999996e-07 2024-09-17T18:16:21.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.367125+0000", 2024-09-17T18:16:21.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1704000000000001e-05 2024-09-17T18:16:21.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.367137+0000", 2024-09-17T18:16:21.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1787000000000001e-05 2024-09-17T18:16:21.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.367145+0000", 2024-09-17T18:16:21.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5040000000000002e-06 2024-09-17T18:16:21.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.367227+0000", 2024-09-17T18:16:21.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2086e-05 2024-09-17T18:16:21.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.367241+0000", 2024-09-17T18:16:21.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3618000000000001e-05 2024-09-17T18:16:21.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.373861+0000", 2024-09-17T18:16:21.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006619532 2024-09-17T18:16:21.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.373896+0000", 2024-09-17T18:16:21.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5139999999999999e-05 2024-09-17T18:16:21.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.414 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.414 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 85/31 ECSubWrite(tid=341, reqid=osd.4.0:341, at_version=85'176, trim_to=0'0, roll_forward_to=85'174))", 2024-09-17T18:16:21.414 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:20.368526+0000", 2024-09-17T18:16:21.414 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.94288887399999999, 2024-09-17T18:16:21.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056084639999999996, 2024-09-17T18:16:21.414 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.414 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.414 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.414 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.368526+0000", 2024-09-17T18:16:21.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.368526+0000", 2024-09-17T18:16:21.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.368527+0000", 2024-09-17T18:16:21.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.291e-06 2024-09-17T18:16:21.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.368561+0000", 2024-09-17T18:16:21.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3569999999999999e-05 2024-09-17T18:16:21.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.368580+0000", 2024-09-17T18:16:21.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9473000000000001e-05 2024-09-17T18:16:21.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.368591+0000", 2024-09-17T18:16:21.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0739e-05 2024-09-17T18:16:21.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.368664+0000", 2024-09-17T18:16:21.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3176999999999994e-05 2024-09-17T18:16:21.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.368674+0000", 2024-09-17T18:16:21.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7280000000000007e-06 2024-09-17T18:16:21.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.374096+0000", 2024-09-17T18:16:21.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054221670000000003 2024-09-17T18:16:21.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.374134+0000", 2024-09-17T18:16:21.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8318999999999997e-05 2024-09-17T18:16:21.419 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.419 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.419 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.419 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.bs3 85/31 ECSubWrite(tid=342, reqid=osd.4.0:342, at_version=85'178, trim_to=0'0, roll_forward_to=85'174))", 2024-09-17T18:16:21.419 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:20.369648+0000", 2024-09-17T18:16:21.419 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.94176657900000005, 2024-09-17T18:16:21.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065658699999999997, 2024-09-17T18:16:21.419 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.419 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.419 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.420 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.369648+0000", 2024-09-17T18:16:21.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.369648+0000", 2024-09-17T18:16:21.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.369649+0000", 2024-09-17T18:16:21.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7000000000000003e-07 2024-09-17T18:16:21.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.369675+0000", 2024-09-17T18:16:21.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6336e-05 2024-09-17T18:16:21.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.369690+0000", 2024-09-17T18:16:21.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4263e-05 2024-09-17T18:16:21.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.369700+0000", 2024-09-17T18:16:21.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.011e-05 2024-09-17T18:16:21.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.370885+0000", 2024-09-17T18:16:21.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011851450000000001 2024-09-17T18:16:21.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.370893+0000", 2024-09-17T18:16:21.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7640000000000005e-06 2024-09-17T18:16:21.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.376173+0000", 2024-09-17T18:16:21.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052805619999999999 2024-09-17T18:16:21.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.376214+0000", 2024-09-17T18:16:21.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0720000000000003e-05 2024-09-17T18:16:21.423 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.423 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.423 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.424 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "MOSDECSubOpWrite(3.ds5 85/82 ECSubWrite(tid=114, reqid=osd.10.0:114, at_version=85'346, trim_to=0'0, roll_forward_to=85'342))", 2024-09-17T18:16:21.424 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-17T18:16:20.372374+0000", 2024-09-17T18:16:21.424 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.93904077200000002, 2024-09-17T18:16:21.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006789008, 2024-09-17T18:16:21.424 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-17T18:16:21.424 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-17T18:16:21.424 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.424 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-17T18:16:21.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-17T18:16:21.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.372374+0000", 2024-09-17T18:16:21.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-17T18:16:21.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.372374+0000", 2024-09-17T18:16:21.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-17T18:16:21.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-17T18:16:21.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.372375+0000", 2024-09-17T18:16:21.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2389999999999999e-06 2024-09-17T18:16:21.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-17T18:16:21.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.372399+0000", 2024-09-17T18:16:21.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3825e-05 2024-09-17T18:16:21.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-17T18:16:21.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.372414+0000", 2024-09-17T18:16:21.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5089000000000001e-05 2024-09-17T18:16:21.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.372432+0000", 2024-09-17T18:16:21.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7788e-05 2024-09-17T18:16:21.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-17T18:16:21.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.372491+0000", 2024-09-17T18:16:21.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9416000000000002e-05 2024-09-17T18:16:21.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.372501+0000", 2024-09-17T18:16:21.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6169999999999996e-06 2024-09-17T18:16:21.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.379111+0000", 2024-09-17T18:16:21.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066098390000000002 2024-09-17T18:16:21.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:21.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:21.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-17T18:16:21.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-17T18:16:20.379163+0000", 2024-09-17T18:16:21.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2194999999999997e-05 2024-09-17T18:16:21.428 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.428 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.428 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.428 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:21.428 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:21.428 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:21.430 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T18:16:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:nodeep-scrub is unset 2024-09-17T18:16:21.435 INFO:tasks.rados.rados.0.smithi154.stdout:362: done (6 left) 2024-09-17T18:16:21.435 INFO:tasks.rados.rados.0.smithi154.stdout:363: rmattr oid 14 current snap is 30 2024-09-17T18:16:21.436 INFO:tasks.rados.rados.0.smithi154.stdout:356: finishing write tid 2 to smithi15432074-48 2024-09-17T18:16:21.436 INFO:tasks.rados.rados.0.smithi154.stdout:356: finishing write tid 3 to smithi15432074-48 2024-09-17T18:16:21.436 INFO:tasks.rados.rados.0.smithi154.stdout:356: oid 48 updating version 0 to 153 2024-09-17T18:16:21.436 INFO:tasks.rados.rados.0.smithi154.stdout:356: oid 48 version 153 is already newer than 152 2024-09-17T18:16:21.436 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 48 v 153 (ObjNum 145 snap 30 seq_num 145) dirty exists 2024-09-17T18:16:21.436 INFO:tasks.rados.rados.0.smithi154.stdout:356: left oid 48 (ObjNum 145 snap 30 seq_num 145) 2024-09-17T18:16:21.436 INFO:tasks.rados.rados.0.smithi154.stdout:358: finishing rollback tid 0 to smithi15432074-2 2024-09-17T18:16:21.436 INFO:tasks.rados.rados.0.smithi154.stdout:353: finishing copy_from racing read to smithi15432074-15 2024-09-17T18:16:21.436 INFO:tasks.rados.rados.0.smithi154.stdout:358: finishing rollback tid 1 to smithi15432074-2 2024-09-17T18:16:21.436 INFO:tasks.rados.rados.0.smithi154.stdout:358: finishing rollback tid 2 to smithi15432074-2 2024-09-17T18:16:21.436 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 2 v 358 (ObjNum 92 snap 15 seq_num 92) dirty exists 2024-09-17T18:16:21.436 INFO:tasks.rados.rados.0.smithi154.stdout:353: finishing copy_from to smithi15432074-15 2024-09-17T18:16:21.437 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 15 v 27 (ObjNum 109 snap 23 seq_num 109) dirty exists 2024-09-17T18:16:21.437 INFO:tasks.rados.rados.0.smithi154.stdout:359: finishing write tid 1 to smithi15432074-37 2024-09-17T18:16:21.437 INFO:tasks.rados.rados.0.smithi154.stdout:359: finishing write tid 2 to smithi15432074-37 2024-09-17T18:16:21.437 INFO:tasks.rados.rados.0.smithi154.stdout:360: finishing write tid 1 to smithi15432074-19 2024-09-17T18:16:21.437 INFO:tasks.rados.rados.0.smithi154.stdout:361: finishing rollback tid 0 to smithi15432074-23 2024-09-17T18:16:21.437 INFO:tasks.rados.rados.0.smithi154.stdout:360: finishing write tid 2 to smithi15432074-19 2024-09-17T18:16:21.437 INFO:tasks.rados.rados.0.smithi154.stdout:361: finishing rollback tid 1 to smithi15432074-23 2024-09-17T18:16:21.437 INFO:tasks.rados.rados.0.smithi154.stdout:359: finishing write tid 3 to smithi15432074-37 2024-09-17T18:16:21.437 INFO:tasks.rados.rados.0.smithi154.stdout:359: oid 37 updating version 0 to 360 2024-09-17T18:16:21.437 INFO:tasks.rados.rados.0.smithi154.stdout:359: oid 37 updating version 360 to 361 2024-09-17T18:16:21.437 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 37 v 361 (ObjNum 146 snap 30 seq_num 146) dirty exists 2024-09-17T18:16:21.437 INFO:tasks.rados.rados.0.smithi154.stdout:359: left oid 37 (ObjNum 146 snap 30 seq_num 146) 2024-09-17T18:16:21.438 INFO:tasks.rados.rados.0.smithi154.stdout:361: finishing rollback tid 2 to smithi15432074-23 2024-09-17T18:16:21.438 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 23 v 85 (ObjNum 97 snap 16 seq_num 97) dirty exists 2024-09-17T18:16:21.438 INFO:tasks.rados.rados.0.smithi154.stdout:360: finishing write tid 3 to smithi15432074-19 2024-09-17T18:16:21.438 INFO:tasks.rados.rados.0.smithi154.stdout:360: oid 19 updating version 0 to 116 2024-09-17T18:16:21.438 INFO:tasks.rados.rados.0.smithi154.stdout:360: oid 19 updating version 116 to 117 2024-09-17T18:16:21.438 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 19 v 117 (ObjNum 147 snap 30 seq_num 147) dirty exists 2024-09-17T18:16:21.438 INFO:tasks.rados.rados.0.smithi154.stdout:360: left oid 19 (ObjNum 147 snap 30 seq_num 147) 2024-09-17T18:16:21.438 INFO:tasks.rados.rados.0.smithi154.stdout:353: done (6 left) 2024-09-17T18:16:21.438 INFO:tasks.rados.rados.0.smithi154.stdout:356: done (5 left) 2024-09-17T18:16:21.438 INFO:tasks.rados.rados.0.smithi154.stdout:358: done (4 left) 2024-09-17T18:16:21.438 INFO:tasks.rados.rados.0.smithi154.stdout:359: done (3 left) 2024-09-17T18:16:21.438 INFO:tasks.rados.rados.0.smithi154.stdout:360: done (2 left) 2024-09-17T18:16:21.439 INFO:tasks.rados.rados.0.smithi154.stdout:361: done (1 left) 2024-09-17T18:16:21.439 INFO:tasks.rados.rados.0.smithi154.stdout:364: rollback oid 26 current snap is 30 2024-09-17T18:16:21.439 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 26 to 26 2024-09-17T18:16:21.439 INFO:tasks.rados.rados.0.smithi154.stdout:365: read oid 41 snap 29 2024-09-17T18:16:21.439 INFO:tasks.rados.rados.0.smithi154.stdout:365: expect (ObjNum 94 snap 15 seq_num 94) 2024-09-17T18:16:21.439 INFO:tasks.rados.rados.0.smithi154.stdout:366: setattr oid 27 current snap is 30 2024-09-17T18:16:21.439 INFO:tasks.rados.rados.0.smithi154.stdout:367: rollback oid 10 current snap is 30 2024-09-17T18:16:21.439 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 10 to 20 2024-09-17T18:16:21.439 INFO:tasks.rados.rados.0.smithi154.stdout:368: read oid 21 snap 26 2024-09-17T18:16:21.439 INFO:tasks.rados.rados.0.smithi154.stdout:368: expect deleted 2024-09-17T18:16:21.439 INFO:tasks.rados.rados.0.smithi154.stdout:369: read oid 19 snap 27 2024-09-17T18:16:21.439 INFO:tasks.rados.rados.0.smithi154.stdout:369: expect (ObjNum 3 snap 0 seq_num 3) 2024-09-17T18:16:21.439 INFO:tasks.rados.rados.0.smithi154.stdout:370: delete oid 47 current snap is 30 2024-09-17T18:16:21.439 INFO:tasks.rados.rados.0.smithi154.stdout:368: done (7 left) 2024-09-17T18:16:21.440 INFO:tasks.rados.rados.0.smithi154.stdout:370: done (6 left) 2024-09-17T18:16:21.440 INFO:tasks.rados.rados.0.smithi154.stdout:371: copy_from oid 47 from oid 48 current snap is 30 2024-09-17T18:16:21.440 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 49 current snap is 30 2024-09-17T18:16:21.440 INFO:tasks.rados.rados.0.smithi154.stdout:372: seq_num 149 ranges {5505024=98304} 2024-09-17T18:16:21.440 INFO:tasks.rados.rados.0.smithi154.stdout:372: writing smithi15432074-49 from 5505024 to 5603328 tid 1 2024-09-17T18:16:21.440 INFO:tasks.rados.rados.0.smithi154.stdout:373: rollback oid 17 current snap is 30 2024-09-17T18:16:21.440 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 17 to 29 2024-09-17T18:16:21.440 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 14 v 44 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-09-17T18:16:21.440 INFO:tasks.rados.rados.0.smithi154.stdout:363: done (8 left) 2024-09-17T18:16:21.440 INFO:tasks.rados.rados.0.smithi154.stdout:374: read oid 43 snap -1 2024-09-17T18:16:21.440 INFO:tasks.rados.rados.0.smithi154.stdout:374: expect (ObjNum 78 snap 7 seq_num 78) 2024-09-17T18:16:21.440 INFO:tasks.rados.rados.0.smithi154.stdout:375: read oid 46 snap -1 2024-09-17T18:16:21.441 INFO:tasks.rados.rados.0.smithi154.stdout:375: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-17T18:16:21.441 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 6 current snap is 30 2024-09-17T18:16:21.441 INFO:tasks.rados.rados.0.smithi154.stdout:369: expect (ObjNum 3 snap 0 seq_num 3) 2024-09-17T18:16:21.441 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:21.441 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:21.441 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 31772 2024-09-17T18:16:21.441 INFO:tasks.rados.rados.0.smithi154.stdout:364: finishing rollback tid 0 to smithi15432074-26 2024-09-17T18:16:21.441 INFO:tasks.rados.rados.0.smithi154.stdout:364: finishing rollback tid 1 to smithi15432074-26 2024-09-17T18:16:21.441 INFO:tasks.rados.rados.0.smithi154.stdout:364: finishing rollback tid 2 to smithi15432074-26 2024-09-17T18:16:21.441 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 26 v 75 (ObjNum 87 snap 14 seq_num 87) dirty exists 2024-09-17T18:16:21.441 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 27 v 159 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-09-17T18:16:21.441 INFO:tasks.rados.rados.0.smithi154.stdout:371: finishing copy_from racing read to smithi15432074-47 2024-09-17T18:16:21.442 INFO:tasks.rados.rados.0.smithi154.stdout:365: expect (ObjNum 94 snap 15 seq_num 94) 2024-09-17T18:16:21.442 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:21.442 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:21.425+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:21.495 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1956867 2024-09-17T18:16:21.526 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 2910104 2024-09-17T18:16:21.530 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:21.525+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:21.532 INFO:tasks.rados.rados.0.smithi154.stdout:371: finishing copy_from to smithi15432074-47 2024-09-17T18:16:21.532 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 47 v 153 (ObjNum 145 snap 30 seq_num 145) dirty exists 2024-09-17T18:16:21.532 INFO:tasks.rados.rados.0.smithi154.stdout:367: finishing rollback tid 0 to smithi15432074-10 2024-09-17T18:16:21.532 INFO:tasks.rados.rados.0.smithi154.stdout:367: finishing rollback tid 1 to smithi15432074-10 2024-09-17T18:16:21.533 INFO:tasks.rados.rados.0.smithi154.stdout:367: finishing rollback tid 2 to smithi15432074-10 2024-09-17T18:16:21.533 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 10 v 369 (ObjNum 80 snap 11 seq_num 80) dirty exists 2024-09-17T18:16:21.533 INFO:tasks.rados.rados.0.smithi154.stdout:375: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-17T18:16:21.535 INFO:tasks.rados.rados.0.smithi154.stdout:373: finishing rollback tid 0 to smithi15432074-17 2024-09-17T18:16:21.535 INFO:tasks.rados.rados.0.smithi154.stdout:373: finishing rollback tid 1 to smithi15432074-17 2024-09-17T18:16:21.535 INFO:tasks.rados.rados.0.smithi154.stdout:373: finishing rollback tid 2 to smithi15432074-17 2024-09-17T18:16:21.536 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 17 v 256 (ObjNum 98 snap 17 seq_num 98) dirty exists 2024-09-17T18:16:21.536 INFO:tasks.rados.rados.0.smithi154.stdout:374: expect (ObjNum 78 snap 7 seq_num 78) 2024-09-17T18:16:21.544 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1692548 2024-09-17T18:16:21.550 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 426349 2024-09-17T18:16:21.569 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:21.569 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:21.570 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:16:21.570 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:21.570 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 398029 2024-09-17T18:16:21.583 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T18:16:21.588 INFO:tasks.rados.rados.0.smithi154.stdout:372: finishing write tid 1 to smithi15432074-49 2024-09-17T18:16:21.588 INFO:tasks.rados.rados.0.smithi154.stdout:372: finishing write tid 2 to smithi15432074-49 2024-09-17T18:16:21.588 INFO:tasks.rados.rados.0.smithi154.stdout:372: finishing write tid 3 to smithi15432074-49 2024-09-17T18:16:21.588 INFO:tasks.rados.rados.0.smithi154.stdout:372: oid 49 updating version 0 to 112 2024-09-17T18:16:21.588 INFO:tasks.rados.rados.0.smithi154.stdout:372: oid 49 updating version 112 to 113 2024-09-17T18:16:21.588 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 49 v 113 (ObjNum 149 snap 30 seq_num 149) dirty exists 2024-09-17T18:16:21.588 INFO:tasks.rados.rados.0.smithi154.stdout:372: left oid 49 (ObjNum 149 snap 30 seq_num 149) 2024-09-17T18:16:21.588 INFO:tasks.rados.rados.0.smithi154.stdout:376: seq_num 150 ranges {98304=114688} 2024-09-17T18:16:21.591 INFO:tasks.rados.rados.0.smithi154.stdout:376: writing smithi15432074-6 from 98304 to 212992 tid 1 2024-09-17T18:16:21.591 INFO:tasks.rados.rados.0.smithi154.stdout:364: done (10 left) 2024-09-17T18:16:21.591 INFO:tasks.rados.rados.0.smithi154.stdout:365: done (9 left) 2024-09-17T18:16:21.591 INFO:tasks.rados.rados.0.smithi154.stdout:366: done (8 left) 2024-09-17T18:16:21.592 INFO:tasks.rados.rados.0.smithi154.stdout:367: done (7 left) 2024-09-17T18:16:21.592 INFO:tasks.rados.rados.0.smithi154.stdout:369: done (6 left) 2024-09-17T18:16:21.592 INFO:tasks.rados.rados.0.smithi154.stdout:371: done (5 left) 2024-09-17T18:16:21.592 INFO:tasks.rados.rados.0.smithi154.stdout:372: done (4 left) 2024-09-17T18:16:21.592 INFO:tasks.rados.rados.0.smithi154.stdout:373: done (3 left) 2024-09-17T18:16:21.592 INFO:tasks.rados.rados.0.smithi154.stdout:374: done (2 left) 2024-09-17T18:16:21.592 INFO:tasks.rados.rados.0.smithi154.stdout:375: done (1 left) 2024-09-17T18:16:21.592 INFO:tasks.rados.rados.0.smithi154.stdout:377: snap_create 2024-09-17T18:16:21.598 INFO:tasks.rados.rados.0.smithi154.stdout:376: finishing write tid 1 to smithi15432074-6 2024-09-17T18:16:21.598 INFO:tasks.rados.rados.0.smithi154.stdout:376: finishing write tid 2 to smithi15432074-6 2024-09-17T18:16:21.602 INFO:tasks.rados.rados.0.smithi154.stdout:376: finishing write tid 3 to smithi15432074-6 2024-09-17T18:16:21.602 INFO:tasks.rados.rados.0.smithi154.stdout:376: oid 6 updating version 0 to 384 2024-09-17T18:16:21.602 INFO:tasks.rados.rados.0.smithi154.stdout:376: oid 6 version 384 is already newer than 383 2024-09-17T18:16:21.602 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 6 v 384 (ObjNum 150 snap 30 seq_num 150) dirty exists 2024-09-17T18:16:21.603 INFO:tasks.rados.rados.0.smithi154.stdout:376: left oid 6 (ObjNum 150 snap 30 seq_num 150) 2024-09-17T18:16:21.631 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:21.629+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:21.703 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:21.704 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:21.704 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:16:21.704 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:16:21.704 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:21.717 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T18:16:21.760 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:16:21.757+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:16:21.833 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:21.829+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:21.838 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:21.838 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:16:21.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:16:21.838 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:16:21.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.838 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 75/31 ECSubWrite(tid=245, reqid=client.4565.0:761, at_version=75'123, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:21.838 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.337231+0000", 2024-09-17T18:16:21.838 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.496904914, 2024-09-17T18:16:21.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020931967999999999, 2024-09-17T18:16:21.838 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.838 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.839 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.839 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337231+0000", 2024-09-17T18:16:21.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337231+0000", 2024-09-17T18:16:21.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337233+0000", 2024-09-17T18:16:21.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1670000000000002e-06 2024-09-17T18:16:21.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337289+0000", 2024-09-17T18:16:21.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5639e-05 2024-09-17T18:16:21.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337328+0000", 2024-09-17T18:16:21.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8955000000000002e-05 2024-09-17T18:16:21.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337353+0000", 2024-09-17T18:16:21.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5100999999999999e-05 2024-09-17T18:16:21.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337531+0000", 2024-09-17T18:16:21.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000177694 2024-09-17T18:16:21.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337560+0000", 2024-09-17T18:16:21.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9482e-05 2024-09-17T18:16:21.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.358060+0000", 2024-09-17T18:16:21.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020499864 2024-09-17T18:16:21.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.358163+0000", 2024-09-17T18:16:21.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010306600000000001 2024-09-17T18:16:21.844 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.844 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.844 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.844 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 75/31 ECSubWrite(tid=247, reqid=client.4565.0:762, at_version=75'124, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:21.844 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.337404+0000", 2024-09-17T18:16:21.844 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.496732302, 2024-09-17T18:16:21.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026944722000000001, 2024-09-17T18:16:21.845 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.845 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.845 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.845 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337404+0000", 2024-09-17T18:16:21.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337404+0000", 2024-09-17T18:16:21.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337405+0000", 2024-09-17T18:16:21.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1999999999999999e-06 2024-09-17T18:16:21.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337488+0000", 2024-09-17T18:16:21.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3294000000000006e-05 2024-09-17T18:16:21.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337517+0000", 2024-09-17T18:16:21.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8761000000000001e-05 2024-09-17T18:16:21.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337540+0000", 2024-09-17T18:16:21.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3538999999999999e-05 2024-09-17T18:16:21.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.340275+0000", 2024-09-17T18:16:21.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002734429 2024-09-17T18:16:21.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.340294+0000", 2024-09-17T18:16:21.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9286000000000001e-05 2024-09-17T18:16:21.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364261+0000", 2024-09-17T18:16:21.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023966794999999999 2024-09-17T18:16:21.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364348+0000", 2024-09-17T18:16:21.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7417999999999995e-05 2024-09-17T18:16:21.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.849 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.849 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 75/31 ECSubWrite(tid=248, reqid=client.4565.0:763, at_version=75'125, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:21.849 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.337574+0000", 2024-09-17T18:16:21.849 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.496562311, 2024-09-17T18:16:21.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026838753, 2024-09-17T18:16:21.850 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.850 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.850 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.850 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337574+0000", 2024-09-17T18:16:21.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337574+0000", 2024-09-17T18:16:21.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337575+0000", 2024-09-17T18:16:21.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0270000000000001e-06 2024-09-17T18:16:21.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337618+0000", 2024-09-17T18:16:21.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3059999999999998e-05 2024-09-17T18:16:21.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337639+0000", 2024-09-17T18:16:21.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1426000000000001e-05 2024-09-17T18:16:21.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337657+0000", 2024-09-17T18:16:21.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7812000000000002e-05 2024-09-17T18:16:21.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.351067+0000", 2024-09-17T18:16:21.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013410131 2024-09-17T18:16:21.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.351093+0000", 2024-09-17T18:16:21.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-17T18:16:21.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364357+0000", 2024-09-17T18:16:21.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013263079000000001 2024-09-17T18:16:21.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364412+0000", 2024-09-17T18:16:21.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5813000000000002e-05 2024-09-17T18:16:21.854 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.854 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.854 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.855 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 75/31 ECSubWrite(tid=180, reqid=osd.6.0:180, at_version=75'64, trim_to=0'0, roll_forward_to=73'60))", 2024-09-17T18:16:21.855 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.338219+0000", 2024-09-17T18:16:21.855 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.495916976, 2024-09-17T18:16:21.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025663440999999999, 2024-09-17T18:16:21.855 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.855 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.855 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.855 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.338219+0000", 2024-09-17T18:16:21.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.338219+0000", 2024-09-17T18:16:21.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.338220+0000", 2024-09-17T18:16:21.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9999999999999995e-07 2024-09-17T18:16:21.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.338260+0000", 2024-09-17T18:16:21.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0377999999999999e-05 2024-09-17T18:16:21.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.338282+0000", 2024-09-17T18:16:21.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1661000000000001e-05 2024-09-17T18:16:21.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.338299+0000", 2024-09-17T18:16:21.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6895999999999999e-05 2024-09-17T18:16:21.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.340926+0000", 2024-09-17T18:16:21.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026275169999999998 2024-09-17T18:16:21.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.340963+0000", 2024-09-17T18:16:21.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6284e-05 2024-09-17T18:16:21.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.363741+0000", 2024-09-17T18:16:21.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022777954999999999 2024-09-17T18:16:21.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.363882+0000", 2024-09-17T18:16:21.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014175 2024-09-17T18:16:21.860 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.860 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.860 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 75/31 ECSubWrite(tid=519, reqid=osd.13.0:519, at_version=75'170, trim_to=0'0, roll_forward_to=73'168))", 2024-09-17T18:16:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.339069+0000", 2024-09-17T18:16:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.495066554999999, 2024-09-17T18:16:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024986121, 2024-09-17T18:16:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339069+0000", 2024-09-17T18:16:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339069+0000", 2024-09-17T18:16:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339070+0000", 2024-09-17T18:16:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1999999999999999e-07 2024-09-17T18:16:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339120+0000", 2024-09-17T18:16:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0197000000000001e-05 2024-09-17T18:16:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339150+0000", 2024-09-17T18:16:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9873999999999999e-05 2024-09-17T18:16:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339185+0000", 2024-09-17T18:16:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4578e-05 2024-09-17T18:16:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339350+0000", 2024-09-17T18:16:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016585800000000001 2024-09-17T18:16:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339376+0000", 2024-09-17T18:16:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5655000000000001e-05 2024-09-17T18:16:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.363994+0000", 2024-09-17T18:16:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024617587999999999 2024-09-17T18:16:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364055+0000", 2024-09-17T18:16:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1750999999999999e-05 2024-09-17T18:16:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 75/31 ECSubWrite(tid=249, reqid=client.4565.0:764, at_version=75'126, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.340585+0000", 2024-09-17T18:16:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.493550717, 2024-09-17T18:16:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023897931000000001, 2024-09-17T18:16:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.340585+0000", 2024-09-17T18:16:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.340585+0000", 2024-09-17T18:16:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.340587+0000", 2024-09-17T18:16:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.029e-06 2024-09-17T18:16:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341053+0000", 2024-09-17T18:16:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046546199999999998 2024-09-17T18:16:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341164+0000", 2024-09-17T18:16:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011100200000000001 2024-09-17T18:16:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341188+0000", 2024-09-17T18:16:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4125e-05 2024-09-17T18:16:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.351772+0000", 2024-09-17T18:16:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010583785 2024-09-17T18:16:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.351801+0000", 2024-09-17T18:16:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9348000000000001e-05 2024-09-17T18:16:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364418+0000", 2024-09-17T18:16:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012616571 2024-09-17T18:16:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364483+0000", 2024-09-17T18:16:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5609000000000002e-05 2024-09-17T18:16:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s3 75/31 ECSubWrite(tid=54, reqid=osd.14.0:54, at_version=75'48, trim_to=0'0, roll_forward_to=73'46))", 2024-09-17T18:16:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.341346+0000", 2024-09-17T18:16:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.492790141, 2024-09-17T18:16:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022638376000000002, 2024-09-17T18:16:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341346+0000", 2024-09-17T18:16:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341346+0000", 2024-09-17T18:16:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341346+0000", 2024-09-17T18:16:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4700000000000001e-07 2024-09-17T18:16:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341411+0000", 2024-09-17T18:16:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4498999999999994e-05 2024-09-17T18:16:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341437+0000", 2024-09-17T18:16:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6095e-05 2024-09-17T18:16:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341469+0000", 2024-09-17T18:16:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1918000000000002e-05 2024-09-17T18:16:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341608+0000", 2024-09-17T18:16:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013927000000000001 2024-09-17T18:16:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341635+0000", 2024-09-17T18:16:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6308e-05 2024-09-17T18:16:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.363901+0000", 2024-09-17T18:16:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022266411 2024-09-17T18:16:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.363984+0000", 2024-09-17T18:16:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3227999999999997e-05 2024-09-17T18:16:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 75/31 ECSubWrite(tid=520, reqid=osd.13.0:520, at_version=75'267, trim_to=0'0, roll_forward_to=73'265))", 2024-09-17T18:16:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.343521+0000", 2024-09-17T18:16:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.490615045, 2024-09-17T18:16:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020513732, 2024-09-17T18:16:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343521+0000", 2024-09-17T18:16:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343521+0000", 2024-09-17T18:16:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343524+0000", 2024-09-17T18:16:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7690000000000001e-06 2024-09-17T18:16:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343579+0000", 2024-09-17T18:16:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5677000000000002e-05 2024-09-17T18:16:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343614+0000", 2024-09-17T18:16:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4539999999999998e-05 2024-09-17T18:16:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343639+0000", 2024-09-17T18:16:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4969000000000001e-05 2024-09-17T18:16:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343852+0000", 2024-09-17T18:16:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000213258 2024-09-17T18:16:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343880+0000", 2024-09-17T18:16:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7484999999999999e-05 2024-09-17T18:16:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.363937+0000", 2024-09-17T18:16:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020057760000000001 2024-09-17T18:16:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364035+0000", 2024-09-17T18:16:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7274000000000004e-05 2024-09-17T18:16:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 75/31 ECSubWrite(tid=250, reqid=client.4565.0:765, at_version=75'127, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.343833+0000", 2024-09-17T18:16:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.490303017, 2024-09-17T18:16:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020738876999999999, 2024-09-17T18:16:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343833+0000", 2024-09-17T18:16:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343833+0000", 2024-09-17T18:16:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343841+0000", 2024-09-17T18:16:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3489999999999992e-06 2024-09-17T18:16:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.344201+0000", 2024-09-17T18:16:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00035977200000000001 2024-09-17T18:16:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.344239+0000", 2024-09-17T18:16:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7963999999999998e-05 2024-09-17T18:16:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.344259+0000", 2024-09-17T18:16:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0482000000000001e-05 2024-09-17T18:16:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.353501+0000", 2024-09-17T18:16:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092414249999999993 2024-09-17T18:16:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.353526+0000", 2024-09-17T18:16:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5182e-05 2024-09-17T18:16:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364512+0000", 2024-09-17T18:16:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010986278 2024-09-17T18:16:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364572+0000", 2024-09-17T18:16:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9425000000000001e-05 2024-09-17T18:16:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(osd.10.22:1 3.ds1 3:bae030be:::smithi15432074-12:head [assert-version v82,copy-get max 8388608] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-17T18:16:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.493174+0000", 2024-09-17T18:16:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.3409620560000004, 2024-09-17T18:16:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.471630424, 2024-09-17T18:16:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493174+0000", 2024-09-17T18:16:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493174+0000", 2024-09-17T18:16:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493178+0000", 2024-09-17T18:16:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2270000000000004e-06 2024-09-17T18:16:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493195+0000", 2024-09-17T18:16:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6769000000000002e-05 2024-09-17T18:16:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493244+0000", 2024-09-17T18:16:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8900000000000003e-05 2024-09-17T18:16:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493269+0000", 2024-09-17T18:16:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4936e-05 2024-09-17T18:16:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493462+0000", 2024-09-17T18:16:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019376500000000001 2024-09-17T18:16:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493485+0000", 2024-09-17T18:16:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2078000000000001e-05 2024-09-17T18:16:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.501833+0000", 2024-09-17T18:16:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083483529999999993 2024-09-17T18:16:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-17T18:16:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.501838+0000", 2024-09-17T18:16:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.293e-06 2024-09-17T18:16:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.938624+0000", 2024-09-17T18:16:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4367860379999999 2024-09-17T18:16:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.939089+0000", 2024-09-17T18:16:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046498500000000001 2024-09-17T18:16:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.964804+0000", 2024-09-17T18:16:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025715080000000001 2024-09-17T18:16:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:866 3.ds1 3:b4393ba6:::smithi15432074-18:head [read 0~2179072,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-17T18:16:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.501981+0000", 2024-09-17T18:16:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.3321550269999998, 2024-09-17T18:16:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4713632839999999, 2024-09-17T18:16:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 866 2024-09-17T18:16:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.501981+0000", 2024-09-17T18:16:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.501981+0000", 2024-09-17T18:16:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.501984+0000", 2024-09-17T18:16:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4460000000000001e-06 2024-09-17T18:16:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.501998+0000", 2024-09-17T18:16:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4015999999999999e-05 2024-09-17T18:16:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502031+0000", 2024-09-17T18:16:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2721000000000001e-05 2024-09-17T18:16:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502053+0000", 2024-09-17T18:16:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1948999999999999e-05 2024-09-17T18:16:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502310+0000", 2024-09-17T18:16:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025703100000000001 2024-09-17T18:16:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-17T18:16:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502315+0000", 2024-09-17T18:16:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7500000000000003e-06 2024-09-17T18:16:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.947111+0000", 2024-09-17T18:16:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.444795864 2024-09-17T18:16:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.947940+0000", 2024-09-17T18:16:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00082896499999999998 2024-09-17T18:16:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.973344+0000", 2024-09-17T18:16:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025404541999999999 2024-09-17T18:16:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:867 3.ds1 3:b4393ba6:::smithi15432074-18:head [read 1912030~267042,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-17T18:16:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.502112+0000", 2024-09-17T18:16:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.332023629, 2024-09-17T18:16:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4743501290000001, 2024-09-17T18:16:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 867 2024-09-17T18:16:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502112+0000", 2024-09-17T18:16:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502112+0000", 2024-09-17T18:16:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502114+0000", 2024-09-17T18:16:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.66e-06 2024-09-17T18:16:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502124+0000", 2024-09-17T18:16:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5629999999999998e-06 2024-09-17T18:16:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502145+0000", 2024-09-17T18:16:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1671999999999999e-05 2024-09-17T18:16:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502162+0000", 2024-09-17T18:16:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7246000000000001e-05 2024-09-17T18:16:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503001+0000", 2024-09-17T18:16:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00083880900000000004 2024-09-17T18:16:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-17T18:16:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503006+0000", 2024-09-17T18:16:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-09-17T18:16:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.948752+0000", 2024-09-17T18:16:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.44574552 2024-09-17T18:16:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.949259+0000", 2024-09-17T18:16:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00050740699999999998 2024-09-17T18:16:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.976462+0000", 2024-09-17T18:16:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027203409000000001 2024-09-17T18:16:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:868 3.ds1 3:b4393ba6:::smithi15432074-18:head [read 0~2179072,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-17T18:16:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.502486+0000", 2024-09-17T18:16:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.3316494380000004, 2024-09-17T18:16:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4835850749999999, 2024-09-17T18:16:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 868 2024-09-17T18:16:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502486+0000", 2024-09-17T18:16:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502486+0000", 2024-09-17T18:16:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502488+0000", 2024-09-17T18:16:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9199999999999998e-06 2024-09-17T18:16:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502501+0000", 2024-09-17T18:16:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2519e-05 2024-09-17T18:16:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502565+0000", 2024-09-17T18:16:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4425999999999996e-05 2024-09-17T18:16:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502597+0000", 2024-09-17T18:16:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1782000000000002e-05 2024-09-17T18:16:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503086+0000", 2024-09-17T18:16:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048855299999999997 2024-09-17T18:16:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-17T18:16:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503088+0000", 2024-09-17T18:16:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.21e-06 2024-09-17T18:16:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.976787+0000", 2024-09-17T18:16:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.473699176 2024-09-17T18:16:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.977128+0000", 2024-09-17T18:16:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034063700000000003 2024-09-17T18:16:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.986072+0000", 2024-09-17T18:16:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0089438520000000004 2024-09-17T18:16:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.ds1 81/80 ECSubReadReply(tid=1, attrs_read=0))", 2024-09-17T18:16:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:16.952759+0000", 2024-09-17T18:16:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.881377005, 2024-09-17T18:16:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020700592, 2024-09-17T18:16:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.952759+0000", 2024-09-17T18:16:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.952759+0000", 2024-09-17T18:16:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.952760+0000", 2024-09-17T18:16:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7699999999999992e-07 2024-09-17T18:16:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953686+0000", 2024-09-17T18:16:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092626899999999996 2024-09-17T18:16:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953706+0000", 2024-09-17T18:16:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0086e-05 2024-09-17T18:16:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953717+0000", 2024-09-17T18:16:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1141999999999999e-05 2024-09-17T18:16:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.966031+0000", 2024-09-17T18:16:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012313774 2024-09-17T18:16:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.973459+0000", 2024-09-17T18:16:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074283439999999999 2024-09-17T18:16:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.ds1 81/80 ECSubReadReply(tid=2, attrs_read=0))", 2024-09-17T18:16:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:16.953720+0000", 2024-09-17T18:16:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.8804158810000002, 2024-09-17T18:16:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020043406, 2024-09-17T18:16:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953720+0000", 2024-09-17T18:16:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953720+0000", 2024-09-17T18:16:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953720+0000", 2024-09-17T18:16:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953720+0000", 2024-09-17T18:16:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953754+0000", 2024-09-17T18:16:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4085000000000003e-05 2024-09-17T18:16:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953769+0000", 2024-09-17T18:16:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4455e-05 2024-09-17T18:16:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.973593+0000", 2024-09-17T18:16:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019824636 2024-09-17T18:16:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.973763+0000", 2024-09-17T18:16:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017023 2024-09-17T18:16:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.ds1 81/80 ECSubReadReply(tid=2, attrs_read=0))", 2024-09-17T18:16:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:16.953751+0000", 2024-09-17T18:16:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.88038521, 2024-09-17T18:16:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020219452999999998, 2024-09-17T18:16:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953751+0000", 2024-09-17T18:16:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953751+0000", 2024-09-17T18:16:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953751+0000", 2024-09-17T18:16:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8400000000000003e-07 2024-09-17T18:16:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953857+0000", 2024-09-17T18:16:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010503 2024-09-17T18:16:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953872+0000", 2024-09-17T18:16:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5373e-05 2024-09-17T18:16:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953881+0000", 2024-09-17T18:16:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4290000000000007e-06 2024-09-17T18:16:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.973870+0000", 2024-09-17T18:16:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019988922999999999 2024-09-17T18:16:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.973970+0000", 2024-09-17T18:16:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9914000000000006e-05 2024-09-17T18:16:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.ds1 81/80 ECSubReadReply(tid=2, attrs_read=0))", 2024-09-17T18:16:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:16.953945+0000", 2024-09-17T18:16:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.8801911640000002, 2024-09-17T18:16:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022557495, 2024-09-17T18:16:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953945+0000", 2024-09-17T18:16:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953945+0000", 2024-09-17T18:16:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953946+0000", 2024-09-17T18:16:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8700000000000005e-07 2024-09-17T18:16:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953986+0000", 2024-09-17T18:16:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0154000000000002e-05 2024-09-17T18:16:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953997+0000", 2024-09-17T18:16:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1789e-05 2024-09-17T18:16:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.954005+0000", 2024-09-17T18:16:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3529999999999997e-06 2024-09-17T18:16:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.974053+0000", 2024-09-17T18:16:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020048076000000001 2024-09-17T18:16:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.976502+0000", 2024-09-17T18:16:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024493359999999999 2024-09-17T18:16:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 86/82 ECSubWrite(tid=136, reqid=client.4565.0:937, at_version=86'367, trim_to=0'0, roll_forward_to=85'361))", 2024-09-17T18:16:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.379743+0000", 2024-09-17T18:16:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.45439256300000003, 2024-09-17T18:16:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027154621, 2024-09-17T18:16:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379743+0000", 2024-09-17T18:16:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379743+0000", 2024-09-17T18:16:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379744+0000", 2024-09-17T18:16:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.04e-06 2024-09-17T18:16:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379795+0000", 2024-09-17T18:16:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0274e-05 2024-09-17T18:16:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379817+0000", 2024-09-17T18:16:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2181999999999999e-05 2024-09-17T18:16:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379917+0000", 2024-09-17T18:16:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9938000000000004e-05 2024-09-17T18:16:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.390590+0000", 2024-09-17T18:16:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010672849999999999 2024-09-17T18:16:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.390610+0000", 2024-09-17T18:16:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0652000000000001e-05 2024-09-17T18:16:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.406832+0000", 2024-09-17T18:16:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016221348999999999 2024-09-17T18:16:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.406898+0000", 2024-09-17T18:16:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6335999999999996e-05 2024-09-17T18:16:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 86/82 ECSubWrite(tid=137, reqid=client.4565.0:938, at_version=86'368, trim_to=0'0, roll_forward_to=85'361))", 2024-09-17T18:16:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.379952+0000", 2024-09-17T18:16:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.45418416700000003, 2024-09-17T18:16:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028793836, 2024-09-17T18:16:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379952+0000", 2024-09-17T18:16:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379952+0000", 2024-09-17T18:16:21.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379953+0000", 2024-09-17T18:16:21.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.083e-06 2024-09-17T18:16:21.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379991+0000", 2024-09-17T18:16:21.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8321999999999997e-05 2024-09-17T18:16:21.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380014+0000", 2024-09-17T18:16:21.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3224999999999999e-05 2024-09-17T18:16:21.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380032+0000", 2024-09-17T18:16:21.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7753000000000001e-05 2024-09-17T18:16:21.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.395808+0000", 2024-09-17T18:16:21.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015776199000000001 2024-09-17T18:16:21.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.395828+0000", 2024-09-17T18:16:21.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-09-17T18:16:21.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.408687+0000", 2024-09-17T18:16:21.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012858824 2024-09-17T18:16:21.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.408746+0000", 2024-09-17T18:16:21.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8876999999999999e-05 2024-09-17T18:16:21.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.960 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.961 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 86/82 ECSubWrite(tid=138, reqid=client.4565.0:939, at_version=86'369, trim_to=0'0, roll_forward_to=85'361))", 2024-09-17T18:16:21.961 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.380062+0000", 2024-09-17T18:16:21.961 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.454074223, 2024-09-17T18:16:21.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028735995, 2024-09-17T18:16:21.961 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:21.961 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:21.962 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:21.962 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:21.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:21.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380062+0000", 2024-09-17T18:16:21.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:21.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380062+0000", 2024-09-17T18:16:21.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:21.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:21.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380063+0000", 2024-09-17T18:16:21.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.540000000000001e-07 2024-09-17T18:16:21.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:21.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380105+0000", 2024-09-17T18:16:21.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2304e-05 2024-09-17T18:16:21.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:21.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380125+0000", 2024-09-17T18:16:21.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0075999999999999e-05 2024-09-17T18:16:21.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:21.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380142+0000", 2024-09-17T18:16:21.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7286e-05 2024-09-17T18:16:21.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:21.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.398645+0000", 2024-09-17T18:16:21.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018502304000000001 2024-09-17T18:16:21.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:21.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.398684+0000", 2024-09-17T18:16:21.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8906000000000003e-05 2024-09-17T18:16:21.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:21.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.408754+0000", 2024-09-17T18:16:21.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01007043 2024-09-17T18:16:21.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:21.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:21.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:21.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.408798+0000", 2024-09-17T18:16:21.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3735000000000001e-05 2024-09-17T18:16:21.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.971 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.971 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.971 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:21.971 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:21.971 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:21.972 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T18:16:21.976 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T18:16:21.976 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:21.969+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:22.075 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:22.069+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:22.130 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:16:22.130 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:16:22.146 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:22.146 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:22.146 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:16:22.147 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:22.148 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:16:22.148 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:16:22.161 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T18:16:22.169 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:16:22.169 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:16:22.176 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:22.173+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:22.190 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:16:22.191 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:16:22.211 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:16:22.212 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:16:22.231 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:16:22.231 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:16:22.253 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:16:22.254 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:16:22.276 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:16:22.277 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:16:22.277 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:22.274+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:22.282 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:22.282 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:22.295 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:16:22.295 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:16:22.297 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T18:16:22.317 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:16:22.317 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:16:22.339 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:16:22.340 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:16:22.343 INFO:tasks.rados.rados.0.smithi154.stdout:376: done (1 left) 2024-09-17T18:16:22.343 INFO:tasks.rados.rados.0.smithi154.stdout:377: done (0 left) 2024-09-17T18:16:22.343 INFO:tasks.rados.rados.0.smithi154.stdout:378: delete oid 10 current snap is 31 2024-09-17T18:16:22.355 INFO:tasks.rados.rados.0.smithi154.stdout:378: done (0 left) 2024-09-17T18:16:22.355 INFO:tasks.rados.rados.0.smithi154.stdout:379: snap_remove snap 27 2024-09-17T18:16:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:16:22.365 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:16:22.377 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:22.373+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:22.387 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:16:22.387 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:16:22.409 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:16:22.409 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:16:22.417 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:22.417 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:22.431 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:16:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:16:22.432 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T18:16:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:16:22.429+0000 7f86708ae640 0 -- 172.21.15.87:0/98262637 >> [v2:172.21.15.154:6824/3670919160,v1:172.21.15.154:6825/3670919160] conn(0x7f866c224ed0 msgr2=0x7f866c2272c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T18:16:22.457 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:16:22.457 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:16:22.478 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:22.474+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:22.554 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:22.554 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:22.568 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T18:16:22.578 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:22.573+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:22.683 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:22.681+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:22.685 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:22.686 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:22.702 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T18:16:22.786 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:22.777+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:22.849 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:22.849 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:22.861 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T18:16:22.884 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:22.877+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:22.984 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:22.981+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:23.010 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:23.010 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:23.025 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T18:16:23.085 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:23.081+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:23.155 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:23.155 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:23.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T18:16:23.185 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:23.181+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:23.285 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:23.281+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:23.290 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:23.291 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:23.305 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T18:16:23.322 INFO:tasks.rados.rados.0.smithi154.stdout:379: done (0 left) 2024-09-17T18:16:23.322 INFO:tasks.rados.rados.0.smithi154.stdout:380: snap_create 2024-09-17T18:16:23.385 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:23.382+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:23.433 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T18:16:23.445 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:23.446 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:23.460 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T18:16:23.504 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:16:23.502+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:16:23.587 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:23.581+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:23.628 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:23.628 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:23.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T18:16:23.692 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:23.690+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:23.765 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:23.765 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:23.780 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T18:16:23.790 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:23.785+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:23.891 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:23.886+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:23.949 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:23.949 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:23.963 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T18:16:23.992 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:23.989+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:24.093 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:24.089+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:24.134 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:24.135 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:24.149 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T18:16:24.194 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:24.189+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:24.270 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:24.270 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:24.285 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T18:16:24.295 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:24.289+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:24.319 INFO:teuthology.orchestra.run.smithi087.stderr:noscrub is set 2024-09-17T18:16:24.326 INFO:tasks.rados.rados.0.smithi154.stdout:380: done (0 left) 2024-09-17T18:16:24.326 INFO:tasks.rados.rados.0.smithi154.stdout:381: read oid 25 snap 30 2024-09-17T18:16:24.326 INFO:tasks.rados.rados.0.smithi154.stdout:381: expect (ObjNum 119 snap 26 seq_num 119) 2024-09-17T18:16:24.326 INFO:tasks.rados.rados.0.smithi154.stdout:382: copy_from oid 39 from oid 11 current snap is 32 2024-09-17T18:16:24.326 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 9 current snap is 32 2024-09-17T18:16:24.326 INFO:tasks.rados.rados.0.smithi154.stdout:383: seq_num 152 ranges {589824=147456} 2024-09-17T18:16:24.341 INFO:tasks.rados.rados.0.smithi154.stdout:383: writing smithi15432074-9 from 589824 to 737280 tid 1 2024-09-17T18:16:24.341 INFO:tasks.rados.rados.0.smithi154.stdout:384: snap_create 2024-09-17T18:16:24.346 INFO:tasks.rados.rados.0.smithi154.stdout:382: finishing copy_from racing read to smithi15432074-39 2024-09-17T18:16:24.349 INFO:tasks.rados.rados.0.smithi154.stdout:383: finishing write tid 1 to smithi15432074-9 2024-09-17T18:16:24.353 INFO:tasks.rados.rados.0.smithi154.stdout:381: expect (ObjNum 119 snap 26 seq_num 119) 2024-09-17T18:16:24.369 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 1458565 2024-09-17T18:16:24.396 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:24.393+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:24.416 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:24.417 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:24.431 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T18:16:24.431 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 696163 2024-09-17T18:16:24.477 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T18:16:24.482 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 2291852 2024-09-17T18:16:24.495 INFO:tasks.rados.rados.0.smithi154.stdout:382: finishing copy_from to smithi15432074-39 2024-09-17T18:16:24.495 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 39 v 148 (ObjNum 120 snap 26 seq_num 120) dirty exists 2024-09-17T18:16:24.496 INFO:tasks.rados.rados.0.smithi154.stdout:383: finishing write tid 2 to smithi15432074-9 2024-09-17T18:16:24.496 INFO:tasks.rados.rados.0.smithi154.stdout:383: finishing write tid 3 to smithi15432074-9 2024-09-17T18:16:24.496 INFO:tasks.rados.rados.0.smithi154.stdout:383: oid 9 updating version 0 to 206 2024-09-17T18:16:24.496 INFO:tasks.rados.rados.0.smithi154.stdout:383: oid 9 version 206 is already newer than 205 2024-09-17T18:16:24.496 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 9 v 206 (ObjNum 152 snap 32 seq_num 152) dirty exists 2024-09-17T18:16:24.496 INFO:tasks.rados.rados.0.smithi154.stdout:383: left oid 9 (ObjNum 152 snap 32 seq_num 152) 2024-09-17T18:16:24.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:16:24.493+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:16:24.548 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:24.548 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:24.562 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T18:16:24.598 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:16:24.593+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:16:24.633 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:16:24.633 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:16:24.655 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:16:24.655 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:16:24.675 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:16:24.675 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:16:24.680 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:24.680 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:24.694 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T18:16:24.695 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:16:24.696 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:16:24.715 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:16:24.715 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:16:24.736 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:16:24.736 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:16:24.739 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:24.738+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:24.756 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:16:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:16:24.780 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:16:24.780 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:16:24.799 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:16:24.800 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:16:24.800 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:24.797+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:24.808 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:24.809 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:24.821 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T18:16:24.822 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:16:24.822 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:16:24.842 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:16:24.842 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:16:24.858 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T18:16:24.859 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T18:16:24.859 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-17T18:16:24.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T18:16:24.863 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:16:24.863 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:16:24.884 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:16:24.884 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:16:24.901 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:24.897+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:24.906 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:16:24.907 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:16:24.928 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:16:24.928 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:16:24.950 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:16:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:16:24.987 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:24.987 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:16:24.987 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:16:24.987 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:16:24.988 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:25.003 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T18:16:25.012 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:25.009+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:25.103 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:25.102+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:25.124 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:25.124 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:16:25.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:16:25.124 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-17T18:16:25.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.124 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:259 3.2s0 3:412841d6:::smithi15432074-31:head [copy-from ver 6] snapc 5=[5,4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:16:25.124 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:33.723621+0000", 2024-09-17T18:16:25.124 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 51.396963683999999, 2024-09-17T18:16:25.124 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.023930903999999999, 2024-09-17T18:16:25.124 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.124 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.125 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:25.125 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:25.125 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:25.125 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:25.125 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 259 2024-09-17T18:16:25.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.125 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.125 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.125 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723621+0000", 2024-09-17T18:16:25.125 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723621+0000", 2024-09-17T18:16:25.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723624+0000", 2024-09-17T18:16:25.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7329999999999999e-06 2024-09-17T18:16:25.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.126 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.126 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723650+0000", 2024-09-17T18:16:25.126 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.635e-05 2024-09-17T18:16:25.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723679+0000", 2024-09-17T18:16:25.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9471999999999998e-05 2024-09-17T18:16:25.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723697+0000", 2024-09-17T18:16:25.127 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7499999999999998e-05 2024-09-17T18:16:25.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.127 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.127 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723856+0000", 2024-09-17T18:16:25.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015885699999999999 2024-09-17T18:16:25.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "op must wait for map", 2024-09-17T18:16:25.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723876+0000", 2024-09-17T18:16:25.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0672000000000001e-05 2024-09-17T18:16:25.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.128 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.128 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725096+0000", 2024-09-17T18:16:25.128 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001219749 2024-09-17T18:16:25.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:25.129 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725238+0000", 2024-09-17T18:16:25.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014202299999999999 2024-09-17T18:16:25.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.129 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.742960+0000", 2024-09-17T18:16:25.129 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017721959999999998 2024-09-17T18:16:25.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.129 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.129 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.746486+0000", 2024-09-17T18:16:25.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0035262169999999999 2024-09-17T18:16:25.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:25.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.747419+0000", 2024-09-17T18:16:25.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00093307999999999998 2024-09-17T18:16:25.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.130 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.130 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.747552+0000", 2024-09-17T18:16:25.130 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00013229100000000001 2024-09-17T18:16:25.130 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.130 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.130 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.131 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:260 3.2s0 3:412841d6:::smithi15432074-31:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e38)", 2024-09-17T18:16:25.131 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:33.723741+0000", 2024-09-17T18:16:25.131 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 51.396843662999999, 2024-09-17T18:16:25.131 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022041903000000002, 2024-09-17T18:16:25.131 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.131 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.131 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-17T18:16:25.131 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:25.131 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:25.131 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:25.131 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 260 2024-09-17T18:16:25.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.132 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.132 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.132 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723741+0000", 2024-09-17T18:16:25.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.132 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.132 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723741+0000", 2024-09-17T18:16:25.132 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723742+0000", 2024-09-17T18:16:25.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0130000000000001e-06 2024-09-17T18:16:25.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723747+0000", 2024-09-17T18:16:25.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.1499999999999998e-06 2024-09-17T18:16:25.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.133 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.133 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723773+0000", 2024-09-17T18:16:25.133 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6389000000000001e-05 2024-09-17T18:16:25.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.723788+0000", 2024-09-17T18:16:25.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4843e-05 2024-09-17T18:16:25.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.134 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.724014+0000", 2024-09-17T18:16:25.134 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000225539 2024-09-17T18:16:25.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.134 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:25.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.724024+0000", 2024-09-17T18:16:25.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0246e-05 2024-09-17T18:16:25.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725543+0000", 2024-09-17T18:16:25.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001519149 2024-09-17T18:16:25.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.135 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for blocked object", 2024-09-17T18:16:25.135 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.725732+0000", 2024-09-17T18:16:25.135 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018853300000000001 2024-09-17T18:16:25.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.136 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.136 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.745290+0000", 2024-09-17T18:16:25.136 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019558507999999999 2024-09-17T18:16:25.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.136 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:25.136 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.745513+0000", 2024-09-17T18:16:25.136 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022266500000000001 2024-09-17T18:16:25.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.136 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.137 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:33.745783+0000", 2024-09-17T18:16:25.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00026986799999999999 2024-09-17T18:16:25.137 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.137 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.137 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.137 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 75/31 ECSubWrite(tid=246, reqid=client.4565.0:760, at_version=75'94, trim_to=0'0, roll_forward_to=72'92))", 2024-09-17T18:16:25.137 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.332062+0000", 2024-09-17T18:16:25.137 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 14.788522248, 2024-09-17T18:16:25.137 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017811364999999999, 2024-09-17T18:16:25.137 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.137 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.137 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.138 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.138 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.138 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.332062+0000", 2024-09-17T18:16:25.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.138 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.138 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.332062+0000", 2024-09-17T18:16:25.138 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.138 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.332070+0000", 2024-09-17T18:16:25.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1629999999999996e-06 2024-09-17T18:16:25.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.139 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.332704+0000", 2024-09-17T18:16:25.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00063376999999999997 2024-09-17T18:16:25.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.139 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.139 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.332734+0000", 2024-09-17T18:16:25.139 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9737999999999999e-05 2024-09-17T18:16:25.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.140 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.140 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.332756+0000", 2024-09-17T18:16:25.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2399e-05 2024-09-17T18:16:25.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.140 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.140 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.334281+0000", 2024-09-17T18:16:25.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0015245149999999999 2024-09-17T18:16:25.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.140 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.140 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.334304+0000", 2024-09-17T18:16:25.140 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3385000000000001e-05 2024-09-17T18:16:25.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.141 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.349768+0000", 2024-09-17T18:16:25.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015463503999999999 2024-09-17T18:16:25.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.141 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.141 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.349874+0000", 2024-09-17T18:16:25.141 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010589100000000001 2024-09-17T18:16:25.141 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.141 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.141 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.142 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 75/31 ECSubWrite(tid=245, reqid=client.4565.0:761, at_version=75'123, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:25.142 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.335411+0000", 2024-09-17T18:16:25.142 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 14.785173791, 2024-09-17T18:16:25.142 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019764741999999998, 2024-09-17T18:16:25.142 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.142 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.142 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.142 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.142 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.142 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335411+0000", 2024-09-17T18:16:25.142 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.143 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.143 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.143 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335411+0000", 2024-09-17T18:16:25.143 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.143 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.143 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.143 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335412+0000", 2024-09-17T18:16:25.143 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.423e-06 2024-09-17T18:16:25.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.143 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.143 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.143 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335461+0000", 2024-09-17T18:16:25.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9237999999999999e-05 2024-09-17T18:16:25.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335488+0000", 2024-09-17T18:16:25.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6968999999999999e-05 2024-09-17T18:16:25.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.144 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.144 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.335866+0000", 2024-09-17T18:16:25.144 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00037801000000000002 2024-09-17T18:16:25.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.336026+0000", 2024-09-17T18:16:25.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015991700000000001 2024-09-17T18:16:25.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.336051+0000", 2024-09-17T18:16:25.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4791999999999999e-05 2024-09-17T18:16:25.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.145 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.145 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.355078+0000", 2024-09-17T18:16:25.145 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019027174000000001 2024-09-17T18:16:25.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.146 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.146 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.355175+0000", 2024-09-17T18:16:25.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7219000000000005e-05 2024-09-17T18:16:25.146 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.146 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.146 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.146 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 75/31 ECSubWrite(tid=247, reqid=client.4565.0:762, at_version=75'124, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:25.146 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.337234+0000", 2024-09-17T18:16:25.146 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 14.783350249, 2024-09-17T18:16:25.146 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019217306, 2024-09-17T18:16:25.146 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.147 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.147 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.147 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.147 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.147 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.147 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.337234+0000", 2024-09-17T18:16:25.147 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.147 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.147 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.147 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.337234+0000", 2024-09-17T18:16:25.147 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.148 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.148 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.337244+0000", 2024-09-17T18:16:25.148 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.4499999999999993e-06 2024-09-17T18:16:25.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.148 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.148 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.337288+0000", 2024-09-17T18:16:25.148 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4604000000000002e-05 2024-09-17T18:16:25.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.148 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.148 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338683+0000", 2024-09-17T18:16:25.149 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0013942410000000001 2024-09-17T18:16:25.149 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.149 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.149 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.149 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338709+0000", 2024-09-17T18:16:25.149 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6971999999999999e-05 2024-09-17T18:16:25.149 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.149 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.149 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.149 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.340821+0000", 2024-09-17T18:16:25.149 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021112230000000002 2024-09-17T18:16:25.149 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.149 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.149 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.150 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.340845+0000", 2024-09-17T18:16:25.150 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4516e-05 2024-09-17T18:16:25.150 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.150 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.150 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.150 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.356360+0000", 2024-09-17T18:16:25.150 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015515057000000001 2024-09-17T18:16:25.150 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.150 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.150 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.150 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.356452+0000", 2024-09-17T18:16:25.150 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1242999999999994e-05 2024-09-17T18:16:25.150 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.150 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.151 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.151 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.151 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.151 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:778 3.2s0 3:4d1a0b53:::smithi15432074-38:head [copy-from ver 27] snapc 1c=[1c,19,18,17,16,15,13,11,10,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T18:16:25.151 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:11.384083+0000", 2024-09-17T18:16:25.151 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.736501217000001, 2024-09-17T18:16:25.151 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.042878652000000003, 2024-09-17T18:16:25.151 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.151 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.151 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:25.151 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:25.151 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:25.151 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:25.151 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 778 2024-09-17T18:16:25.152 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.152 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.152 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.152 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.152 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384083+0000", 2024-09-17T18:16:25.152 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.152 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.152 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.152 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.152 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384083+0000", 2024-09-17T18:16:25.152 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.152 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.152 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.153 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.153 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384087+0000", 2024-09-17T18:16:25.153 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2890000000000002e-06 2024-09-17T18:16:25.153 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.153 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.153 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.153 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384101+0000", 2024-09-17T18:16:25.153 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4630999999999999e-05 2024-09-17T18:16:25.153 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.153 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.153 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.153 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384133+0000", 2024-09-17T18:16:25.153 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1792999999999999e-05 2024-09-17T18:16:25.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.154 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.154 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.154 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384152+0000", 2024-09-17T18:16:25.154 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9023999999999999e-05 2024-09-17T18:16:25.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.154 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.154 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.154 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384304+0000", 2024-09-17T18:16:25.154 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00015227099999999999 2024-09-17T18:16:25.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.154 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.154 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:25.155 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384581+0000", 2024-09-17T18:16:25.155 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00027697799999999999 2024-09-17T18:16:25.155 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.155 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.155 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.155 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.417138+0000", 2024-09-17T18:16:25.155 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.032556278000000001 2024-09-17T18:16:25.155 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.155 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.155 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.155 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.425666+0000", 2024-09-17T18:16:25.155 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0085287820000000004 2024-09-17T18:16:25.155 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.156 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.156 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "commit_sent", 2024-09-17T18:16:25.156 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.426814+0000", 2024-09-17T18:16:25.156 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0011479369999999999 2024-09-17T18:16:25.156 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.156 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.156 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.156 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.426962+0000", 2024-09-17T18:16:25.156 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00014766900000000001 2024-09-17T18:16:25.156 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.156 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.156 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.156 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.157 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.157 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "osd_op(client.4565.0:779 3.2s0 3:4d1a0b53:::smithi15432074-38:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-09-17T18:16:25.157 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:11.384204+0000", 2024-09-17T18:16:25.157 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 13.736380266999999, 2024-09-17T18:16:25.157 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.039332700999999998, 2024-09-17T18:16:25.157 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.157 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.157 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "started", 2024-09-17T18:16:25.157 INFO:teuthology.orchestra.run.smithi146.stdout: "client_info": { 2024-09-17T18:16:25.157 INFO:teuthology.orchestra.run.smithi146.stdout: "client": "client.4565", 2024-09-17T18:16:25.157 INFO:teuthology.orchestra.run.smithi146.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:25.157 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 779 2024-09-17T18:16:25.157 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.157 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.158 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.158 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.158 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384204+0000", 2024-09-17T18:16:25.158 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.158 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.158 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.158 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.158 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384204+0000", 2024-09-17T18:16:25.158 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.158 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.158 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.158 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.158 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384206+0000", 2024-09-17T18:16:25.158 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5740000000000001e-06 2024-09-17T18:16:25.159 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.159 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.159 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.159 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384213+0000", 2024-09-17T18:16:25.159 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.1049999999999997e-06 2024-09-17T18:16:25.159 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.159 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.159 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.159 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384236+0000", 2024-09-17T18:16:25.159 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2991000000000001e-05 2024-09-17T18:16:25.159 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.159 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.160 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.160 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384255+0000", 2024-09-17T18:16:25.160 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9256e-05 2024-09-17T18:16:25.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.160 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.160 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.160 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.384960+0000", 2024-09-17T18:16:25.160 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00070503600000000003 2024-09-17T18:16:25.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.160 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.160 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "waiting for blocked object", 2024-09-17T18:16:25.160 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.385064+0000", 2024-09-17T18:16:25.160 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103724 2024-09-17T18:16:25.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.161 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.161 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.161 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.422933+0000", 2024-09-17T18:16:25.161 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.037868952999999997 2024-09-17T18:16:25.161 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.161 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.161 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "started", 2024-09-17T18:16:25.161 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.423214+0000", 2024-09-17T18:16:25.161 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00028103200000000002 2024-09-17T18:16:25.161 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.161 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.161 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.161 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.423537+0000", 2024-09-17T18:16:25.161 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00032302999999999998 2024-09-17T18:16:25.162 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.162 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.162 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.162 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.162 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.162 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 85/31 ECSubWrite(tid=333, reqid=osd.4.0:333, at_version=85'172, trim_to=0'0, roll_forward_to=84'170))", 2024-09-17T18:16:25.162 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:20.334565+0000", 2024-09-17T18:16:25.162 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.7860199349999997, 2024-09-17T18:16:25.162 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021207001999999999, 2024-09-17T18:16:25.162 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.162 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.162 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.162 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.162 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.163 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.163 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.334565+0000", 2024-09-17T18:16:25.163 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.163 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.163 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.163 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.163 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.334565+0000", 2024-09-17T18:16:25.163 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.163 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.163 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.163 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.163 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.334565+0000", 2024-09-17T18:16:25.163 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.9999999999999997e-07 2024-09-17T18:16:25.163 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.164 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.164 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.164 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.334622+0000", 2024-09-17T18:16:25.164 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7011e-05 2024-09-17T18:16:25.164 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.164 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.164 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.164 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.334667+0000", 2024-09-17T18:16:25.164 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.4888999999999997e-05 2024-09-17T18:16:25.164 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.164 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.164 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.164 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.334694+0000", 2024-09-17T18:16:25.164 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7322e-05 2024-09-17T18:16:25.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.165 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.165 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.165 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.336869+0000", 2024-09-17T18:16:25.165 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0021744920000000001 2024-09-17T18:16:25.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.165 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.165 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.165 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.336901+0000", 2024-09-17T18:16:25.165 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1931999999999999e-05 2024-09-17T18:16:25.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.165 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.165 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.165 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.355697+0000", 2024-09-17T18:16:25.166 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018796548999999999 2024-09-17T18:16:25.166 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.166 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.166 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.166 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.355772+0000", 2024-09-17T18:16:25.166 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.4107e-05 2024-09-17T18:16:25.166 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.166 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.166 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.166 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.166 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.166 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 85/31 ECSubWrite(tid=335, reqid=osd.4.0:335, at_version=85'174, trim_to=0'0, roll_forward_to=84'170))", 2024-09-17T18:16:25.166 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:20.334896+0000", 2024-09-17T18:16:25.166 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.7856883359999998, 2024-09-17T18:16:25.167 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.030834700999999999, 2024-09-17T18:16:25.167 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.167 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.167 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.167 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.167 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.167 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.167 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.334896+0000", 2024-09-17T18:16:25.167 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.167 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.167 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.167 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.167 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.334896+0000", 2024-09-17T18:16:25.167 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.168 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.168 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.168 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.168 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.334897+0000", 2024-09-17T18:16:25.168 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6300000000000004e-07 2024-09-17T18:16:25.168 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.168 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.168 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.168 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.334952+0000", 2024-09-17T18:16:25.168 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4617999999999998e-05 2024-09-17T18:16:25.168 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.168 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.168 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.168 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.334975+0000", 2024-09-17T18:16:25.169 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3370000000000002e-05 2024-09-17T18:16:25.169 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.169 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.169 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.169 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.334993+0000", 2024-09-17T18:16:25.169 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8292e-05 2024-09-17T18:16:25.169 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.169 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.169 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.169 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.348830+0000", 2024-09-17T18:16:25.169 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013836251000000001 2024-09-17T18:16:25.169 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.169 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.169 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.170 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.348856+0000", 2024-09-17T18:16:25.170 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6242e-05 2024-09-17T18:16:25.170 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.170 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.170 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.170 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.365633+0000", 2024-09-17T18:16:25.170 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016777364999999999 2024-09-17T18:16:25.170 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.170 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.170 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.170 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.365731+0000", 2024-09-17T18:16:25.170 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7700000000000003e-05 2024-09-17T18:16:25.170 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.170 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.171 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.171 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.171 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.171 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 85/31 ECSubWrite(tid=336, reqid=osd.4.0:336, at_version=85'144, trim_to=0'0, roll_forward_to=84'140))", 2024-09-17T18:16:25.171 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:20.335510+0000", 2024-09-17T18:16:25.171 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.78507441, 2024-09-17T18:16:25.171 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018114844000000001, 2024-09-17T18:16:25.171 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.171 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.171 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.171 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.171 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.171 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.172 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.335510+0000", 2024-09-17T18:16:25.172 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.172 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.172 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.172 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.172 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.335510+0000", 2024-09-17T18:16:25.172 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.172 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.172 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.173 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.173 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.335512+0000", 2024-09-17T18:16:25.173 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9539999999999998e-06 2024-09-17T18:16:25.173 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.173 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.173 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.173 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.335559+0000", 2024-09-17T18:16:25.173 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6944999999999999e-05 2024-09-17T18:16:25.173 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.173 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.173 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.173 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.335590+0000", 2024-09-17T18:16:25.173 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1301999999999999e-05 2024-09-17T18:16:25.174 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.174 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.174 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.174 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.335616+0000", 2024-09-17T18:16:25.174 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5896000000000001e-05 2024-09-17T18:16:25.174 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.174 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.174 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.174 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.336929+0000", 2024-09-17T18:16:25.174 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001312644 2024-09-17T18:16:25.174 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.174 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.174 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.175 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.336954+0000", 2024-09-17T18:16:25.175 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5309000000000001e-05 2024-09-17T18:16:25.175 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.175 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.175 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.175 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.353561+0000", 2024-09-17T18:16:25.175 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016607252999999999 2024-09-17T18:16:25.175 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.175 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.176 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.176 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.353625+0000", 2024-09-17T18:16:25.176 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3540999999999994e-05 2024-09-17T18:16:25.176 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.176 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.176 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.176 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.176 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.176 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s1 85/31 ECSubWrite(tid=119, reqid=osd.0.0:119, at_version=85'108, trim_to=0'0, roll_forward_to=84'106))", 2024-09-17T18:16:25.176 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:20.342407+0000", 2024-09-17T18:16:25.176 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.7781771319999997, 2024-09-17T18:16:25.176 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019253192999999998, 2024-09-17T18:16:25.176 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.177 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.177 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.177 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.177 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.177 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.177 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.342407+0000", 2024-09-17T18:16:25.177 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.177 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.177 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.177 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.342407+0000", 2024-09-17T18:16:25.177 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.342408+0000", 2024-09-17T18:16:25.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.37e-07 2024-09-17T18:16:25.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.342470+0000", 2024-09-17T18:16:25.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2141e-05 2024-09-17T18:16:25.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.178 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.178 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.178 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.342501+0000", 2024-09-17T18:16:25.178 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0994999999999997e-05 2024-09-17T18:16:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.342523+0000", 2024-09-17T18:16:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1963e-05 2024-09-17T18:16:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.342708+0000", 2024-09-17T18:16:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000185238 2024-09-17T18:16:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.342737+0000", 2024-09-17T18:16:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8955999999999999e-05 2024-09-17T18:16:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.361551+0000", 2024-09-17T18:16:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018814217000000001 2024-09-17T18:16:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.361661+0000", 2024-09-17T18:16:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000109046 2024-09-17T18:16:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.181 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.181 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.181 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s1 85/31 ECSubWrite(tid=120, reqid=osd.0.0:120, at_version=85'110, trim_to=0'0, roll_forward_to=84'106))", 2024-09-17T18:16:25.181 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:20.344145+0000", 2024-09-17T18:16:25.181 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.7764394650000002, 2024-09-17T18:16:25.181 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021651377999999999, 2024-09-17T18:16:25.181 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.181 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.181 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.181 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.181 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.181 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.344145+0000", 2024-09-17T18:16:25.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.182 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.344145+0000", 2024-09-17T18:16:25.182 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.182 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.182 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.183 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.344147+0000", 2024-09-17T18:16:25.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0360000000000001e-06 2024-09-17T18:16:25.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.183 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.183 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.183 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.344207+0000", 2024-09-17T18:16:25.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0448000000000001e-05 2024-09-17T18:16:25.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.183 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.183 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.183 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.344240+0000", 2024-09-17T18:16:25.183 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.2376000000000003e-05 2024-09-17T18:16:25.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.184 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.344271+0000", 2024-09-17T18:16:25.184 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0694999999999997e-05 2024-09-17T18:16:25.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.184 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.352235+0000", 2024-09-17T18:16:25.184 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0079646730000000002 2024-09-17T18:16:25.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.184 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.184 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.352261+0000", 2024-09-17T18:16:25.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6186e-05 2024-09-17T18:16:25.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.365711+0000", 2024-09-17T18:16:25.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013449556999999999 2024-09-17T18:16:25.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.185 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.185 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.365796+0000", 2024-09-17T18:16:25.185 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.5407000000000004e-05 2024-09-17T18:16:25.185 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.185 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.186 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.186 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.es1 85/31 ECSubWrite(tid=51, reqid=osd.11.0:51, at_version=85'42, trim_to=0'0, roll_forward_to=84'40))", 2024-09-17T18:16:25.186 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:20.351837+0000", 2024-09-17T18:16:25.186 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 4.7687478070000004, 2024-09-17T18:16:25.186 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.018479208, 2024-09-17T18:16:25.186 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.186 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.186 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.186 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.186 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.351837+0000", 2024-09-17T18:16:25.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.351837+0000", 2024-09-17T18:16:25.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.187 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.187 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.187 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.351837+0000", 2024-09-17T18:16:25.187 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0699999999999996e-07 2024-09-17T18:16:25.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.188 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.188 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.351893+0000", 2024-09-17T18:16:25.188 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5031000000000002e-05 2024-09-17T18:16:25.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.188 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.188 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.351917+0000", 2024-09-17T18:16:25.188 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4409e-05 2024-09-17T18:16:25.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.188 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.189 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.351937+0000", 2024-09-17T18:16:25.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9752999999999999e-05 2024-09-17T18:16:25.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.189 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.356262+0000", 2024-09-17T18:16:25.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.004325705 2024-09-17T18:16:25.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.189 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.189 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.189 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.356291+0000", 2024-09-17T18:16:25.189 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8609e-05 2024-09-17T18:16:25.189 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.190 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.190 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.370212+0000", 2024-09-17T18:16:25.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013921108 2024-09-17T18:16:25.190 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.190 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.190 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.190 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.370316+0000", 2024-09-17T18:16:25.190 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103786 2024-09-17T18:16:25.190 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.190 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.190 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.190 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.191 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 86/31 ECSubWrite(tid=352, reqid=osd.4.0:352, at_version=86'182, trim_to=0'0, roll_forward_to=85'180))", 2024-09-17T18:16:25.191 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:21.347747+0000", 2024-09-17T18:16:25.191 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.7728375070000002, 2024-09-17T18:16:25.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.023968335, 2024-09-17T18:16:25.191 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.191 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.191 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.191 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.191 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.191 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.191 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.347747+0000", 2024-09-17T18:16:25.191 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.347747+0000", 2024-09-17T18:16:25.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.192 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.347748+0000", 2024-09-17T18:16:25.192 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.540000000000001e-07 2024-09-17T18:16:25.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.192 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.347829+0000", 2024-09-17T18:16:25.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.0822999999999995e-05 2024-09-17T18:16:25.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.347855+0000", 2024-09-17T18:16:25.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5982999999999998e-05 2024-09-17T18:16:25.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.193 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.193 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.193 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.347877+0000", 2024-09-17T18:16:25.193 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1869e-05 2024-09-17T18:16:25.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.348063+0000", 2024-09-17T18:16:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000186594 2024-09-17T18:16:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.348093+0000", 2024-09-17T18:16:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9748999999999999e-05 2024-09-17T18:16:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.371690+0000", 2024-09-17T18:16:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.023596567999999998 2024-09-17T18:16:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.371715+0000", 2024-09-17T18:16:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5795e-05 2024-09-17T18:16:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.bs6 86/31 ECSubWrite(tid=353, reqid=osd.4.0:353, at_version=86'184, trim_to=0'0, roll_forward_to=85'180))", 2024-09-17T18:16:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:21.347944+0000", 2024-09-17T18:16:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.7726401730000001, 2024-09-17T18:16:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.032923406000000002, 2024-09-17T18:16:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.347944+0000", 2024-09-17T18:16:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.347944+0000", 2024-09-17T18:16:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.347945+0000", 2024-09-17T18:16:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.2999999999999999e-07 2024-09-17T18:16:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.347988+0000", 2024-09-17T18:16:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.2638000000000001e-05 2024-09-17T18:16:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.348010+0000", 2024-09-17T18:16:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2135999999999999e-05 2024-09-17T18:16:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.348031+0000", 2024-09-17T18:16:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0570000000000001e-05 2024-09-17T18:16:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.356037+0000", 2024-09-17T18:16:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0080065210000000008 2024-09-17T18:16:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.356062+0000", 2024-09-17T18:16:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5205999999999999e-05 2024-09-17T18:16:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.380840+0000", 2024-09-17T18:16:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.024778026000000002 2024-09-17T18:16:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.380868+0000", 2024-09-17T18:16:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7379e-05 2024-09-17T18:16:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.cs6 86/31 ECSubWrite(tid=198, reqid=osd.5.0:198, at_version=86'119, trim_to=0'0, roll_forward_to=85'117))", 2024-09-17T18:16:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:21.348097+0000", 2024-09-17T18:16:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.772487785, 2024-09-17T18:16:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.023441586, 2024-09-17T18:16:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.348097+0000", 2024-09-17T18:16:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.348097+0000", 2024-09-17T18:16:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.348098+0000", 2024-09-17T18:16:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.0299999999999997e-07 2024-09-17T18:16:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.348146+0000", 2024-09-17T18:16:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.8785999999999997e-05 2024-09-17T18:16:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.348172+0000", 2024-09-17T18:16:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5429e-05 2024-09-17T18:16:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.348192+0000", 2024-09-17T18:16:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0248999999999999e-05 2024-09-17T18:16:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.348380+0000", 2024-09-17T18:16:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018780399999999999 2024-09-17T18:16:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.348409+0000", 2024-09-17T18:16:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9349e-05 2024-09-17T18:16:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.362101+0000", 2024-09-17T18:16:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013691405 2024-09-17T18:16:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.371538+0000", 2024-09-17T18:16:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.009437661 2024-09-17T18:16:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.cs6 86/31 ECSubWrite(tid=199, reqid=osd.5.0:199, at_version=86'121, trim_to=0'0, roll_forward_to=85'117))", 2024-09-17T18:16:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:21.351316+0000", 2024-09-17T18:16:25.205 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.7692683570000001, 2024-09-17T18:16:25.205 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.029502226999999999, 2024-09-17T18:16:25.205 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.205 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.205 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.205 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.205 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.205 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.351316+0000", 2024-09-17T18:16:25.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.351316+0000", 2024-09-17T18:16:25.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.206 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.206 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.206 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.351318+0000", 2024-09-17T18:16:25.206 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0200000000000001e-06 2024-09-17T18:16:25.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.351369+0000", 2024-09-17T18:16:25.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0929e-05 2024-09-17T18:16:25.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.351400+0000", 2024-09-17T18:16:25.207 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.1386000000000001e-05 2024-09-17T18:16:25.207 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.207 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.207 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.207 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.351423+0000", 2024-09-17T18:16:25.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2432000000000001e-05 2024-09-17T18:16:25.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.355851+0000", 2024-09-17T18:16:25.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0044283020000000003 2024-09-17T18:16:25.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.208 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.208 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.355880+0000", 2024-09-17T18:16:25.208 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8739e-05 2024-09-17T18:16:25.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.380772+0000", 2024-09-17T18:16:25.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.024891847000000002 2024-09-17T18:16:25.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.209 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.209 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.380818+0000", 2024-09-17T18:16:25.209 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6572000000000001e-05 2024-09-17T18:16:25.209 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.209 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.209 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.209 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.209 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.209 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 86/31 ECSubWrite(tid=354, reqid=osd.4.0:354, at_version=86'155, trim_to=0'0, roll_forward_to=85'153))", 2024-09-17T18:16:25.210 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:21.351820+0000", 2024-09-17T18:16:25.210 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.7687647760000003, 2024-09-17T18:16:25.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019887034000000001, 2024-09-17T18:16:25.210 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.210 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.210 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.210 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.210 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.210 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.351820+0000", 2024-09-17T18:16:25.210 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.351820+0000", 2024-09-17T18:16:25.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.351821+0000", 2024-09-17T18:16:25.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5200000000000001e-06 2024-09-17T18:16:25.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.211 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.211 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.351861+0000", 2024-09-17T18:16:25.211 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.0142000000000003e-05 2024-09-17T18:16:25.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.212 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.351912+0000", 2024-09-17T18:16:25.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0688e-05 2024-09-17T18:16:25.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.212 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.351935+0000", 2024-09-17T18:16:25.212 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2932e-05 2024-09-17T18:16:25.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.212 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.352096+0000", 2024-09-17T18:16:25.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00016147199999999999 2024-09-17T18:16:25.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.352123+0000", 2024-09-17T18:16:25.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6568999999999999e-05 2024-09-17T18:16:25.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.213 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.213 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.371683+0000", 2024-09-17T18:16:25.213 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.019559798999999999 2024-09-17T18:16:25.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.214 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.214 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.371707+0000", 2024-09-17T18:16:25.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3912000000000001e-05 2024-09-17T18:16:25.214 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.214 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.214 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.214 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 86/31 ECSubWrite(tid=355, reqid=osd.4.0:355, at_version=86'157, trim_to=0'0, roll_forward_to=85'153))", 2024-09-17T18:16:25.214 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:21.352236+0000", 2024-09-17T18:16:25.214 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.768348424, 2024-09-17T18:16:25.214 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.028518002000000001, 2024-09-17T18:16:25.214 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.215 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.215 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.215 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.352236+0000", 2024-09-17T18:16:25.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.215 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.215 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.352236+0000", 2024-09-17T18:16:25.215 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.352237+0000", 2024-09-17T18:16:25.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.074e-06 2024-09-17T18:16:25.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.352294+0000", 2024-09-17T18:16:25.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.7221e-05 2024-09-17T18:16:25.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.216 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.216 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.352320+0000", 2024-09-17T18:16:25.216 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5346000000000001e-05 2024-09-17T18:16:25.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.217 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.217 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.352340+0000", 2024-09-17T18:16:25.217 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0109999999999999e-05 2024-09-17T18:16:25.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.217 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.217 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.359056+0000", 2024-09-17T18:16:25.217 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0067164659999999999 2024-09-17T18:16:25.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.217 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.359086+0000", 2024-09-17T18:16:25.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9275999999999999e-05 2024-09-17T18:16:25.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.218 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.380691+0000", 2024-09-17T18:16:25.218 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.021605193000000002 2024-09-17T18:16:25.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.218 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.219 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.380754+0000", 2024-09-17T18:16:25.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.3316000000000002e-05 2024-09-17T18:16:25.219 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.219 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.219 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.219 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.7s4 86/31 ECSubWrite(tid=356, reqid=client.4565.0:936, at_version=86'159, trim_to=0'0, roll_forward_to=85'153))", 2024-09-17T18:16:25.219 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:21.360248+0000", 2024-09-17T18:16:25.219 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 3.7603365059999998, 2024-09-17T18:16:25.219 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.027971942, 2024-09-17T18:16:25.219 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:25.219 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:25.220 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.220 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:25.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:25.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.360248+0000", 2024-09-17T18:16:25.220 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.220 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:25.220 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.360248+0000", 2024-09-17T18:16:25.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:25.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:25.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.360250+0000", 2024-09-17T18:16:25.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2570000000000002e-06 2024-09-17T18:16:25.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.221 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:25.221 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.362234+0000", 2024-09-17T18:16:25.221 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0019836379999999998 2024-09-17T18:16:25.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:25.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.371755+0000", 2024-09-17T18:16:25.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0095212500000000002 2024-09-17T18:16:25.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.371779+0000", 2024-09-17T18:16:25.222 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3688000000000001e-05 2024-09-17T18:16:25.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.222 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:25.222 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.371868+0000", 2024-09-17T18:16:25.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.8729999999999999e-05 2024-09-17T18:16:25.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.371874+0000", 2024-09-17T18:16:25.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.2659999999999998e-06 2024-09-17T18:16:25.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.223 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.388190+0000", 2024-09-17T18:16:25.223 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016315902 2024-09-17T18:16:25.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:25.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:25.223 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:25.224 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.388220+0000", 2024-09-17T18:16:25.224 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0210999999999999e-05 2024-09-17T18:16:25.224 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.224 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.224 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.224 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:25.224 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:25.224 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:25.226 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:25.221+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:25.227 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T18:16:25.227 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:16:25.228 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:16:25.228 INFO:teuthology.orchestra.run.smithi087.stdout: "epoch": 89, 2024-09-17T18:16:25.228 INFO:teuthology.orchestra.run.smithi087.stdout: "fsid": "61bbf164-0ac7-4613-95ea-b1c3bf551ccb", 2024-09-17T18:16:25.228 INFO:teuthology.orchestra.run.smithi087.stdout: "created": "2024-09-17T18:14:58.620399+0000", 2024-09-17T18:16:25.228 INFO:teuthology.orchestra.run.smithi087.stdout: "modified": "2024-09-17T18:16:24.315955+0000", 2024-09-17T18:16:25.228 INFO:teuthology.orchestra.run.smithi087.stdout: "last_up_change": "2024-09-17T18:15:12.533086+0000", 2024-09-17T18:16:25.228 INFO:teuthology.orchestra.run.smithi087.stdout: "last_in_change": "2024-09-17T18:15:03.053866+0000", 2024-09-17T18:16:25.228 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T18:16:25.228 INFO:teuthology.orchestra.run.smithi087.stdout: "flags_num": 5801984, 2024-09-17T18:16:25.228 INFO:teuthology.orchestra.run.smithi087.stdout: "flags_set": [ 2024-09-17T18:16:25.228 INFO:teuthology.orchestra.run.smithi087.stdout: "noscrub", 2024-09-17T18:16:25.228 INFO:teuthology.orchestra.run.smithi087.stdout: "pglog_hardlimit", 2024-09-17T18:16:25.228 INFO:teuthology.orchestra.run.smithi087.stdout: "purged_snapdirs", 2024-09-17T18:16:25.229 INFO:teuthology.orchestra.run.smithi087.stdout: "recovery_deletes", 2024-09-17T18:16:25.229 INFO:teuthology.orchestra.run.smithi087.stdout: "sortbitwise" 2024-09-17T18:16:25.229 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T18:16:25.229 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_version": 6, 2024-09-17T18:16:25.229 INFO:teuthology.orchestra.run.smithi087.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T18:16:25.229 INFO:teuthology.orchestra.run.smithi087.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T18:16:25.229 INFO:teuthology.orchestra.run.smithi087.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T18:16:25.229 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_snapshot": "", 2024-09-17T18:16:25.229 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_max": 3, 2024-09-17T18:16:25.229 INFO:teuthology.orchestra.run.smithi087.stdout: "max_osd": 16, 2024-09-17T18:16:25.229 INFO:teuthology.orchestra.run.smithi087.stdout: "require_min_compat_client": "luminous", 2024-09-17T18:16:25.229 INFO:teuthology.orchestra.run.smithi087.stdout: "min_compat_client": "luminous", 2024-09-17T18:16:25.229 INFO:teuthology.orchestra.run.smithi087.stdout: "require_osd_release": "squid", 2024-09-17T18:16:25.230 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_crimson": false, 2024-09-17T18:16:25.230 INFO:teuthology.orchestra.run.smithi087.stdout: "pools": [ 2024-09-17T18:16:25.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.230 INFO:teuthology.orchestra.run.smithi087.stdout: "pool": 1, 2024-09-17T18:16:25.230 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_name": ".mgr", 2024-09-17T18:16:25.230 INFO:teuthology.orchestra.run.smithi087.stdout: "create_time": "2024-09-17T18:15:11.543279+0000", 2024-09-17T18:16:25.230 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-17T18:16:25.230 INFO:teuthology.orchestra.run.smithi087.stdout: "flags_names": "hashpspool", 2024-09-17T18:16:25.230 INFO:teuthology.orchestra.run.smithi087.stdout: "type": 1, 2024-09-17T18:16:25.230 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 2, 2024-09-17T18:16:25.230 INFO:teuthology.orchestra.run.smithi087.stdout: "min_size": 1, 2024-09-17T18:16:25.230 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_rule": 0, 2024-09-17T18:16:25.230 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_count": 0, 2024-09-17T18:16:25.230 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_target": 0, 2024-09-17T18:16:25.231 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T18:16:25.231 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T18:16:25.231 INFO:teuthology.orchestra.run.smithi087.stdout: "is_stretch_pool": false, 2024-09-17T18:16:25.231 INFO:teuthology.orchestra.run.smithi087.stdout: "object_hash": 2, 2024-09-17T18:16:25.231 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscale_mode": "off", 2024-09-17T18:16:25.231 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num": 1, 2024-09-17T18:16:25.231 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_placement_num": 1, 2024-09-17T18:16:25.231 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_placement_num_target": 1, 2024-09-17T18:16:25.231 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_target": 1, 2024-09-17T18:16:25.231 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_pending": 1, 2024-09-17T18:16:25.231 INFO:teuthology.orchestra.run.smithi087.stdout: "last_pg_merge_meta": { 2024-09-17T18:16:25.231 INFO:teuthology.orchestra.run.smithi087.stdout: "source_pgid": "0.0", 2024-09-17T18:16:25.231 INFO:teuthology.orchestra.run.smithi087.stdout: "ready_epoch": 0, 2024-09-17T18:16:25.231 INFO:teuthology.orchestra.run.smithi087.stdout: "last_epoch_started": 0, 2024-09-17T18:16:25.232 INFO:teuthology.orchestra.run.smithi087.stdout: "last_epoch_clean": 0, 2024-09-17T18:16:25.232 INFO:teuthology.orchestra.run.smithi087.stdout: "source_version": "0'0", 2024-09-17T18:16:25.232 INFO:teuthology.orchestra.run.smithi087.stdout: "target_version": "0'0" 2024-09-17T18:16:25.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.232 INFO:teuthology.orchestra.run.smithi087.stdout: "last_change": "25", 2024-09-17T18:16:25.232 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend": "0", 2024-09-17T18:16:25.232 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T18:16:25.232 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T18:16:25.232 INFO:teuthology.orchestra.run.smithi087.stdout: "auid": 0, 2024-09-17T18:16:25.232 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_mode": "selfmanaged", 2024-09-17T18:16:25.232 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_seq": 0, 2024-09-17T18:16:25.232 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_epoch": 0, 2024-09-17T18:16:25.232 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_snaps": [], 2024-09-17T18:16:25.233 INFO:teuthology.orchestra.run.smithi087.stdout: "removed_snaps": "[]", 2024-09-17T18:16:25.233 INFO:teuthology.orchestra.run.smithi087.stdout: "quota_max_bytes": 0, 2024-09-17T18:16:25.233 INFO:teuthology.orchestra.run.smithi087.stdout: "quota_max_objects": 0, 2024-09-17T18:16:25.233 INFO:teuthology.orchestra.run.smithi087.stdout: "tiers": [], 2024-09-17T18:16:25.233 INFO:teuthology.orchestra.run.smithi087.stdout: "tier_of": -1, 2024-09-17T18:16:25.233 INFO:teuthology.orchestra.run.smithi087.stdout: "read_tier": -1, 2024-09-17T18:16:25.233 INFO:teuthology.orchestra.run.smithi087.stdout: "write_tier": -1, 2024-09-17T18:16:25.233 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_mode": "none", 2024-09-17T18:16:25.233 INFO:teuthology.orchestra.run.smithi087.stdout: "target_max_bytes": 0, 2024-09-17T18:16:25.233 INFO:teuthology.orchestra.run.smithi087.stdout: "target_max_objects": 0, 2024-09-17T18:16:25.233 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T18:16:25.233 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T18:16:25.233 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T18:16:25.234 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_min_flush_age": 0, 2024-09-17T18:16:25.234 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_min_evict_age": 0, 2024-09-17T18:16:25.234 INFO:teuthology.orchestra.run.smithi087.stdout: "erasure_code_profile": "", 2024-09-17T18:16:25.234 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_params": { 2024-09-17T18:16:25.234 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "none" 2024-09-17T18:16:25.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.234 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_period": 0, 2024-09-17T18:16:25.234 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_count": 0, 2024-09-17T18:16:25.234 INFO:teuthology.orchestra.run.smithi087.stdout: "use_gmt_hitset": true, 2024-09-17T18:16:25.234 INFO:teuthology.orchestra.run.smithi087.stdout: "min_read_recency_for_promote": 0, 2024-09-17T18:16:25.234 INFO:teuthology.orchestra.run.smithi087.stdout: "min_write_recency_for_promote": 0, 2024-09-17T18:16:25.234 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T18:16:25.234 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_search_last_n": 0, 2024-09-17T18:16:25.235 INFO:teuthology.orchestra.run.smithi087.stdout: "grade_table": [], 2024-09-17T18:16:25.235 INFO:teuthology.orchestra.run.smithi087.stdout: "stripe_width": 0, 2024-09-17T18:16:25.235 INFO:teuthology.orchestra.run.smithi087.stdout: "expected_num_objects": 0, 2024-09-17T18:16:25.235 INFO:teuthology.orchestra.run.smithi087.stdout: "fast_read": false, 2024-09-17T18:16:25.235 INFO:teuthology.orchestra.run.smithi087.stdout: "options": { 2024-09-17T18:16:25.235 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_max": 32, 2024-09-17T18:16:25.235 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_min": 1 2024-09-17T18:16:25.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.235 INFO:teuthology.orchestra.run.smithi087.stdout: "application_metadata": { 2024-09-17T18:16:25.235 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": {} 2024-09-17T18:16:25.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.235 INFO:teuthology.orchestra.run.smithi087.stdout: "read_balance": { 2024-09-17T18:16:25.235 INFO:teuthology.orchestra.run.smithi087.stdout: "score_type": "Fair distribution", 2024-09-17T18:16:25.235 INFO:teuthology.orchestra.run.smithi087.stdout: "score_acting": 15.380000114440918, 2024-09-17T18:16:25.236 INFO:teuthology.orchestra.run.smithi087.stdout: "score_stable": 15.380000114440918, 2024-09-17T18:16:25.236 INFO:teuthology.orchestra.run.smithi087.stdout: "optimal_score": 0.12999999523162842, 2024-09-17T18:16:25.236 INFO:teuthology.orchestra.run.smithi087.stdout: "raw_score_acting": 2, 2024-09-17T18:16:25.236 INFO:teuthology.orchestra.run.smithi087.stdout: "raw_score_stable": 2, 2024-09-17T18:16:25.236 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity_weighted": 1, 2024-09-17T18:16:25.236 INFO:teuthology.orchestra.run.smithi087.stdout: "average_primary_affinity": 1, 2024-09-17T18:16:25.236 INFO:teuthology.orchestra.run.smithi087.stdout: "average_primary_affinity_weighted": 1 2024-09-17T18:16:25.236 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.236 INFO:teuthology.orchestra.run.smithi087.stdout: "pool": 2, 2024-09-17T18:16:25.236 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_name": "rbd", 2024-09-17T18:16:25.236 INFO:teuthology.orchestra.run.smithi087.stdout: "create_time": "2024-09-17T18:15:13.520321+0000", 2024-09-17T18:16:25.237 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 8193, 2024-09-17T18:16:25.237 INFO:teuthology.orchestra.run.smithi087.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T18:16:25.237 INFO:teuthology.orchestra.run.smithi087.stdout: "type": 1, 2024-09-17T18:16:25.237 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 2, 2024-09-17T18:16:25.237 INFO:teuthology.orchestra.run.smithi087.stdout: "min_size": 1, 2024-09-17T18:16:25.237 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_rule": 0, 2024-09-17T18:16:25.237 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_count": 0, 2024-09-17T18:16:25.237 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_target": 0, 2024-09-17T18:16:25.237 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T18:16:25.237 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T18:16:25.237 INFO:teuthology.orchestra.run.smithi087.stdout: "is_stretch_pool": false, 2024-09-17T18:16:25.237 INFO:teuthology.orchestra.run.smithi087.stdout: "object_hash": 2, 2024-09-17T18:16:25.237 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscale_mode": "off", 2024-09-17T18:16:25.238 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num": 8, 2024-09-17T18:16:25.238 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_placement_num": 8, 2024-09-17T18:16:25.238 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_placement_num_target": 8, 2024-09-17T18:16:25.238 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_target": 8, 2024-09-17T18:16:25.238 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_pending": 8, 2024-09-17T18:16:25.238 INFO:teuthology.orchestra.run.smithi087.stdout: "last_pg_merge_meta": { 2024-09-17T18:16:25.238 INFO:teuthology.orchestra.run.smithi087.stdout: "source_pgid": "0.0", 2024-09-17T18:16:25.238 INFO:teuthology.orchestra.run.smithi087.stdout: "ready_epoch": 0, 2024-09-17T18:16:25.238 INFO:teuthology.orchestra.run.smithi087.stdout: "last_epoch_started": 0, 2024-09-17T18:16:25.238 INFO:teuthology.orchestra.run.smithi087.stdout: "last_epoch_clean": 0, 2024-09-17T18:16:25.238 INFO:teuthology.orchestra.run.smithi087.stdout: "source_version": "0'0", 2024-09-17T18:16:25.238 INFO:teuthology.orchestra.run.smithi087.stdout: "target_version": "0'0" 2024-09-17T18:16:25.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.239 INFO:teuthology.orchestra.run.smithi087.stdout: "last_change": "27", 2024-09-17T18:16:25.239 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend": "0", 2024-09-17T18:16:25.239 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T18:16:25.239 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T18:16:25.239 INFO:teuthology.orchestra.run.smithi087.stdout: "auid": 0, 2024-09-17T18:16:25.239 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_mode": "selfmanaged", 2024-09-17T18:16:25.239 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_seq": 2, 2024-09-17T18:16:25.239 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_epoch": 27, 2024-09-17T18:16:25.239 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_snaps": [], 2024-09-17T18:16:25.239 INFO:teuthology.orchestra.run.smithi087.stdout: "removed_snaps": "[]", 2024-09-17T18:16:25.239 INFO:teuthology.orchestra.run.smithi087.stdout: "quota_max_bytes": 0, 2024-09-17T18:16:25.239 INFO:teuthology.orchestra.run.smithi087.stdout: "quota_max_objects": 0, 2024-09-17T18:16:25.239 INFO:teuthology.orchestra.run.smithi087.stdout: "tiers": [], 2024-09-17T18:16:25.240 INFO:teuthology.orchestra.run.smithi087.stdout: "tier_of": -1, 2024-09-17T18:16:25.240 INFO:teuthology.orchestra.run.smithi087.stdout: "read_tier": -1, 2024-09-17T18:16:25.240 INFO:teuthology.orchestra.run.smithi087.stdout: "write_tier": -1, 2024-09-17T18:16:25.240 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_mode": "none", 2024-09-17T18:16:25.240 INFO:teuthology.orchestra.run.smithi087.stdout: "target_max_bytes": 0, 2024-09-17T18:16:25.240 INFO:teuthology.orchestra.run.smithi087.stdout: "target_max_objects": 0, 2024-09-17T18:16:25.240 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T18:16:25.240 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T18:16:25.240 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T18:16:25.240 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_min_flush_age": 0, 2024-09-17T18:16:25.240 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_min_evict_age": 0, 2024-09-17T18:16:25.240 INFO:teuthology.orchestra.run.smithi087.stdout: "erasure_code_profile": "", 2024-09-17T18:16:25.241 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_params": { 2024-09-17T18:16:25.241 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "none" 2024-09-17T18:16:25.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.241 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_period": 0, 2024-09-17T18:16:25.241 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_count": 0, 2024-09-17T18:16:25.241 INFO:teuthology.orchestra.run.smithi087.stdout: "use_gmt_hitset": true, 2024-09-17T18:16:25.241 INFO:teuthology.orchestra.run.smithi087.stdout: "min_read_recency_for_promote": 0, 2024-09-17T18:16:25.241 INFO:teuthology.orchestra.run.smithi087.stdout: "min_write_recency_for_promote": 0, 2024-09-17T18:16:25.241 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T18:16:25.241 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_search_last_n": 0, 2024-09-17T18:16:25.241 INFO:teuthology.orchestra.run.smithi087.stdout: "grade_table": [], 2024-09-17T18:16:25.241 INFO:teuthology.orchestra.run.smithi087.stdout: "stripe_width": 0, 2024-09-17T18:16:25.241 INFO:teuthology.orchestra.run.smithi087.stdout: "expected_num_objects": 0, 2024-09-17T18:16:25.241 INFO:teuthology.orchestra.run.smithi087.stdout: "fast_read": false, 2024-09-17T18:16:25.242 INFO:teuthology.orchestra.run.smithi087.stdout: "options": {}, 2024-09-17T18:16:25.242 INFO:teuthology.orchestra.run.smithi087.stdout: "application_metadata": { 2024-09-17T18:16:25.242 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd": {} 2024-09-17T18:16:25.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.242 INFO:teuthology.orchestra.run.smithi087.stdout: "read_balance": { 2024-09-17T18:16:25.242 INFO:teuthology.orchestra.run.smithi087.stdout: "score_type": "Fair distribution", 2024-09-17T18:16:25.242 INFO:teuthology.orchestra.run.smithi087.stdout: "score_acting": 4, 2024-09-17T18:16:25.242 INFO:teuthology.orchestra.run.smithi087.stdout: "score_stable": 4, 2024-09-17T18:16:25.242 INFO:teuthology.orchestra.run.smithi087.stdout: "optimal_score": 0.75, 2024-09-17T18:16:25.242 INFO:teuthology.orchestra.run.smithi087.stdout: "raw_score_acting": 3, 2024-09-17T18:16:25.242 INFO:teuthology.orchestra.run.smithi087.stdout: "raw_score_stable": 3, 2024-09-17T18:16:25.242 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity_weighted": 1, 2024-09-17T18:16:25.242 INFO:teuthology.orchestra.run.smithi087.stdout: "average_primary_affinity": 1, 2024-09-17T18:16:25.243 INFO:teuthology.orchestra.run.smithi087.stdout: "average_primary_affinity_weighted": 1 2024-09-17T18:16:25.243 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.243 INFO:teuthology.orchestra.run.smithi087.stdout: "pool": 3, 2024-09-17T18:16:25.243 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_name": "unique_pool_0", 2024-09-17T18:16:25.243 INFO:teuthology.orchestra.run.smithi087.stdout: "create_time": "2024-09-17T18:15:25.661590+0000", 2024-09-17T18:16:25.243 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 8193, 2024-09-17T18:16:25.243 INFO:teuthology.orchestra.run.smithi087.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T18:16:25.243 INFO:teuthology.orchestra.run.smithi087.stdout: "type": 3, 2024-09-17T18:16:25.243 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 7, 2024-09-17T18:16:25.243 INFO:teuthology.orchestra.run.smithi087.stdout: "min_size": 5, 2024-09-17T18:16:25.243 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_rule": 1, 2024-09-17T18:16:25.244 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_count": 0, 2024-09-17T18:16:25.244 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_target": 0, 2024-09-17T18:16:25.244 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T18:16:25.244 INFO:teuthology.orchestra.run.smithi087.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T18:16:25.244 INFO:teuthology.orchestra.run.smithi087.stdout: "is_stretch_pool": false, 2024-09-17T18:16:25.244 INFO:teuthology.orchestra.run.smithi087.stdout: "object_hash": 2, 2024-09-17T18:16:25.244 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscale_mode": "off", 2024-09-17T18:16:25.244 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num": 16, 2024-09-17T18:16:25.244 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_placement_num": 16, 2024-09-17T18:16:25.244 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_placement_num_target": 16, 2024-09-17T18:16:25.244 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_target": 16, 2024-09-17T18:16:25.244 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num_pending": 16, 2024-09-17T18:16:25.244 INFO:teuthology.orchestra.run.smithi087.stdout: "last_pg_merge_meta": { 2024-09-17T18:16:25.245 INFO:teuthology.orchestra.run.smithi087.stdout: "source_pgid": "0.0", 2024-09-17T18:16:25.245 INFO:teuthology.orchestra.run.smithi087.stdout: "ready_epoch": 0, 2024-09-17T18:16:25.245 INFO:teuthology.orchestra.run.smithi087.stdout: "last_epoch_started": 0, 2024-09-17T18:16:25.245 INFO:teuthology.orchestra.run.smithi087.stdout: "last_epoch_clean": 0, 2024-09-17T18:16:25.245 INFO:teuthology.orchestra.run.smithi087.stdout: "source_version": "0'0", 2024-09-17T18:16:25.245 INFO:teuthology.orchestra.run.smithi087.stdout: "target_version": "0'0" 2024-09-17T18:16:25.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.245 INFO:teuthology.orchestra.run.smithi087.stdout: "last_change": "89", 2024-09-17T18:16:25.245 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend": "0", 2024-09-17T18:16:25.245 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T18:16:25.245 INFO:teuthology.orchestra.run.smithi087.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T18:16:25.245 INFO:teuthology.orchestra.run.smithi087.stdout: "auid": 0, 2024-09-17T18:16:25.245 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_mode": "selfmanaged", 2024-09-17T18:16:25.246 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_seq": 33, 2024-09-17T18:16:25.246 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_epoch": 89, 2024-09-17T18:16:25.246 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_snaps": [], 2024-09-17T18:16:25.246 INFO:teuthology.orchestra.run.smithi087.stdout: "removed_snaps": "[]", 2024-09-17T18:16:25.246 INFO:teuthology.orchestra.run.smithi087.stdout: "quota_max_bytes": 0, 2024-09-17T18:16:25.246 INFO:teuthology.orchestra.run.smithi087.stdout: "quota_max_objects": 0, 2024-09-17T18:16:25.246 INFO:teuthology.orchestra.run.smithi087.stdout: "tiers": [], 2024-09-17T18:16:25.246 INFO:teuthology.orchestra.run.smithi087.stdout: "tier_of": -1, 2024-09-17T18:16:25.246 INFO:teuthology.orchestra.run.smithi087.stdout: "read_tier": -1, 2024-09-17T18:16:25.246 INFO:teuthology.orchestra.run.smithi087.stdout: "write_tier": -1, 2024-09-17T18:16:25.246 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_mode": "none", 2024-09-17T18:16:25.246 INFO:teuthology.orchestra.run.smithi087.stdout: "target_max_bytes": 0, 2024-09-17T18:16:25.246 INFO:teuthology.orchestra.run.smithi087.stdout: "target_max_objects": 0, 2024-09-17T18:16:25.247 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T18:16:25.247 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T18:16:25.247 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T18:16:25.247 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_min_flush_age": 0, 2024-09-17T18:16:25.247 INFO:teuthology.orchestra.run.smithi087.stdout: "cache_min_evict_age": 0, 2024-09-17T18:16:25.247 INFO:teuthology.orchestra.run.smithi087.stdout: "erasure_code_profile": "shecprofile", 2024-09-17T18:16:25.247 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_params": { 2024-09-17T18:16:25.247 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "none" 2024-09-17T18:16:25.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.247 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_period": 0, 2024-09-17T18:16:25.247 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_count": 0, 2024-09-17T18:16:25.247 INFO:teuthology.orchestra.run.smithi087.stdout: "use_gmt_hitset": true, 2024-09-17T18:16:25.247 INFO:teuthology.orchestra.run.smithi087.stdout: "min_read_recency_for_promote": 0, 2024-09-17T18:16:25.247 INFO:teuthology.orchestra.run.smithi087.stdout: "min_write_recency_for_promote": 0, 2024-09-17T18:16:25.248 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T18:16:25.248 INFO:teuthology.orchestra.run.smithi087.stdout: "hit_set_search_last_n": 0, 2024-09-17T18:16:25.248 INFO:teuthology.orchestra.run.smithi087.stdout: "grade_table": [], 2024-09-17T18:16:25.248 INFO:teuthology.orchestra.run.smithi087.stdout: "stripe_width": 16384, 2024-09-17T18:16:25.248 INFO:teuthology.orchestra.run.smithi087.stdout: "expected_num_objects": 0, 2024-09-17T18:16:25.248 INFO:teuthology.orchestra.run.smithi087.stdout: "fast_read": false, 2024-09-17T18:16:25.248 INFO:teuthology.orchestra.run.smithi087.stdout: "options": {}, 2024-09-17T18:16:25.248 INFO:teuthology.orchestra.run.smithi087.stdout: "application_metadata": { 2024-09-17T18:16:25.248 INFO:teuthology.orchestra.run.smithi087.stdout: "rados": {} 2024-09-17T18:16:25.248 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.248 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.248 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T18:16:25.248 INFO:teuthology.orchestra.run.smithi087.stdout: "osds": [ 2024-09-17T18:16:25.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.249 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 0, 2024-09-17T18:16:25.249 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "15f80e97-3ed0-4557-b1f4-7ffa88c188dd", 2024-09-17T18:16:25.249 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.249 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.249 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.249 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.249 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.249 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.249 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 21, 2024-09-17T18:16:25.249 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:25.249 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.249 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.249 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.250 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.250 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.250 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6802", 2024-09-17T18:16:25.250 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:25.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.250 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.250 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6803", 2024-09-17T18:16:25.250 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:25.250 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.250 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.250 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.251 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.251 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.251 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6804", 2024-09-17T18:16:25.251 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:25.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.251 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.251 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6805", 2024-09-17T18:16:25.251 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:25.251 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.251 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.251 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.252 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.252 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.252 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6808", 2024-09-17T18:16:25.252 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:25.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.252 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.252 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6809", 2024-09-17T18:16:25.252 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:25.252 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.252 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.252 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.253 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.253 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.253 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6806", 2024-09-17T18:16:25.253 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:25.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.253 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.253 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6807", 2024-09-17T18:16:25.253 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2391985960 2024-09-17T18:16:25.253 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.253 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.253 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.87:6803/2391985960", 2024-09-17T18:16:25.254 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.87:6805/2391985960", 2024-09-17T18:16:25.254 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.87:6809/2391985960", 2024-09-17T18:16:25.254 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.87:6807/2391985960", 2024-09-17T18:16:25.254 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.254 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.254 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.254 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 1, 2024-09-17T18:16:25.254 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "a9b255d0-e8d9-4d9a-9118-742dc2ac013f", 2024-09-17T18:16:25.254 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.254 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.254 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.255 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.255 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.255 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.255 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 22, 2024-09-17T18:16:25.255 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 81, 2024-09-17T18:16:25.255 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.255 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.255 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.255 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.255 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.255 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6816", 2024-09-17T18:16:25.255 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:25.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.256 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.256 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6817", 2024-09-17T18:16:25.256 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:25.256 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.256 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.256 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.256 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.256 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.256 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6818", 2024-09-17T18:16:25.256 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:25.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.257 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.257 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6819", 2024-09-17T18:16:25.257 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:25.257 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.257 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.257 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.257 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.257 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.257 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6822", 2024-09-17T18:16:25.257 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:25.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.258 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.258 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6823", 2024-09-17T18:16:25.258 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:25.258 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.258 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.258 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.258 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.258 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.258 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6820", 2024-09-17T18:16:25.259 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:25.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.259 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.259 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6821", 2024-09-17T18:16:25.259 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 692679878 2024-09-17T18:16:25.259 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.259 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.259 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.134:6817/692679878", 2024-09-17T18:16:25.259 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.134:6819/692679878", 2024-09-17T18:16:25.259 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.134:6823/692679878", 2024-09-17T18:16:25.259 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.134:6821/692679878", 2024-09-17T18:16:25.259 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.260 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.260 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.260 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.260 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 2, 2024-09-17T18:16:25.260 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "76ad6be0-c351-4265-893f-cec4a82ecd76", 2024-09-17T18:16:25.260 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.260 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.260 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.260 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.260 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.260 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.260 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 22, 2024-09-17T18:16:25.261 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 0, 2024-09-17T18:16:25.261 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.261 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.261 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.261 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.261 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.261 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6824", 2024-09-17T18:16:25.261 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:25.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.261 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.261 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6825", 2024-09-17T18:16:25.262 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:25.262 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.262 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.262 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.262 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.262 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.262 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6826", 2024-09-17T18:16:25.262 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:25.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.262 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.262 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6827", 2024-09-17T18:16:25.262 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:25.263 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.263 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.263 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.263 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.263 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.263 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6830", 2024-09-17T18:16:25.263 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:25.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.263 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.263 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6831", 2024-09-17T18:16:25.264 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:25.264 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.264 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.264 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.264 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.264 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.264 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6828", 2024-09-17T18:16:25.264 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:25.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.264 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.265 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6829", 2024-09-17T18:16:25.265 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 197002546 2024-09-17T18:16:25.265 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.265 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.265 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.146:6825/197002546", 2024-09-17T18:16:25.265 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.146:6827/197002546", 2024-09-17T18:16:25.265 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.146:6831/197002546", 2024-09-17T18:16:25.265 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.146:6829/197002546", 2024-09-17T18:16:25.265 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.265 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.265 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.265 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.266 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 3, 2024-09-17T18:16:25.266 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "325d4c94-b21d-48cd-8f47-446e6a8bcbcb", 2024-09-17T18:16:25.266 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.266 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.266 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.266 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.266 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.266 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.266 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 23, 2024-09-17T18:16:25.266 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:25.266 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.266 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.266 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.267 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.267 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.267 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6816", 2024-09-17T18:16:25.267 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:25.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.267 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.267 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6817", 2024-09-17T18:16:25.267 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:25.267 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.267 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.268 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.268 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.268 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.268 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6818", 2024-09-17T18:16:25.268 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:25.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.268 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.268 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6819", 2024-09-17T18:16:25.268 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:25.268 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.268 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.269 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.269 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.269 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.269 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6822", 2024-09-17T18:16:25.269 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:25.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.269 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.269 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6823", 2024-09-17T18:16:25.269 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:25.269 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.269 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.270 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.270 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.270 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.270 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6820", 2024-09-17T18:16:25.270 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:25.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.270 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.270 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6821", 2024-09-17T18:16:25.270 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 450535216 2024-09-17T18:16:25.270 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.270 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.271 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.154:6817/450535216", 2024-09-17T18:16:25.271 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.154:6819/450535216", 2024-09-17T18:16:25.271 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.154:6823/450535216", 2024-09-17T18:16:25.271 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.154:6821/450535216", 2024-09-17T18:16:25.271 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.271 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.271 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.271 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.271 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 4, 2024-09-17T18:16:25.271 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "58b12ec9-29f5-4fea-a835-594fe03cd376", 2024-09-17T18:16:25.271 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.272 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.272 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.272 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.272 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.272 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.272 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 23, 2024-09-17T18:16:25.272 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:25.272 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.272 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.272 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.272 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.273 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.273 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6826", 2024-09-17T18:16:25.273 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:25.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.273 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.273 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6827", 2024-09-17T18:16:25.273 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:25.273 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.274 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.274 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.274 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.274 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.274 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6828", 2024-09-17T18:16:25.274 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:25.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.274 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.274 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6829", 2024-09-17T18:16:25.274 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:25.275 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.275 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.275 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.275 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.275 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.275 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6832", 2024-09-17T18:16:25.275 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:25.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.275 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.275 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6833", 2024-09-17T18:16:25.276 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:25.276 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.276 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.276 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.276 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.276 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.276 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6830", 2024-09-17T18:16:25.276 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:25.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.276 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.277 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6831", 2024-09-17T18:16:25.277 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1911207814 2024-09-17T18:16:25.277 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.277 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.277 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.87:6827/1911207814", 2024-09-17T18:16:25.277 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.87:6829/1911207814", 2024-09-17T18:16:25.277 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.87:6833/1911207814", 2024-09-17T18:16:25.277 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.87:6831/1911207814", 2024-09-17T18:16:25.277 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.277 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.277 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.277 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.278 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 5, 2024-09-17T18:16:25.278 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "27d3075f-32f4-4032-b0d4-fb7604c8bfda", 2024-09-17T18:16:25.278 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.278 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.278 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.278 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.278 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.278 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.278 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 22, 2024-09-17T18:16:25.278 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:25.278 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.278 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.279 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.279 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.279 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.279 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6824", 2024-09-17T18:16:25.279 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:25.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.279 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.279 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6825", 2024-09-17T18:16:25.279 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:25.279 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.279 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.280 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.280 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.280 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.280 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6826", 2024-09-17T18:16:25.280 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:25.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.280 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.280 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6827", 2024-09-17T18:16:25.280 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:25.280 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.280 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.281 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.281 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.281 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.281 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6830", 2024-09-17T18:16:25.281 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:25.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.281 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.281 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6831", 2024-09-17T18:16:25.281 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:25.281 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.281 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.282 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.282 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.282 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.282 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6828", 2024-09-17T18:16:25.282 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:25.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.282 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.283 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6829", 2024-09-17T18:16:25.283 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 391215769 2024-09-17T18:16:25.283 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.283 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.283 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.134:6825/391215769", 2024-09-17T18:16:25.283 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.134:6827/391215769", 2024-09-17T18:16:25.283 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.134:6831/391215769", 2024-09-17T18:16:25.283 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.134:6829/391215769", 2024-09-17T18:16:25.283 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.283 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.283 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.283 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.284 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 6, 2024-09-17T18:16:25.284 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "4326073e-338d-47f1-9860-5e44455f49ff", 2024-09-17T18:16:25.284 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.284 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.284 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.284 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.284 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.284 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.284 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 23, 2024-09-17T18:16:25.284 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:25.284 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.285 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.285 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.285 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.285 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.285 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6800", 2024-09-17T18:16:25.285 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:25.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.285 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.285 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6801", 2024-09-17T18:16:25.285 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:25.285 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.286 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.286 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.286 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.286 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.286 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6802", 2024-09-17T18:16:25.286 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:25.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.286 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.286 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6803", 2024-09-17T18:16:25.286 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:25.287 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.287 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.287 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.287 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.287 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.287 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6806", 2024-09-17T18:16:25.287 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:25.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.287 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.287 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6807", 2024-09-17T18:16:25.287 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:25.288 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.288 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.288 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.288 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.288 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.288 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6804", 2024-09-17T18:16:25.288 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:25.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.288 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.288 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6805", 2024-09-17T18:16:25.289 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1495925642 2024-09-17T18:16:25.289 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.289 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.289 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.146:6801/1495925642", 2024-09-17T18:16:25.289 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.146:6803/1495925642", 2024-09-17T18:16:25.289 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.146:6807/1495925642", 2024-09-17T18:16:25.289 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.146:6805/1495925642", 2024-09-17T18:16:25.289 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.289 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.289 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.289 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.290 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 7, 2024-09-17T18:16:25.290 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "455a2636-b754-4e1f-8933-16cd3fc126fd", 2024-09-17T18:16:25.290 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.290 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.290 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.290 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.290 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.290 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.290 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 23, 2024-09-17T18:16:25.290 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:25.290 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.290 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.290 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.290 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.291 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.291 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6808", 2024-09-17T18:16:25.291 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:25.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.291 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.291 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6809", 2024-09-17T18:16:25.291 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:25.291 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.291 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.291 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.291 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.292 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.292 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6810", 2024-09-17T18:16:25.292 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:25.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.292 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.292 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6811", 2024-09-17T18:16:25.292 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:25.292 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.292 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.292 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.293 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.293 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.293 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6814", 2024-09-17T18:16:25.293 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:25.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.293 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.293 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6815", 2024-09-17T18:16:25.293 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:25.293 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.293 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.293 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.294 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.294 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.294 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6812", 2024-09-17T18:16:25.294 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:25.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.294 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.294 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6813", 2024-09-17T18:16:25.294 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3979156181 2024-09-17T18:16:25.294 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.294 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.295 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.154:6809/3979156181", 2024-09-17T18:16:25.295 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.154:6811/3979156181", 2024-09-17T18:16:25.295 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.154:6815/3979156181", 2024-09-17T18:16:25.295 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.154:6813/3979156181", 2024-09-17T18:16:25.295 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.295 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.295 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.295 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.295 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 8, 2024-09-17T18:16:25.295 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "e64c05c6-2dce-4abc-8693-3e06b69723b6", 2024-09-17T18:16:25.295 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.295 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.296 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.296 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.296 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.296 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.296 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 22, 2024-09-17T18:16:25.296 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:25.296 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.296 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.296 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.296 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.296 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.296 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6818", 2024-09-17T18:16:25.297 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:25.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.297 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.297 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6819", 2024-09-17T18:16:25.297 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:25.297 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.297 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.297 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.297 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.297 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.298 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6820", 2024-09-17T18:16:25.298 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:25.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.298 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.298 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6821", 2024-09-17T18:16:25.298 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:25.298 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.298 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.298 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.298 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.298 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.299 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6824", 2024-09-17T18:16:25.299 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:25.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.299 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.299 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6825", 2024-09-17T18:16:25.299 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:25.299 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.299 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.299 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.299 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.299 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.300 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6822", 2024-09-17T18:16:25.300 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:25.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.300 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.300 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6823", 2024-09-17T18:16:25.300 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 740946583 2024-09-17T18:16:25.300 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.300 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.300 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.87:6819/740946583", 2024-09-17T18:16:25.300 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.87:6821/740946583", 2024-09-17T18:16:25.300 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.87:6825/740946583", 2024-09-17T18:16:25.300 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.87:6823/740946583", 2024-09-17T18:16:25.301 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.301 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.301 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.301 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.301 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 9, 2024-09-17T18:16:25.301 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "10bcf7b0-b22d-4a33-b090-b3c8083b6445", 2024-09-17T18:16:25.301 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.301 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.301 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.301 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.301 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.302 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.302 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 21, 2024-09-17T18:16:25.302 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 24, 2024-09-17T18:16:25.302 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.302 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.302 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.302 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.302 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.302 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6808", 2024-09-17T18:16:25.302 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:25.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.302 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.303 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6809", 2024-09-17T18:16:25.303 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:25.303 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.303 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.303 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.303 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.303 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.303 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6810", 2024-09-17T18:16:25.303 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:25.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.304 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.304 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6811", 2024-09-17T18:16:25.304 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:25.304 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.304 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.304 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.304 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.304 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.304 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6814", 2024-09-17T18:16:25.304 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:25.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.305 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.305 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6815", 2024-09-17T18:16:25.305 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:25.305 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.305 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.305 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.305 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.305 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.305 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6812", 2024-09-17T18:16:25.305 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:25.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.306 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.306 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6813", 2024-09-17T18:16:25.306 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2811218890 2024-09-17T18:16:25.306 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.306 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.306 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.134:6809/2811218890", 2024-09-17T18:16:25.306 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.134:6811/2811218890", 2024-09-17T18:16:25.306 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.134:6815/2811218890", 2024-09-17T18:16:25.306 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.134:6813/2811218890", 2024-09-17T18:16:25.306 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.306 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.307 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.307 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.307 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 10, 2024-09-17T18:16:25.307 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "a69d3d5e-353a-41aa-8b1c-fe7b0a68865f", 2024-09-17T18:16:25.307 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.307 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.307 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.307 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.307 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.307 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.307 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 22, 2024-09-17T18:16:25.307 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 82, 2024-09-17T18:16:25.308 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.308 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.308 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.308 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.308 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.308 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6816", 2024-09-17T18:16:25.308 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:25.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.308 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.308 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6817", 2024-09-17T18:16:25.308 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:25.309 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.309 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.309 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.309 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.309 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.309 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6818", 2024-09-17T18:16:25.309 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:25.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.309 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.309 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6819", 2024-09-17T18:16:25.310 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:25.310 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.310 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.310 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.310 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.310 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.310 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6822", 2024-09-17T18:16:25.310 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:25.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.310 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.310 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6823", 2024-09-17T18:16:25.311 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:25.311 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.311 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.311 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.311 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.311 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.311 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6820", 2024-09-17T18:16:25.311 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:25.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.311 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.311 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6821", 2024-09-17T18:16:25.312 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1660646458 2024-09-17T18:16:25.312 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.312 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.312 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.146:6817/1660646458", 2024-09-17T18:16:25.312 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.146:6819/1660646458", 2024-09-17T18:16:25.312 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.146:6823/1660646458", 2024-09-17T18:16:25.312 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.146:6821/1660646458", 2024-09-17T18:16:25.312 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.312 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.312 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.312 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.313 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 11, 2024-09-17T18:16:25.313 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "0a0e715b-1804-4e14-87e1-8c5de231b01d", 2024-09-17T18:16:25.313 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.313 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.313 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.313 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.313 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.313 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.313 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 21, 2024-09-17T18:16:25.313 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:25.313 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.313 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.314 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.314 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.314 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.314 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6800", 2024-09-17T18:16:25.314 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:25.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.314 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.314 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6801", 2024-09-17T18:16:25.314 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:25.314 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.315 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.315 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.315 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.315 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.315 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6802", 2024-09-17T18:16:25.315 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:25.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.315 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.315 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6803", 2024-09-17T18:16:25.316 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:25.316 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.316 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.316 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.316 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.316 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.316 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6806", 2024-09-17T18:16:25.316 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:25.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.317 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.317 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6807", 2024-09-17T18:16:25.317 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:25.317 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.317 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.317 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.317 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.317 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.317 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6804", 2024-09-17T18:16:25.317 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:25.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.318 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.318 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6805", 2024-09-17T18:16:25.318 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2080834051 2024-09-17T18:16:25.318 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.318 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.318 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.154:6801/2080834051", 2024-09-17T18:16:25.318 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.154:6803/2080834051", 2024-09-17T18:16:25.318 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.154:6807/2080834051", 2024-09-17T18:16:25.318 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.154:6805/2080834051", 2024-09-17T18:16:25.318 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.319 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.319 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.319 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.319 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 12, 2024-09-17T18:16:25.319 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "bdb1a692-4d6e-4a0c-a21f-db10b3af5025", 2024-09-17T18:16:25.319 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.319 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.319 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.319 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.319 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.319 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.320 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 22, 2024-09-17T18:16:25.320 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 0, 2024-09-17T18:16:25.320 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.320 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.320 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.320 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.320 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.320 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6810", 2024-09-17T18:16:25.320 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:25.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.321 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.321 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6811", 2024-09-17T18:16:25.321 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:25.321 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.321 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.321 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.321 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.321 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.321 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6812", 2024-09-17T18:16:25.321 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:25.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.322 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.322 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6813", 2024-09-17T18:16:25.322 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:25.322 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.322 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.322 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.322 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.322 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.322 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6816", 2024-09-17T18:16:25.322 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:25.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.323 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.323 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6817", 2024-09-17T18:16:25.323 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:25.323 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.323 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.323 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.323 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.323 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.323 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6814", 2024-09-17T18:16:25.324 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:25.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.324 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.324 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6815", 2024-09-17T18:16:25.324 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 249183944 2024-09-17T18:16:25.324 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.324 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.324 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.87:6811/249183944", 2024-09-17T18:16:25.324 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.87:6813/249183944", 2024-09-17T18:16:25.324 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.87:6817/249183944", 2024-09-17T18:16:25.324 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.87:6815/249183944", 2024-09-17T18:16:25.325 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.325 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.325 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.325 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.325 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 13, 2024-09-17T18:16:25.325 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "225fb253-25c2-4a10-a169-97971cb06e6c", 2024-09-17T18:16:25.325 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.325 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.325 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.325 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.325 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.325 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.326 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 22, 2024-09-17T18:16:25.326 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:25.326 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.326 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.326 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.326 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.326 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.326 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6800", 2024-09-17T18:16:25.326 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:25.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.326 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.327 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6801", 2024-09-17T18:16:25.327 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:25.327 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.327 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.327 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.327 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.327 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.327 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6802", 2024-09-17T18:16:25.327 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:25.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.327 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.328 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6803", 2024-09-17T18:16:25.328 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:25.328 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.328 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.328 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.328 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.328 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.328 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6806", 2024-09-17T18:16:25.328 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:25.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.328 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.329 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6807", 2024-09-17T18:16:25.329 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:25.329 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.329 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.329 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.329 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.329 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.329 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6804", 2024-09-17T18:16:25.329 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:25.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.330 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.330 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.134:6805", 2024-09-17T18:16:25.330 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3397465529 2024-09-17T18:16:25.330 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.330 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.330 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.134:6801/3397465529", 2024-09-17T18:16:25.330 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.134:6803/3397465529", 2024-09-17T18:16:25.330 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.134:6807/3397465529", 2024-09-17T18:16:25.330 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.134:6805/3397465529", 2024-09-17T18:16:25.330 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.330 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.330 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.330 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.331 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 14, 2024-09-17T18:16:25.331 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "43d0e878-9725-4208-ab75-04407b592477", 2024-09-17T18:16:25.331 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.331 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.331 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.331 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.331 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.331 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.331 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 23, 2024-09-17T18:16:25.331 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 31, 2024-09-17T18:16:25.331 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.331 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.332 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.332 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.332 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.332 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6808", 2024-09-17T18:16:25.332 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:25.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.332 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.332 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6809", 2024-09-17T18:16:25.332 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:25.332 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.332 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.333 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.333 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.333 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.333 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6810", 2024-09-17T18:16:25.333 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:25.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.333 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.333 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6811", 2024-09-17T18:16:25.333 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:25.333 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.333 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.334 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.334 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.334 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.334 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6814", 2024-09-17T18:16:25.334 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:25.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.334 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.334 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6815", 2024-09-17T18:16:25.334 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:25.334 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.334 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.335 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.335 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.335 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.335 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6812", 2024-09-17T18:16:25.335 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:25.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.335 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.335 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.146:6813", 2024-09-17T18:16:25.335 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 950976813 2024-09-17T18:16:25.335 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.335 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.336 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.146:6809/950976813", 2024-09-17T18:16:25.336 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.146:6811/950976813", 2024-09-17T18:16:25.336 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.146:6815/950976813", 2024-09-17T18:16:25.336 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.146:6813/950976813", 2024-09-17T18:16:25.336 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.336 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.336 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.336 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.336 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 15, 2024-09-17T18:16:25.336 INFO:teuthology.orchestra.run.smithi087.stdout: "uuid": "1c97e00d-ee0d-4bed-953c-c99a67afe33e", 2024-09-17T18:16:25.336 INFO:teuthology.orchestra.run.smithi087.stdout: "up": 1, 2024-09-17T18:16:25.337 INFO:teuthology.orchestra.run.smithi087.stdout: "in": 1, 2024-09-17T18:16:25.337 INFO:teuthology.orchestra.run.smithi087.stdout: "weight": 1, 2024-09-17T18:16:25.337 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_affinity": 1, 2024-09-17T18:16:25.337 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_begin": 0, 2024-09-17T18:16:25.337 INFO:teuthology.orchestra.run.smithi087.stdout: "last_clean_end": 0, 2024-09-17T18:16:25.337 INFO:teuthology.orchestra.run.smithi087.stdout: "up_from": 23, 2024-09-17T18:16:25.337 INFO:teuthology.orchestra.run.smithi087.stdout: "up_thru": 0, 2024-09-17T18:16:25.337 INFO:teuthology.orchestra.run.smithi087.stdout: "down_at": 0, 2024-09-17T18:16:25.337 INFO:teuthology.orchestra.run.smithi087.stdout: "lost_at": 0, 2024-09-17T18:16:25.337 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addrs": { 2024-09-17T18:16:25.337 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.337 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.337 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6824", 2024-09-17T18:16:25.338 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:25.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.338 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.338 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6825", 2024-09-17T18:16:25.338 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:25.338 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.338 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.338 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addrs": { 2024-09-17T18:16:25.338 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.338 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.338 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6826", 2024-09-17T18:16:25.339 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:25.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.339 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.339 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6827", 2024-09-17T18:16:25.339 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:25.339 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.339 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.339 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addrs": { 2024-09-17T18:16:25.339 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.339 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.339 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6830", 2024-09-17T18:16:25.340 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:25.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.340 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.340 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6831", 2024-09-17T18:16:25.340 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:25.340 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.340 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.340 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addrs": { 2024-09-17T18:16:25.340 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-17T18:16:25.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.340 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-17T18:16:25.341 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6828", 2024-09-17T18:16:25.341 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:25.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.341 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T18:16:25.341 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.154:6829", 2024-09-17T18:16:25.341 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3670919160 2024-09-17T18:16:25.341 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.341 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.341 INFO:teuthology.orchestra.run.smithi087.stdout: "public_addr": "172.21.15.154:6825/3670919160", 2024-09-17T18:16:25.341 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_addr": "172.21.15.154:6827/3670919160", 2024-09-17T18:16:25.341 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_back_addr": "172.21.15.154:6831/3670919160", 2024-09-17T18:16:25.341 INFO:teuthology.orchestra.run.smithi087.stdout: "heartbeat_front_addr": "172.21.15.154:6829/3670919160", 2024-09-17T18:16:25.342 INFO:teuthology.orchestra.run.smithi087.stdout: "state": [ 2024-09-17T18:16:25.342 INFO:teuthology.orchestra.run.smithi087.stdout: "exists", 2024-09-17T18:16:25.342 INFO:teuthology.orchestra.run.smithi087.stdout: "up" 2024-09-17T18:16:25.342 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.342 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.342 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T18:16:25.342 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_xinfo": [ 2024-09-17T18:16:25.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.342 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 0, 2024-09-17T18:16:25.342 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.342 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.342 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.342 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.342 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.342 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.473183+0000", 2024-09-17T18:16:25.343 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.343 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 1, 2024-09-17T18:16:25.343 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.343 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.343 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.343 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.343 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.343 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:16:11.844633+0000", 2024-09-17T18:16:25.343 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.343 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 2, 2024-09-17T18:16:25.344 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.344 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.344 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.344 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.344 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.344 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:16:15.197431+0000", 2024-09-17T18:16:25.344 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.344 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 3, 2024-09-17T18:16:25.344 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.344 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.344 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.345 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.345 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.345 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.802332+0000", 2024-09-17T18:16:25.345 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.345 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 4, 2024-09-17T18:16:25.345 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.345 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.345 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.345 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.345 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.345 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:16:17.886509+0000", 2024-09-17T18:16:25.345 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.346 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 5, 2024-09-17T18:16:25.346 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.346 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.346 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.346 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.346 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.346 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:16:17.377166+0000", 2024-09-17T18:16:25.346 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.346 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 6, 2024-09-17T18:16:25.346 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.347 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.347 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.347 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.347 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.347 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.773040+0000", 2024-09-17T18:16:25.347 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.347 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 7, 2024-09-17T18:16:25.347 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.347 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.347 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.347 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.348 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.348 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.794981+0000", 2024-09-17T18:16:25.348 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.348 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 8, 2024-09-17T18:16:25.348 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.348 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.348 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.348 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.348 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.348 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:16:23.502749+0000", 2024-09-17T18:16:25.348 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.349 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 9, 2024-09-17T18:16:25.349 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.349 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.349 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.349 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.349 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.349 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.445477+0000", 2024-09-17T18:16:25.349 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.349 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 10, 2024-09-17T18:16:25.349 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.349 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.350 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.350 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.350 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.350 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:16:11.740729+0000", 2024-09-17T18:16:25.350 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.350 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 11, 2024-09-17T18:16:25.350 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.350 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.350 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.350 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.350 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.351 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.296968+0000", 2024-09-17T18:16:25.351 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.351 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 12, 2024-09-17T18:16:25.351 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.351 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.351 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.351 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.351 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.351 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.903544+0000", 2024-09-17T18:16:25.351 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.351 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 13, 2024-09-17T18:16:25.352 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.352 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.352 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.352 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.352 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.352 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:09.548371+0000", 2024-09-17T18:16:25.352 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.352 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 14, 2024-09-17T18:16:25.352 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.352 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.352 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.353 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.353 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.353 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:16:15.089100+0000", 2024-09-17T18:16:25.353 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.353 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": 15, 2024-09-17T18:16:25.353 INFO:teuthology.orchestra.run.smithi087.stdout: "down_stamp": "0.000000", 2024-09-17T18:16:25.353 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_probability": 0, 2024-09-17T18:16:25.353 INFO:teuthology.orchestra.run.smithi087.stdout: "laggy_interval": 0, 2024-09-17T18:16:25.353 INFO:teuthology.orchestra.run.smithi087.stdout: "features": 4540719139924082687, 2024-09-17T18:16:25.353 INFO:teuthology.orchestra.run.smithi087.stdout: "old_weight": 0, 2024-09-17T18:16:25.353 INFO:teuthology.orchestra.run.smithi087.stdout: "last_purged_snaps_scrub": "2024-09-17T18:15:10.079389+0000", 2024-09-17T18:16:25.353 INFO:teuthology.orchestra.run.smithi087.stdout: "dead_epoch": 0 2024-09-17T18:16:25.354 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.354 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T18:16:25.354 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_upmap": [], 2024-09-17T18:16:25.354 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_upmap_items": [ 2024-09-17T18:16:25.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.354 INFO:teuthology.orchestra.run.smithi087.stdout: "pgid": "3.d", 2024-09-17T18:16:25.354 INFO:teuthology.orchestra.run.smithi087.stdout: "mappings": [ 2024-09-17T18:16:25.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.354 INFO:teuthology.orchestra.run.smithi087.stdout: "from": 13, 2024-09-17T18:16:25.354 INFO:teuthology.orchestra.run.smithi087.stdout: "to": 10 2024-09-17T18:16:25.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.354 INFO:teuthology.orchestra.run.smithi087.stdout: "from": 11, 2024-09-17T18:16:25.354 INFO:teuthology.orchestra.run.smithi087.stdout: "to": 3 2024-09-17T18:16:25.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.355 INFO:teuthology.orchestra.run.smithi087.stdout: "from": 8, 2024-09-17T18:16:25.355 INFO:teuthology.orchestra.run.smithi087.stdout: "to": 12 2024-09-17T18:16:25.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.355 INFO:teuthology.orchestra.run.smithi087.stdout: "from": 1, 2024-09-17T18:16:25.355 INFO:teuthology.orchestra.run.smithi087.stdout: "to": 9 2024-09-17T18:16:25.355 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.355 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.355 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.355 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T18:16:25.355 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_upmap_primaries": [], 2024-09-17T18:16:25.355 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_temp": [], 2024-09-17T18:16:25.356 INFO:teuthology.orchestra.run.smithi087.stdout: "primary_temp": [], 2024-09-17T18:16:25.356 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklist": {}, 2024-09-17T18:16:25.356 INFO:teuthology.orchestra.run.smithi087.stdout: "range_blocklist": {}, 2024-09-17T18:16:25.356 INFO:teuthology.orchestra.run.smithi087.stdout: "erasure_code_profiles": { 2024-09-17T18:16:25.356 INFO:teuthology.orchestra.run.smithi087.stdout: "default": { 2024-09-17T18:16:25.356 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-failure-domain": "osd", 2024-09-17T18:16:25.356 INFO:teuthology.orchestra.run.smithi087.stdout: "k": "2", 2024-09-17T18:16:25.356 INFO:teuthology.orchestra.run.smithi087.stdout: "m": "1", 2024-09-17T18:16:25.356 INFO:teuthology.orchestra.run.smithi087.stdout: "plugin": "jerasure", 2024-09-17T18:16:25.356 INFO:teuthology.orchestra.run.smithi087.stdout: "technique": "reed_sol_van" 2024-09-17T18:16:25.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.356 INFO:teuthology.orchestra.run.smithi087.stdout: "shecprofile": { 2024-09-17T18:16:25.356 INFO:teuthology.orchestra.run.smithi087.stdout: "c": "2", 2024-09-17T18:16:25.356 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-device-class": "", 2024-09-17T18:16:25.357 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-failure-domain": "osd", 2024-09-17T18:16:25.357 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-num-failure-domains": "0", 2024-09-17T18:16:25.357 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-osds-per-failure-domain": "0", 2024-09-17T18:16:25.357 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-root": "default", 2024-09-17T18:16:25.357 INFO:teuthology.orchestra.run.smithi087.stdout: "k": "4", 2024-09-17T18:16:25.357 INFO:teuthology.orchestra.run.smithi087.stdout: "m": "3", 2024-09-17T18:16:25.357 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "shecprofile", 2024-09-17T18:16:25.357 INFO:teuthology.orchestra.run.smithi087.stdout: "plugin": "shec", 2024-09-17T18:16:25.357 INFO:teuthology.orchestra.run.smithi087.stdout: "technique": "multiple" 2024-09-17T18:16:25.357 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.357 INFO:teuthology.orchestra.run.smithi087.stdout: "removed_snaps_queue": [ 2024-09-17T18:16:25.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.357 INFO:teuthology.orchestra.run.smithi087.stdout: "pool": 3, 2024-09-17T18:16:25.358 INFO:teuthology.orchestra.run.smithi087.stdout: "snaps": [ 2024-09-17T18:16:25.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.358 INFO:teuthology.orchestra.run.smithi087.stdout: "begin": 6, 2024-09-17T18:16:25.358 INFO:teuthology.orchestra.run.smithi087.stdout: "length": 3 2024-09-17T18:16:25.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.358 INFO:teuthology.orchestra.run.smithi087.stdout: "begin": 16, 2024-09-17T18:16:25.358 INFO:teuthology.orchestra.run.smithi087.stdout: "length": 1 2024-09-17T18:16:25.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.358 INFO:teuthology.orchestra.run.smithi087.stdout: "begin": 23, 2024-09-17T18:16:25.358 INFO:teuthology.orchestra.run.smithi087.stdout: "length": 1 2024-09-17T18:16:25.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T18:16:25.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-17T18:16:25.359 INFO:teuthology.orchestra.run.smithi087.stdout: "begin": 29, 2024-09-17T18:16:25.359 INFO:teuthology.orchestra.run.smithi087.stdout: "length": 1 2024-09-17T18:16:25.359 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.359 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T18:16:25.359 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.359 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T18:16:25.359 INFO:teuthology.orchestra.run.smithi087.stdout: "new_removed_snaps": [], 2024-09-17T18:16:25.359 INFO:teuthology.orchestra.run.smithi087.stdout: "new_purged_snaps": [], 2024-09-17T18:16:25.359 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_node_flags": {}, 2024-09-17T18:16:25.359 INFO:teuthology.orchestra.run.smithi087.stdout: "device_class_flags": {}, 2024-09-17T18:16:25.359 INFO:teuthology.orchestra.run.smithi087.stdout: "stretch_mode": { 2024-09-17T18:16:25.359 INFO:teuthology.orchestra.run.smithi087.stdout: "stretch_mode_enabled": false, 2024-09-17T18:16:25.359 INFO:teuthology.orchestra.run.smithi087.stdout: "stretch_bucket_count": 0, 2024-09-17T18:16:25.359 INFO:teuthology.orchestra.run.smithi087.stdout: "degraded_stretch_mode": 0, 2024-09-17T18:16:25.360 INFO:teuthology.orchestra.run.smithi087.stdout: "recovering_stretch_mode": 0, 2024-09-17T18:16:25.360 INFO:teuthology.orchestra.run.smithi087.stdout: "stretch_mode_bucket": 0 2024-09-17T18:16:25.360 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T18:16:25.360 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:16:25.361 INFO:tasks.thrashosds.thrasher:j is {'epoch': 89, 'fsid': '61bbf164-0ac7-4613-95ea-b1c3bf551ccb', 'created': '2024-09-17T18:14:58.620399+0000', 'modified': '2024-09-17T18:16:24.315955+0000', 'last_up_change': '2024-09-17T18:15:12.533086+0000', 'last_in_change': '2024-09-17T18:15:03.053866+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 16, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T18:15:11.543279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 15.380000114440918, 'score_stable': 15.380000114440918, 'optimal_score': 0.12999999523162842, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T18:15:13.520321+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 27, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.75, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-17T18:15:25.661590+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 3, 'size': 7, 'min_size': 5, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 33, 'snap_epoch': 89, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'shecprofile', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 16384, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '15f80e97-3ed0-4557-b1f4-7ffa88c188dd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 21, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6802', 'nonce': 2391985960}, {'type': 'v1', 'addr': '172.21.15.87:6803', 'nonce': 2391985960}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6804', 'nonce': 2391985960}, {'type': 'v1', 'addr': '172.21.15.87:6805', 'nonce': 2391985960}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6808', 'nonce': 2391985960}, {'type': 'v1', 'addr': '172.21.15.87:6809', 'nonce': 2391985960}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6806', 'nonce': 2391985960}, {'type': 'v1', 'addr': '172.21.15.87:6807', 'nonce': 2391985960}]}, 'public_addr': '172.21.15.87:6803/2391985960', 'cluster_addr': '172.21.15.87:6805/2391985960', 'heartbeat_back_addr': '172.21.15.87:6809/2391985960', 'heartbeat_front_addr': '172.21.15.87:6807/2391985960', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a9b255d0-e8d9-4d9a-9118-742dc2ac013f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 81, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6816', 'nonce': 692679878}, {'type': 'v1', 'addr': '172.21.15.134:6817', 'nonce': 692679878}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6818', 'nonce': 692679878}, {'type': 'v1', 'addr': '172.21.15.134:6819', 'nonce': 692679878}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6822', 'nonce': 692679878}, {'type': 'v1', 'addr': '172.21.15.134:6823', 'nonce': 692679878}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6820', 'nonce': 692679878}, {'type': 'v1', 'addr': '172.21.15.134:6821', 'nonce': 692679878}]}, 'public_addr': '172.21.15.134:6817/692679878', 'cluster_addr': '172.21.15.134:6819/692679878', 'heartbeat_back_addr': '172.21.15.134:6823/692679878', 'heartbeat_front_addr': '172.21.15.134:6821/692679878', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '76ad6be0-c351-4265-893f-cec4a82ecd76', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6824', 'nonce': 197002546}, {'type': 'v1', 'addr': '172.21.15.146:6825', 'nonce': 197002546}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6826', 'nonce': 197002546}, {'type': 'v1', 'addr': '172.21.15.146:6827', 'nonce': 197002546}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6830', 'nonce': 197002546}, {'type': 'v1', 'addr': '172.21.15.146:6831', 'nonce': 197002546}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6828', 'nonce': 197002546}, {'type': 'v1', 'addr': '172.21.15.146:6829', 'nonce': 197002546}]}, 'public_addr': '172.21.15.146:6825/197002546', 'cluster_addr': '172.21.15.146:6827/197002546', 'heartbeat_back_addr': '172.21.15.146:6831/197002546', 'heartbeat_front_addr': '172.21.15.146:6829/197002546', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '325d4c94-b21d-48cd-8f47-446e6a8bcbcb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 23, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6816', 'nonce': 450535216}, {'type': 'v1', 'addr': '172.21.15.154:6817', 'nonce': 450535216}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6818', 'nonce': 450535216}, {'type': 'v1', 'addr': '172.21.15.154:6819', 'nonce': 450535216}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6822', 'nonce': 450535216}, {'type': 'v1', 'addr': '172.21.15.154:6823', 'nonce': 450535216}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6820', 'nonce': 450535216}, {'type': 'v1', 'addr': '172.21.15.154:6821', 'nonce': 450535216}]}, 'public_addr': '172.21.15.154:6817/450535216', 'cluster_addr': '172.21.15.154:6819/450535216', 'heartbeat_back_addr': '172.21.15.154:6823/450535216', 'heartbeat_front_addr': '172.21.15.154:6821/450535216', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '58b12ec9-29f5-4fea-a835-594fe03cd376', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 23, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6826', 'nonce': 1911207814}, {'type': 'v1', 'addr': '172.21.15.87:6827', 'nonce': 1911207814}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6828', 'nonce': 1911207814}, {'type': 'v1', 'addr': '172.21.15.87:6829', 'nonce': 1911207814}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6832', 'nonce': 1911207814}, {'type': 'v1', 'addr': '172.21.15.87:6833', 'nonce': 1911207814}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6830', 'nonce': 1911207814}, {'type': 'v1', 'addr': '172.21.15.87:6831', 'nonce': 1911207814}]}, 'public_addr': '172.21.15.87:6827/1911207814', 'cluster_addr': '172.21.15.87:6829/1911207814', 'heartbeat_back_addr': '172.21.15.87:6833/1911207814', 'heartbeat_front_addr': '172.21.15.87:6831/1911207814', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '27d3075f-32f4-4032-b0d4-fb7604c8bfda', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 391215769}, {'type': 'v1', 'addr': '172.21.15.134:6825', 'nonce': 391215769}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 391215769}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 391215769}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6830', 'nonce': 391215769}, {'type': 'v1', 'addr': '172.21.15.134:6831', 'nonce': 391215769}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6828', 'nonce': 391215769}, {'type': 'v1', 'addr': '172.21.15.134:6829', 'nonce': 391215769}]}, 'public_addr': '172.21.15.134:6825/391215769', 'cluster_addr': '172.21.15.134:6827/391215769', 'heartbeat_back_addr': '172.21.15.134:6831/391215769', 'heartbeat_front_addr': '172.21.15.134:6829/391215769', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '4326073e-338d-47f1-9860-5e44455f49ff', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 23, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6800', 'nonce': 1495925642}, {'type': 'v1', 'addr': '172.21.15.146:6801', 'nonce': 1495925642}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6802', 'nonce': 1495925642}, {'type': 'v1', 'addr': '172.21.15.146:6803', 'nonce': 1495925642}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6806', 'nonce': 1495925642}, {'type': 'v1', 'addr': '172.21.15.146:6807', 'nonce': 1495925642}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6804', 'nonce': 1495925642}, {'type': 'v1', 'addr': '172.21.15.146:6805', 'nonce': 1495925642}]}, 'public_addr': '172.21.15.146:6801/1495925642', 'cluster_addr': '172.21.15.146:6803/1495925642', 'heartbeat_back_addr': '172.21.15.146:6807/1495925642', 'heartbeat_front_addr': '172.21.15.146:6805/1495925642', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '455a2636-b754-4e1f-8933-16cd3fc126fd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 23, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6808', 'nonce': 3979156181}, {'type': 'v1', 'addr': '172.21.15.154:6809', 'nonce': 3979156181}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6810', 'nonce': 3979156181}, {'type': 'v1', 'addr': '172.21.15.154:6811', 'nonce': 3979156181}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6814', 'nonce': 3979156181}, {'type': 'v1', 'addr': '172.21.15.154:6815', 'nonce': 3979156181}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6812', 'nonce': 3979156181}, {'type': 'v1', 'addr': '172.21.15.154:6813', 'nonce': 3979156181}]}, 'public_addr': '172.21.15.154:6809/3979156181', 'cluster_addr': '172.21.15.154:6811/3979156181', 'heartbeat_back_addr': '172.21.15.154:6815/3979156181', 'heartbeat_front_addr': '172.21.15.154:6813/3979156181', 'state': ['exists', 'up']}, {'osd': 8, 'uuid': 'e64c05c6-2dce-4abc-8693-3e06b69723b6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6818', 'nonce': 740946583}, {'type': 'v1', 'addr': '172.21.15.87:6819', 'nonce': 740946583}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6820', 'nonce': 740946583}, {'type': 'v1', 'addr': '172.21.15.87:6821', 'nonce': 740946583}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6824', 'nonce': 740946583}, {'type': 'v1', 'addr': '172.21.15.87:6825', 'nonce': 740946583}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6822', 'nonce': 740946583}, {'type': 'v1', 'addr': '172.21.15.87:6823', 'nonce': 740946583}]}, 'public_addr': '172.21.15.87:6819/740946583', 'cluster_addr': '172.21.15.87:6821/740946583', 'heartbeat_back_addr': '172.21.15.87:6825/740946583', 'heartbeat_front_addr': '172.21.15.87:6823/740946583', 'state': ['exists', 'up']}, {'osd': 9, 'uuid': '10bcf7b0-b22d-4a33-b090-b3c8083b6445', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 21, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6808', 'nonce': 2811218890}, {'type': 'v1', 'addr': '172.21.15.134:6809', 'nonce': 2811218890}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6810', 'nonce': 2811218890}, {'type': 'v1', 'addr': '172.21.15.134:6811', 'nonce': 2811218890}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6814', 'nonce': 2811218890}, {'type': 'v1', 'addr': '172.21.15.134:6815', 'nonce': 2811218890}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6812', 'nonce': 2811218890}, {'type': 'v1', 'addr': '172.21.15.134:6813', 'nonce': 2811218890}]}, 'public_addr': '172.21.15.134:6809/2811218890', 'cluster_addr': '172.21.15.134:6811/2811218890', 'heartbeat_back_addr': '172.21.15.134:6815/2811218890', 'heartbeat_front_addr': '172.21.15.134:6813/2811218890', 'state': ['exists', 'up']}, {'osd': 10, 'uuid': 'a69d3d5e-353a-41aa-8b1c-fe7b0a68865f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 82, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6816', 'nonce': 1660646458}, {'type': 'v1', 'addr': '172.21.15.146:6817', 'nonce': 1660646458}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6818', 'nonce': 1660646458}, {'type': 'v1', 'addr': '172.21.15.146:6819', 'nonce': 1660646458}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6822', 'nonce': 1660646458}, {'type': 'v1', 'addr': '172.21.15.146:6823', 'nonce': 1660646458}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6820', 'nonce': 1660646458}, {'type': 'v1', 'addr': '172.21.15.146:6821', 'nonce': 1660646458}]}, 'public_addr': '172.21.15.146:6817/1660646458', 'cluster_addr': '172.21.15.146:6819/1660646458', 'heartbeat_back_addr': '172.21.15.146:6823/1660646458', 'heartbeat_front_addr': '172.21.15.146:6821/1660646458', 'state': ['exists', 'up']}, {'osd': 11, 'uuid': '0a0e715b-1804-4e14-87e1-8c5de231b01d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 21, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6800', 'nonce': 2080834051}, {'type': 'v1', 'addr': '172.21.15.154:6801', 'nonce': 2080834051}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6802', 'nonce': 2080834051}, {'type': 'v1', 'addr': '172.21.15.154:6803', 'nonce': 2080834051}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6806', 'nonce': 2080834051}, {'type': 'v1', 'addr': '172.21.15.154:6807', 'nonce': 2080834051}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6804', 'nonce': 2080834051}, {'type': 'v1', 'addr': '172.21.15.154:6805', 'nonce': 2080834051}]}, 'public_addr': '172.21.15.154:6801/2080834051', 'cluster_addr': '172.21.15.154:6803/2080834051', 'heartbeat_back_addr': '172.21.15.154:6807/2080834051', 'heartbeat_front_addr': '172.21.15.154:6805/2080834051', 'state': ['exists', 'up']}, {'osd': 12, 'uuid': 'bdb1a692-4d6e-4a0c-a21f-db10b3af5025', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6810', 'nonce': 249183944}, {'type': 'v1', 'addr': '172.21.15.87:6811', 'nonce': 249183944}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6812', 'nonce': 249183944}, {'type': 'v1', 'addr': '172.21.15.87:6813', 'nonce': 249183944}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6816', 'nonce': 249183944}, {'type': 'v1', 'addr': '172.21.15.87:6817', 'nonce': 249183944}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6814', 'nonce': 249183944}, {'type': 'v1', 'addr': '172.21.15.87:6815', 'nonce': 249183944}]}, 'public_addr': '172.21.15.87:6811/249183944', 'cluster_addr': '172.21.15.87:6813/249183944', 'heartbeat_back_addr': '172.21.15.87:6817/249183944', 'heartbeat_front_addr': '172.21.15.87:6815/249183944', 'state': ['exists', 'up']}, {'osd': 13, 'uuid': '225fb253-25c2-4a10-a169-97971cb06e6c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 3397465529}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 3397465529}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 3397465529}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 3397465529}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 3397465529}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 3397465529}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 3397465529}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 3397465529}]}, 'public_addr': '172.21.15.134:6801/3397465529', 'cluster_addr': '172.21.15.134:6803/3397465529', 'heartbeat_back_addr': '172.21.15.134:6807/3397465529', 'heartbeat_front_addr': '172.21.15.134:6805/3397465529', 'state': ['exists', 'up']}, {'osd': 14, 'uuid': '43d0e878-9725-4208-ab75-04407b592477', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 23, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6808', 'nonce': 950976813}, {'type': 'v1', 'addr': '172.21.15.146:6809', 'nonce': 950976813}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6810', 'nonce': 950976813}, {'type': 'v1', 'addr': '172.21.15.146:6811', 'nonce': 950976813}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6814', 'nonce': 950976813}, {'type': 'v1', 'addr': '172.21.15.146:6815', 'nonce': 950976813}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6812', 'nonce': 950976813}, {'type': 'v1', 'addr': '172.21.15.146:6813', 'nonce': 950976813}]}, 'public_addr': '172.21.15.146:6809/950976813', 'cluster_addr': '172.21.15.146:6811/950976813', 'heartbeat_back_addr': '172.21.15.146:6815/950976813', 'heartbeat_front_addr': '172.21.15.146:6813/950976813', 'state': ['exists', 'up']}, {'osd': 15, 'uuid': '1c97e00d-ee0d-4bed-953c-c99a67afe33e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 23, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6824', 'nonce': 3670919160}, {'type': 'v1', 'addr': '172.21.15.154:6825', 'nonce': 3670919160}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6826', 'nonce': 3670919160}, {'type': 'v1', 'addr': '172.21.15.154:6827', 'nonce': 3670919160}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6830', 'nonce': 3670919160}, {'type': 'v1', 'addr': '172.21.15.154:6831', 'nonce': 3670919160}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6828', 'nonce': 3670919160}, {'type': 'v1', 'addr': '172.21.15.154:6829', 'nonce': 3670919160}]}, 'public_addr': '172.21.15.154:6825/3670919160', 'cluster_addr': '172.21.15.154:6827/3670919160', 'heartbeat_back_addr': '172.21.15.154:6831/3670919160', 'heartbeat_front_addr': '172.21.15.154:6829/3670919160', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.473183+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:16:11.844633+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:16:15.197431+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.802332+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:16:17.886509+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:16:17.377166+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.773040+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.794981+0000', 'dead_epoch': 0}, {'osd': 8, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:16:23.502749+0000', 'dead_epoch': 0}, {'osd': 9, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.445477+0000', 'dead_epoch': 0}, {'osd': 10, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:16:11.740729+0000', 'dead_epoch': 0}, {'osd': 11, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.296968+0000', 'dead_epoch': 0}, {'osd': 12, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.903544+0000', 'dead_epoch': 0}, {'osd': 13, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:09.548371+0000', 'dead_epoch': 0}, {'osd': 14, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:16:15.089100+0000', 'dead_epoch': 0}, {'osd': 15, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T18:15:10.079389+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.d', 'mappings': [{'from': 13, 'to': 10}, {'from': 11, 'to': 3}, {'from': 8, 'to': 12}, {'from': 1, 'to': 9}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}, 'shecprofile': {'c': '2', 'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-num-failure-domains': '0', 'crush-osds-per-failure-domain': '0', 'crush-root': 'default', 'k': '4', 'm': '3', 'name': 'shecprofile', 'plugin': 'shec', 'technique': 'multiple'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 6, 'length': 3}, {'begin': 16, 'length': 1}, {'begin': 23, 'length': 1}, {'begin': 29, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T18:16:25.361 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:16:25.363 INFO:tasks.rados.rados.0.smithi154.stdout:381: done (3 left) 2024-09-17T18:16:25.363 INFO:tasks.rados.rados.0.smithi154.stdout:382: done (2 left) 2024-09-17T18:16:25.363 INFO:tasks.rados.rados.0.smithi154.stdout:383: done (1 left) 2024-09-17T18:16:25.363 INFO:tasks.rados.rados.0.smithi154.stdout:384: done (0 left) 2024-09-17T18:16:25.363 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 1 current snap is 33 2024-09-17T18:16:25.363 INFO:tasks.rados.rados.0.smithi154.stdout:385: seq_num 153 ranges {2441216=163840} 2024-09-17T18:16:25.364 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:25.361+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:25.370 INFO:tasks.rados.rados.0.smithi154.stdout:385: writing smithi15432074-1 from 2441216 to 2605056 tid 1 2024-09-17T18:16:25.371 INFO:tasks.rados.rados.0.smithi154.stdout:386: rollback oid 41 current snap is 33 2024-09-17T18:16:25.371 INFO:tasks.rados.rados.0.smithi154.stdout:rollback oid 41 to 32 2024-09-17T18:16:25.371 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 5 current snap is 33 2024-09-17T18:16:25.371 INFO:tasks.rados.rados.0.smithi154.stdout:387: seq_num 154 ranges {4997120=180224} 2024-09-17T18:16:25.424 INFO:tasks.rados.rados.0.smithi154.stdout:387: writing smithi15432074-5 from 4997120 to 5177344 tid 1 2024-09-17T18:16:25.424 INFO:tasks.rados.rados.0.smithi154.stdout:388: snap_remove snap 28 2024-09-17T18:16:25.463 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:16:25.457+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:16:25.492 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:25.492 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:25.492 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T18:16:25.492 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:25.507 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T18:16:25.564 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:25.561+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:25.665 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:25.662+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:25.672 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:25.672 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:25.672 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T18:16:25.672 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T18:16:25.672 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:25.674 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:16:25.675 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:16:25.687 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T18:16:25.693 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-17T18:16:25.515712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":152961587,"num_objects":121,"num_object_clones":68,"num_object_copies":827,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":8,"num_read":517,"num_read_kb":188221,"num_write":990,"num_write_kb":174002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":46055424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2069,"ondisk_log_size":2069,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":838820,"kb_used_data":280048,"kb_used_omap":24,"kb_used_meta":558375,"kb_avail":1509110620,"statfs":{"total":1546188226560,"available":1545329274880,"internally_reserved":0,"allocated":286769152,"data_stored":397066452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":571776081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-491520,"num_objects":-22,"num_object_clones":-21,"num_object_copies":-154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":29,"num_read_kb":12649,"num_write":55,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000997"},"pg_stats":[{"pgid":"3.f","version":"86'44","reported_seq":320,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T18:16:21.367299+0000","last_change":"2024-09-17T18:16:21.370045+0000","last_active":"2024-09-17T18:16:21.367299+0000","last_peered":"2024-09-17T18:16:21.367299+0000","last_clean":"2024-09-17T18:16:21.367299+0000","last_became_active":"2024-09-17T18:15:28.090920+0000","last_became_peered":"2024-09-17T18:15:28.090920+0000","last_unstale":"2024-09-17T18:16:21.367299+0000","last_undegraded":"2024-09-17T18:16:21.367299+0000","last_fullsized":"2024-09-17T18:16:21.367299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.329398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030690093000000002,"stat_sum":{"num_bytes":9879552,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":26814,"num_write":18,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3,15,14,2,11,0],"acting":[13,3,15,14,2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.e","version":"86'46","reported_seq":317,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T18:16:22.342360+0000","last_change":"2024-09-17T18:16:21.378301+0000","last_active":"2024-09-17T18:16:22.342360+0000","last_peered":"2024-09-17T18:16:22.342360+0000","last_clean":"2024-09-17T18:16:22.342360+0000","last_became_active":"2024-09-17T18:15:28.110648+0000","last_became_peered":"2024-09-17T18:15:28.110648+0000","last_unstale":"2024-09-17T18:16:22.342360+0000","last_undegraded":"2024-09-17T18:16:22.342360+0000","last_fullsized":"2024-09-17T18:16:22.342360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:56.323367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037728224999999997,"stat_sum":{"num_bytes":1982464,"num_objects":5,"num_object_clones":3,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":14,"num_read_kb":946,"num_write":36,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14,6,13,8,3,12],"acting":[11,14,6,13,8,3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.d","version":"87'386","reported_seq":716,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T18:16:22.348100+0000","last_change":"2024-09-17T18:16:21.426476+0000","last_active":"2024-09-17T18:16:22.348100+0000","last_peered":"2024-09-17T18:16:22.348100+0000","last_clean":"2024-09-17T18:16:22.348100+0000","last_became_active":"2024-09-17T18:16:18.338570+0000","last_became_peered":"2024-09-17T18:16:18.338570+0000","last_unstale":"2024-09-17T18:16:22.348100+0000","last_undegraded":"2024-09-17T18:16:22.348100+0000","last_fullsized":"2024-09-17T18:16:22.348100+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:48.596357+0000","scrub_duration":0,"objects_trimmed":7,"snaptrim_duration":0.087582143000000001,"stat_sum":{"num_bytes":33161216,"num_objects":22,"num_object_clones":13,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":1,"num_read":106,"num_read_kb":44704,"num_write":187,"num_write_kb":35216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":46055424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,3,15,9,12,4],"acting":[10,1,3,15,9,12,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.c","version":"86'125","reported_seq":384,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T18:16:21.403398+0000","last_change":"2024-09-17T18:16:21.405245+0000","last_active":"2024-09-17T18:16:21.403398+0000","last_peered":"2024-09-17T18:16:21.403398+0000","last_clean":"2024-09-17T18:16:21.403398+0000","last_became_active":"2024-09-17T18:15:28.112093+0000","last_became_peered":"2024-09-17T18:15:28.112093+0000","last_unstale":"2024-09-17T18:16:21.403398+0000","last_undegraded":"2024-09-17T18:16:21.403398+0000","last_fullsized":"2024-09-17T18:16:21.403398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:35.782521+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.064926914000000002,"stat_sum":{"num_bytes":3424256,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":25,"num_read_kb":8129,"num_write":33,"num_write_kb":7248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,3,7,12,14],"acting":[5,8,13,3,7,12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.b","version":"88'190","reported_seq":442,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T18:16:23.363889+0000","last_change":"2024-09-17T18:16:23.364853+0000","last_active":"2024-09-17T18:16:23.363889+0000","last_peered":"2024-09-17T18:16:23.363889+0000","last_clean":"2024-09-17T18:16:23.363889+0000","last_became_active":"2024-09-17T18:15:28.111526+0000","last_became_peered":"2024-09-17T18:15:28.111526+0000","last_unstale":"2024-09-17T18:16:23.363889+0000","last_undegraded":"2024-09-17T18:16:23.363889+0000","last_fullsized":"2024-09-17T18:16:23.363889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:38.784566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022186731000000001,"stat_sum":{"num_bytes":17580032,"num_objects":10,"num_object_clones":5,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":26,"num_read_kb":110,"num_write":116,"num_write_kb":19408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,10,12,11,1,14],"acting":[4,0,10,12,11,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"17","length":"1"},{"start":"1d","length":"1"}]},{"pgid":"3.a","version":"86'256","reported_seq":502,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T18:16:21.431353+0000","last_change":"2024-09-17T18:16:21.412381+0000","last_active":"2024-09-17T18:16:21.431353+0000","last_peered":"2024-09-17T18:16:21.431353+0000","last_clean":"2024-09-17T18:16:21.431353+0000","last_became_active":"2024-09-17T18:15:28.089449+0000","last_became_peered":"2024-09-17T18:15:28.089449+0000","last_unstale":"2024-09-17T18:16:21.431353+0000","last_undegraded":"2024-09-17T18:16:21.431353+0000","last_fullsized":"2024-09-17T18:16:21.431353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:54.689987+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.072463262000000001,"stat_sum":{"num_bytes":18563072,"num_objects":14,"num_object_clones":9,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":1,"num_read":51,"num_read_kb":24861,"num_write":62,"num_write_kb":19168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,6,5,3,15,4],"acting":[13,1,6,5,3,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.9","version":"86'194","reported_seq":450,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T18:16:23.330246+0000","last_change":"2024-09-17T18:16:23.331077+0000","last_active":"2024-09-17T18:16:23.330246+0000","last_peered":"2024-09-17T18:16:23.330246+0000","last_clean":"2024-09-17T18:16:23.330246+0000","last_became_active":"2024-09-17T18:15:28.095114+0000","last_became_peered":"2024-09-17T18:15:28.095114+0000","last_unstale":"2024-09-17T18:16:23.330246+0000","last_undegraded":"2024-09-17T18:16:23.330246+0000","last_fullsized":"2024-09-17T18:16:23.330246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:38.259226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024289200000000002,"stat_sum":{"num_bytes":11157504,"num_objects":8,"num_object_clones":4,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":27,"num_read_kb":5061,"num_write":74,"num_write_kb":14144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,10,11,5,8,3],"acting":[7,2,10,11,5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"17","length":"1"},{"start":"1d","length":"1"}]},{"pgid":"3.8","version":"88'117","reported_seq":375,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T18:16:23.341969+0000","last_change":"2024-09-17T18:16:23.343827+0000","last_active":"2024-09-17T18:16:23.341969+0000","last_peered":"2024-09-17T18:16:23.341969+0000","last_clean":"2024-09-17T18:16:23.341969+0000","last_became_active":"2024-09-17T18:15:28.088066+0000","last_became_peered":"2024-09-17T18:15:28.088066+0000","last_unstale":"2024-09-17T18:16:23.341969+0000","last_undegraded":"2024-09-17T18:16:23.341969+0000","last_fullsized":"2024-09-17T18:16:23.341969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.831669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022403208000000001,"stat_sum":{"num_bytes":9682944,"num_objects":8,"num_object_clones":5,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":12,"num_read_kb":9,"num_write":35,"num_write_kb":10112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,11,3,15,1,7],"acting":[6,0,11,3,15,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"17","length":"1"},{"start":"1d","length":"1"}]},{"pgid":"1.0","version":"25'112","reported_seq":272,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T18:16:23.321290+0000","last_change":"2024-09-17T18:15:13.924291+0000","last_active":"2024-09-17T18:16:23.321290+0000","last_peered":"2024-09-17T18:16:23.321290+0000","last_clean":"2024-09-17T18:16:23.321290+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:16:23.321290+0000","last_undegraded":"2024-09-17T18:16:23.321290+0000","last_fullsized":"2024-09-17T18:16:23.321290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:15:12.533086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.379235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T18:16:23.333537+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:16:23.333537+0000","last_peered":"2024-09-17T18:16:23.333537+0000","last_clean":"2024-09-17T18:16:23.333537+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:16:23.333537+0000","last_undegraded":"2024-09-17T18:16:23.333537+0000","last_fullsized":"2024-09-17T18:16:23.333537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"88'91","reported_seq":358,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T18:16:23.349707+0000","last_change":"2024-09-17T18:16:23.352188+0000","last_active":"2024-09-17T18:16:23.349707+0000","last_peered":"2024-09-17T18:16:23.349707+0000","last_clean":"2024-09-17T18:16:23.349707+0000","last_became_active":"2024-09-17T18:15:28.089102+0000","last_became_peered":"2024-09-17T18:15:28.089102+0000","last_unstale":"2024-09-17T18:16:23.349707+0000","last_undegraded":"2024-09-17T18:16:23.349707+0000","last_fullsized":"2024-09-17T18:16:23.349707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:44.704048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018769735999999999,"stat_sum":{"num_bytes":6504448,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":13,"num_read_kb":115,"num_write":37,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3,13,1,5,10,7],"acting":[14,3,13,1,5,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"17","length":"1"},{"start":"1d","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T18:16:21.350555+0000","last_change":"2024-09-17T18:15:16.990099+0000","last_active":"2024-09-17T18:16:21.350555+0000","last_peered":"2024-09-17T18:16:21.350555+0000","last_clean":"2024-09-17T18:16:21.350555+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:16:21.350555+0000","last_undegraded":"2024-09-17T18:16:21.350555+0000","last_fullsized":"2024-09-17T18:16:21.350555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.933228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":269,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T18:16:23.346315+0000","last_change":"2024-09-17T18:16:23.349616+0000","last_active":"2024-09-17T18:16:23.346315+0000","last_peered":"2024-09-17T18:16:23.346315+0000","last_clean":"2024-09-17T18:16:23.346315+0000","last_became_active":"2024-09-17T18:15:28.094455+0000","last_became_peered":"2024-09-17T18:15:28.094455+0000","last_unstale":"2024-09-17T18:16:23.346315+0000","last_undegraded":"2024-09-17T18:16:23.346315+0000","last_fullsized":"2024-09-17T18:16:23.346315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.366067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0080532190000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,14,10,7,3,2],"acting":[4,13,14,10,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"17","length":"1"},{"start":"1d","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T18:16:23.332574+0000","last_change":"2024-09-17T18:15:17.499886+0000","last_active":"2024-09-17T18:16:23.332574+0000","last_peered":"2024-09-17T18:16:23.332574+0000","last_clean":"2024-09-17T18:16:23.332574+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:16:23.332574+0000","last_undegraded":"2024-09-17T18:16:23.332574+0000","last_fullsized":"2024-09-17T18:16:23.332574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.366017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"88'81","reported_seq":359,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T18:16:23.348306+0000","last_change":"2024-09-17T18:16:23.350747+0000","last_active":"2024-09-17T18:16:23.348306+0000","last_peered":"2024-09-17T18:16:23.348306+0000","last_clean":"2024-09-17T18:16:23.348306+0000","last_became_active":"2024-09-17T18:15:28.273637+0000","last_became_peered":"2024-09-17T18:15:28.273637+0000","last_unstale":"2024-09-17T18:16:23.348306+0000","last_undegraded":"2024-09-17T18:16:23.348306+0000","last_fullsized":"2024-09-17T18:16:23.348306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.354820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020349545,"stat_sum":{"num_bytes":9797632,"num_objects":7,"num_object_clones":5,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":32071,"num_write":28,"num_write_kb":11424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,9,2,6,15,4],"acting":[3,7,9,2,6,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"17","length":"1"},{"start":"1d","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":139,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T18:16:21.339343+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:16:21.339343+0000","last_peered":"2024-09-17T18:16:21.339343+0000","last_clean":"2024-09-17T18:16:21.339343+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:16:21.339343+0000","last_undegraded":"2024-09-17T18:16:21.339343+0000","last_fullsized":"2024-09-17T18:16:21.339343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"86'71","reported_seq":344,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T18:16:22.347985+0000","last_change":"2024-09-17T18:16:21.396405+0000","last_active":"2024-09-17T18:16:22.347985+0000","last_peered":"2024-09-17T18:16:22.347985+0000","last_clean":"2024-09-17T18:16:22.347985+0000","last_became_active":"2024-09-17T18:15:28.272974+0000","last_became_peered":"2024-09-17T18:15:28.272974+0000","last_unstale":"2024-09-17T18:16:22.347985+0000","last_undegraded":"2024-09-17T18:16:22.347985+0000","last_fullsized":"2024-09-17T18:16:22.347985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:51.977732+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.057639303000000003,"stat_sum":{"num_bytes":10698752,"num_objects":5,"num_object_clones":3,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":9399,"num_write":18,"num_write_kb":10448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4,13,11,2,5],"acting":[10,9,4,13,11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.5","version":"86'64","reported_seq":334,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T18:16:21.360135+0000","last_change":"2024-09-17T18:16:21.366096+0000","last_active":"2024-09-17T18:16:21.360135+0000","last_peered":"2024-09-17T18:16:21.360135+0000","last_clean":"2024-09-17T18:16:21.360135+0000","last_became_active":"2024-09-17T18:15:28.275306+0000","last_became_peered":"2024-09-17T18:15:28.275306+0000","last_unstale":"2024-09-17T18:16:21.360135+0000","last_undegraded":"2024-09-17T18:16:21.360135+0000","last_fullsized":"2024-09-17T18:16:21.360135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:27.545621+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.024951091000000002,"stat_sum":{"num_bytes":6914048,"num_objects":3,"num_object_clones":2,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":8243,"num_write":35,"num_write_kb":8560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,11],"acting":[5,8,4,9,12,0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T18:16:23.341585+0000","last_change":"2024-09-17T18:15:16.605178+0000","last_active":"2024-09-17T18:16:23.341585+0000","last_peered":"2024-09-17T18:16:23.341585+0000","last_clean":"2024-09-17T18:16:23.341585+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:16:23.341585+0000","last_undegraded":"2024-09-17T18:16:23.341585+0000","last_fullsized":"2024-09-17T18:16:23.341585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":263,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T18:16:21.332358+0000","last_change":"2024-09-17T18:16:21.332736+0000","last_active":"2024-09-17T18:16:21.332358+0000","last_peered":"2024-09-17T18:16:21.332358+0000","last_clean":"2024-09-17T18:16:21.332358+0000","last_became_active":"2024-09-17T18:15:28.090551+0000","last_became_peered":"2024-09-17T18:15:28.090551+0000","last_unstale":"2024-09-17T18:16:21.332358+0000","last_undegraded":"2024-09-17T18:16:21.332358+0000","last_fullsized":"2024-09-17T18:16:21.332358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:46.007859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069523600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15,4,2,6,10,7],"acting":[8,15,4,2,6,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T18:16:23.329430+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:16:23.329430+0000","last_peered":"2024-09-17T18:16:23.329430+0000","last_clean":"2024-09-17T18:16:23.329430+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:16:23.329430+0000","last_undegraded":"2024-09-17T18:16:23.329430+0000","last_fullsized":"2024-09-17T18:16:23.329430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:15.290413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"88'169","reported_seq":440,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T18:16:23.360530+0000","last_change":"2024-09-17T18:16:23.362086+0000","last_active":"2024-09-17T18:16:23.360530+0000","last_peered":"2024-09-17T18:16:23.360530+0000","last_clean":"2024-09-17T18:16:23.360530+0000","last_became_active":"2024-09-17T18:15:27.692814+0000","last_became_peered":"2024-09-17T18:15:27.692814+0000","last_unstale":"2024-09-17T18:16:23.360530+0000","last_undegraded":"2024-09-17T18:16:23.360530+0000","last_fullsized":"2024-09-17T18:16:23.360530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:41.036917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020736729999999998,"stat_sum":{"num_bytes":3047424,"num_objects":11,"num_object_clones":6,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":1,"num_read":47,"num_read_kb":10980,"num_write":130,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,0,14,10,13],"acting":[4,11,6,0,14,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"17","length":"1"},{"start":"1d","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":137,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T18:16:21.331995+0000","last_change":"2024-09-17T18:15:17.502621+0000","last_active":"2024-09-17T18:16:21.331995+0000","last_peered":"2024-09-17T18:16:21.331995+0000","last_clean":"2024-09-17T18:16:21.331995+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:16:21.331995+0000","last_undegraded":"2024-09-17T18:16:21.331995+0000","last_fullsized":"2024-09-17T18:16:21.331995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.990534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"86'120","reported_seq":383,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T18:16:21.429591+0000","last_change":"2024-09-17T18:16:21.391045+0000","last_active":"2024-09-17T18:16:21.429591+0000","last_peered":"2024-09-17T18:16:21.429591+0000","last_clean":"2024-09-17T18:16:21.429591+0000","last_became_active":"2024-09-17T18:15:28.272963+0000","last_became_peered":"2024-09-17T18:15:28.272963+0000","last_unstale":"2024-09-17T18:16:21.429591+0000","last_undegraded":"2024-09-17T18:16:21.429591+0000","last_fullsized":"2024-09-17T18:16:21.429591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:54.596631+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.043214786999999998,"stat_sum":{"num_bytes":9977856,"num_objects":8,"num_object_clones":5,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":16706,"num_write":34,"num_write_kb":9744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14,6,2,5,9,15],"acting":[0,14,6,2,5,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"13","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":137,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T18:16:21.339067+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:16:21.339067+0000","last_peered":"2024-09-17T18:16:21.339067+0000","last_clean":"2024-09-17T18:16:21.339067+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:16:21.339067+0000","last_undegraded":"2024-09-17T18:16:21.339067+0000","last_fullsized":"2024-09-17T18:16:21.339067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":152371200,"num_objects":117,"num_object_clones":68,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":8,"num_read":431,"num_read_kb":188148,"num_write":843,"num_write_kb":171328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":46055424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":265420800,"data_stored":382889984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1954,"ondisk_log_size":1954,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247826,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72664,"kb_used_data":23424,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94299176,"statfs":{"total":96636764160,"available":96562356224,"internally_reserved":0,"allocated":23986176,"data_stored":35466410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247826,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45216,"kb_used_data":14024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326624,"statfs":{"total":96636764160,"available":96590462976,"internally_reserved":0,"allocated":14360576,"data_stored":19290762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280530,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44152,"kb_used_data":17124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94327688,"statfs":{"total":96636764160,"available":96591552512,"internally_reserved":0,"allocated":17534976,"data_stored":21434855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313234,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46336,"kb_used_data":15144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94325504,"statfs":{"total":96636764160,"available":96589316096,"internally_reserved":0,"allocated":15507456,"data_stored":22950356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280530,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45472,"kb_used_data":14284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326368,"statfs":{"total":96636764160,"available":96590200832,"internally_reserved":0,"allocated":14626816,"data_stored":18420199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313234,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45224,"kb_used_data":18188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94326616,"statfs":{"total":96636764160,"available":96590454784,"internally_reserved":0,"allocated":18624512,"data_stored":27961574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280528,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48676,"kb_used_data":17488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94323164,"statfs":{"total":96636764160,"available":96586919936,"internally_reserved":0,"allocated":17907712,"data_stored":24781268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,3,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280529,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52968,"kb_used_data":21780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94318872,"statfs":{"total":96636764160,"available":96582524928,"internally_reserved":0,"allocated":22302720,"data_stored":25813460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[1,2,3,4,5,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313233,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67788,"kb_used_data":18544,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94304052,"statfs":{"total":96636764160,"available":96567349248,"internally_reserved":0,"allocated":18989056,"data_stored":25348746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280529,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70784,"kb_used_data":21544,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94301056,"statfs":{"total":96636764160,"available":96564281344,"internally_reserved":0,"allocated":22061056,"data_stored":29026954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280529,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40820,"kb_used_data":13792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331020,"statfs":{"total":96636764160,"available":96594964480,"internally_reserved":0,"allocated":14123008,"data_stored":20222420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247824,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58208,"kb_used_data":27016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94313632,"statfs":{"total":96636764160,"available":96577159168,"internally_reserved":0,"allocated":27664384,"data_stored":37956234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247826,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74276,"kb_used_data":25036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94297564,"statfs":{"total":96636764160,"available":96560705536,"internally_reserved":0,"allocated":25636864,"data_stored":35613322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247826,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45760,"kb_used_data":14568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326080,"statfs":{"total":96636764160,"available":96589905920,"internally_reserved":0,"allocated":14917632,"data_stored":24983008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247825,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42340,"kb_used_data":11144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329500,"statfs":{"total":96636764160,"available":96593408000,"internally_reserved":0,"allocated":11411456,"data_stored":18031552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280528,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38136,"kb_used_data":6948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333704,"statfs":{"total":96636764160,"available":96597712896,"internally_reserved":0,"allocated":7114752,"data_stored":9765332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14262272,"data_stored":22228992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20799488,"data_stored":28295168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12877824,"data_stored":19501056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26402816,"data_stored":37224448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24375296,"data_stored":34881536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16662528,"data_stored":24059904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13107200,"data_stored":23711744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10133504,"data_stored":17289216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":5869568,"data_stored":9043968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":17190912,"data_stored":25767936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":21057536,"data_stored":25092096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":17727488,"data_stored":24616960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":16285696,"data_stored":20713472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":13377536,"data_stored":17698816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":13099008,"data_stored":18558976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":22192128,"data_stored":34205696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:16:25.695 INFO:tasks.thrashosds.thrasher:Setting 3.6 to [6, 0, 12, 7, 15, 13, 8] 2024-09-17T18:16:25.695 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.6', '6', '0', '12', '7', '15', '13', '8'] 2024-09-17T18:16:25.696 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.6 6 0 12 7 15 13 8 2024-09-17T18:16:25.767 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:25.761+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:25.813 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:25.813 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T18:16:25.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T18:16:25.813 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T18:16:25.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.813 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:659 3.0s0 3:0c709a8a:::smithi15432074-26:head [append 0~737280] snapc 1a=[1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-17T18:16:25.813 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:05.440935+0000", 2024-09-17T18:16:25.813 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 20.36812428, 2024-09-17T18:16:25.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022050706, 2024-09-17T18:16:25.814 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.814 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.814 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:25.814 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:25.814 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:25.814 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:25.814 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 659 2024-09-17T18:16:25.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.814 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.440935+0000", 2024-09-17T18:16:25.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.440935+0000", 2024-09-17T18:16:25.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.440939+0000", 2024-09-17T18:16:25.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7629999999999998e-06 2024-09-17T18:16:25.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.441875+0000", 2024-09-17T18:16:25.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093599000000000004 2024-09-17T18:16:25.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.441913+0000", 2024-09-17T18:16:25.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8216000000000001e-05 2024-09-17T18:16:25.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.441936+0000", 2024-09-17T18:16:25.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2935999999999999e-05 2024-09-17T18:16:25.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.442090+0000", 2024-09-17T18:16:25.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015369299999999999 2024-09-17T18:16:25.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-17T18:16:25.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.442107+0000", 2024-09-17T18:16:25.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6983e-05 2024-09-17T18:16:25.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.446230+0000", 2024-09-17T18:16:25.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041234490000000004 2024-09-17T18:16:25.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:25.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.446453+0000", 2024-09-17T18:16:25.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022280100000000001 2024-09-17T18:16:25.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.449103+0000", 2024-09-17T18:16:25.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026499679999999999 2024-09-17T18:16:25.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.455639+0000", 2024-09-17T18:16:25.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065355969999999998 2024-09-17T18:16:25.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:25.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.462747+0000", 2024-09-17T18:16:25.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0071083129999999998 2024-09-17T18:16:25.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:05.462986+0000", 2024-09-17T18:16:25.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023899699999999999 2024-09-17T18:16:25.821 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.821 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.821 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.821 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWriteReply(3.0s0 79/31 ECSubWriteReply(tid=70, last_complete=79'59, committed=1, applied=1))", 2024-09-17T18:16:25.821 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:14.494170+0000", 2024-09-17T18:16:25.821 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.314889859999999, 2024-09-17T18:16:25.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020998046999999999, 2024-09-17T18:16:25.822 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.822 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.822 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.822 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.494170+0000", 2024-09-17T18:16:25.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.494170+0000", 2024-09-17T18:16:25.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.494172+0000", 2024-09-17T18:16:25.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0770000000000002e-06 2024-09-17T18:16:25.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.494184+0000", 2024-09-17T18:16:25.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2356e-05 2024-09-17T18:16:25.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.494238+0000", 2024-09-17T18:16:25.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4122999999999997e-05 2024-09-17T18:16:25.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.494258+0000", 2024-09-17T18:16:25.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0142000000000001e-05 2024-09-17T18:16:25.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.515062+0000", 2024-09-17T18:16:25.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020803440999999999 2024-09-17T18:16:25.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.515168+0000", 2024-09-17T18:16:25.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105908 2024-09-17T18:16:25.825 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.825 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.826 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.826 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs3 79/31 ECSubWrite(tid=162, reqid=osd.5.0:162, at_version=79'94, trim_to=0'0, roll_forward_to=78'90))", 2024-09-17T18:16:25.826 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:14.495080+0000", 2024-09-17T18:16:25.826 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.313979636999999, 2024-09-17T18:16:25.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020284375, 2024-09-17T18:16:25.826 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.826 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.826 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.826 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.495080+0000", 2024-09-17T18:16:25.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.495080+0000", 2024-09-17T18:16:25.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.495081+0000", 2024-09-17T18:16:25.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1999999999999999e-06 2024-09-17T18:16:25.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.495141+0000", 2024-09-17T18:16:25.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9998999999999999e-05 2024-09-17T18:16:25.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.495169+0000", 2024-09-17T18:16:25.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8019000000000001e-05 2024-09-17T18:16:25.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.495190+0000", 2024-09-17T18:16:25.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0545999999999999e-05 2024-09-17T18:16:25.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.497534+0000", 2024-09-17T18:16:25.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023445549999999999 2024-09-17T18:16:25.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.497561+0000", 2024-09-17T18:16:25.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6533000000000002e-05 2024-09-17T18:16:25.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.515277+0000", 2024-09-17T18:16:25.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017716224999999999 2024-09-17T18:16:25.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:14.515364+0000", 2024-09-17T18:16:25.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7298000000000003e-05 2024-09-17T18:16:25.831 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.831 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.831 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.831 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:873 3.0s0 3:0dbbb22b:::smithi15432074-50:head [read 0~3719168,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-17T18:16:25.831 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:15.498080+0000", 2024-09-17T18:16:25.831 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 10.310979757, 2024-09-17T18:16:25.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.024468653999999999, 2024-09-17T18:16:25.832 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.832 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.832 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:25.832 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:25.832 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:25.832 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:25.832 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 873 2024-09-17T18:16:25.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.832 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.498080+0000", 2024-09-17T18:16:25.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.498080+0000", 2024-09-17T18:16:25.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.498081+0000", 2024-09-17T18:16:25.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1429999999999999e-06 2024-09-17T18:16:25.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.498088+0000", 2024-09-17T18:16:25.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5529999999999998e-06 2024-09-17T18:16:25.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.498105+0000", 2024-09-17T18:16:25.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7558999999999999e-05 2024-09-17T18:16:25.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.498118+0000", 2024-09-17T18:16:25.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.291e-05 2024-09-17T18:16:25.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.498309+0000", 2024-09-17T18:16:25.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000191411 2024-09-17T18:16:25.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:25.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.498319+0000", 2024-09-17T18:16:25.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3030000000000005e-06 2024-09-17T18:16:25.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.506330+0000", 2024-09-17T18:16:25.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0080112180000000005 2024-09-17T18:16:25.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:25.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.506472+0000", 2024-09-17T18:16:25.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014221200000000001 2024-09-17T18:16:25.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.522549+0000", 2024-09-17T18:16:25.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016076344999999999 2024-09-17T18:16:25.836 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.836 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.837 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.837 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 85/31 ECSubWrite(tid=216, reqid=osd.6.0:216, at_version=85'104, trim_to=0'0, roll_forward_to=84'102))", 2024-09-17T18:16:25.837 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:20.345915+0000", 2024-09-17T18:16:25.837 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.4631442650000004, 2024-09-17T18:16:25.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027419260000000001, 2024-09-17T18:16:25.837 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.837 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.837 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.837 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.345915+0000", 2024-09-17T18:16:25.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.345915+0000", 2024-09-17T18:16:25.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.345916+0000", 2024-09-17T18:16:25.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6300000000000004e-07 2024-09-17T18:16:25.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.345983+0000", 2024-09-17T18:16:25.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7185000000000001e-05 2024-09-17T18:16:25.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.347536+0000", 2024-09-17T18:16:25.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015530660000000001 2024-09-17T18:16:25.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.347564+0000", 2024-09-17T18:16:25.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7983e-05 2024-09-17T18:16:25.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.358538+0000", 2024-09-17T18:16:25.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010973182999999999 2024-09-17T18:16:25.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.358561+0000", 2024-09-17T18:16:25.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3456e-05 2024-09-17T18:16:25.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.373275+0000", 2024-09-17T18:16:25.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014713886000000001 2024-09-17T18:16:25.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.373335+0000", 2024-09-17T18:16:25.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9638000000000001e-05 2024-09-17T18:16:25.841 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.841 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.841 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.842 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 85/31 ECSubWrite(tid=217, reqid=osd.6.0:217, at_version=85'106, trim_to=0'0, roll_forward_to=84'102))", 2024-09-17T18:16:25.842 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:20.347630+0000", 2024-09-17T18:16:25.842 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.4614295669999997, 2024-09-17T18:16:25.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031790323000000002, 2024-09-17T18:16:25.843 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.843 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.843 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.843 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.347630+0000", 2024-09-17T18:16:25.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.347630+0000", 2024-09-17T18:16:25.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.347631+0000", 2024-09-17T18:16:25.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.393e-06 2024-09-17T18:16:25.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.347693+0000", 2024-09-17T18:16:25.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1259000000000004e-05 2024-09-17T18:16:25.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.347719+0000", 2024-09-17T18:16:25.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6378999999999999e-05 2024-09-17T18:16:25.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.347737+0000", 2024-09-17T18:16:25.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8320000000000001e-05 2024-09-17T18:16:25.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.364619+0000", 2024-09-17T18:16:25.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016881505000000002 2024-09-17T18:16:25.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.364643+0000", 2024-09-17T18:16:25.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4071999999999999e-05 2024-09-17T18:16:25.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.379332+0000", 2024-09-17T18:16:25.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014688914000000001 2024-09-17T18:16:25.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.379420+0000", 2024-09-17T18:16:25.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8480999999999995e-05 2024-09-17T18:16:25.847 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.847 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.847 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.847 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.as4 85/31 ECSubWrite(tid=640, reqid=osd.13.0:640, at_version=85'234, trim_to=0'0, roll_forward_to=84'230))", 2024-09-17T18:16:25.847 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:20.354794+0000", 2024-09-17T18:16:25.847 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.454265307, 2024-09-17T18:16:25.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018176386999999999, 2024-09-17T18:16:25.847 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.847 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.847 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.848 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.354794+0000", 2024-09-17T18:16:25.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.354794+0000", 2024-09-17T18:16:25.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.354796+0000", 2024-09-17T18:16:25.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2899999999999999e-06 2024-09-17T18:16:25.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.354841+0000", 2024-09-17T18:16:25.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5541999999999999e-05 2024-09-17T18:16:25.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.354879+0000", 2024-09-17T18:16:25.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7438999999999998e-05 2024-09-17T18:16:25.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.354899+0000", 2024-09-17T18:16:25.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0732000000000001e-05 2024-09-17T18:16:25.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.357949+0000", 2024-09-17T18:16:25.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030497570000000002 2024-09-17T18:16:25.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.357975+0000", 2024-09-17T18:16:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6086999999999999e-05 2024-09-17T18:16:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.372907+0000", 2024-09-17T18:16:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014931355 2024-09-17T18:16:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.372971+0000", 2024-09-17T18:16:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4184999999999996e-05 2024-09-17T18:16:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:930 3.0s0 3:0c709a8a:::smithi15432074-26:head [append 0~0] snapc 1f=[1f,1e,1d,1c,18,16,15,11] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-17T18:16:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.336055+0000", 2024-09-17T18:16:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4730044099999997, 2024-09-17T18:16:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.039550912000000001, 2024-09-17T18:16:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 930 2024-09-17T18:16:25.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.853 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336055+0000", 2024-09-17T18:16:25.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336055+0000", 2024-09-17T18:16:25.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336057+0000", 2024-09-17T18:16:25.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0049999999999999e-06 2024-09-17T18:16:25.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336066+0000", 2024-09-17T18:16:25.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5779999999999999e-06 2024-09-17T18:16:25.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336108+0000", 2024-09-17T18:16:25.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2611999999999998e-05 2024-09-17T18:16:25.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336123+0000", 2024-09-17T18:16:25.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4525999999999999e-05 2024-09-17T18:16:25.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336228+0000", 2024-09-17T18:16:25.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105216 2024-09-17T18:16:25.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-17T18:16:25.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336237+0000", 2024-09-17T18:16:25.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9670000000000007e-06 2024-09-17T18:16:25.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.339787+0000", 2024-09-17T18:16:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003549398 2024-09-17T18:16:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.339923+0000", 2024-09-17T18:16:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013682200000000001 2024-09-17T18:16:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.341262+0000", 2024-09-17T18:16:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001338962 2024-09-17T18:16:25.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.367916+0000", 2024-09-17T18:16:25.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.026654148999999999 2024-09-17T18:16:25.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:25.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.375482+0000", 2024-09-17T18:16:25.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007565156 2024-09-17T18:16:25.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.375606+0000", 2024-09-17T18:16:25.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000124521 2024-09-17T18:16:25.858 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.858 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.858 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.858 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:931 3.0s0 3:0c709a8a:::smithi15432074-26:head [rollback 1c] snapc 1f=[1f,1e,1d,1c,18,16,15,11] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-17T18:16:25.858 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.336176+0000", 2024-09-17T18:16:25.858 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4728834749999997, 2024-09-17T18:16:25.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040007342000000001, 2024-09-17T18:16:25.858 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.858 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.858 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:25.858 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:25.859 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:25.859 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:25.859 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 931 2024-09-17T18:16:25.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.859 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336176+0000", 2024-09-17T18:16:25.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336176+0000", 2024-09-17T18:16:25.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336177+0000", 2024-09-17T18:16:25.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1170000000000001e-06 2024-09-17T18:16:25.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336183+0000", 2024-09-17T18:16:25.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7599999999999999e-06 2024-09-17T18:16:25.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336197+0000", 2024-09-17T18:16:25.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4426e-05 2024-09-17T18:16:25.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336207+0000", 2024-09-17T18:16:25.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4320000000000005e-06 2024-09-17T18:16:25.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336343+0000", 2024-09-17T18:16:25.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013593000000000001 2024-09-17T18:16:25.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:25.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336355+0000", 2024-09-17T18:16:25.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1986e-05 2024-09-17T18:16:25.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.343251+0000", 2024-09-17T18:16:25.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0068963540000000004 2024-09-17T18:16:25.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:25.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.343428+0000", 2024-09-17T18:16:25.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017678099999999999 2024-09-17T18:16:25.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.344448+0000", 2024-09-17T18:16:25.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001020525 2024-09-17T18:16:25.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.367920+0000", 2024-09-17T18:16:25.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023471210999999999 2024-09-17T18:16:25.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:25.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.376020+0000", 2024-09-17T18:16:25.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0081002810000000008 2024-09-17T18:16:25.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.376184+0000", 2024-09-17T18:16:25.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016353900000000001 2024-09-17T18:16:25.864 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.864 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.864 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.864 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:932 3.0s0 3:0c709a8a:::smithi15432074-26:head [append 0~0] snapc 1f=[1f,1e,1d,1c,18,16,15,11] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-17T18:16:25.864 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.336232+0000", 2024-09-17T18:16:25.865 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4728272310000001, 2024-09-17T18:16:25.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040288351999999999, 2024-09-17T18:16:25.865 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.865 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.865 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:25.865 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:25.865 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:25.865 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:25.865 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 932 2024-09-17T18:16:25.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.866 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336232+0000", 2024-09-17T18:16:25.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336232+0000", 2024-09-17T18:16:25.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336233+0000", 2024-09-17T18:16:25.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T18:16:25.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336238+0000", 2024-09-17T18:16:25.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2910000000000001e-06 2024-09-17T18:16:25.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336249+0000", 2024-09-17T18:16:25.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1104000000000001e-05 2024-09-17T18:16:25.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336261+0000", 2024-09-17T18:16:25.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1948e-05 2024-09-17T18:16:25.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336419+0000", 2024-09-17T18:16:25.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015822899999999999 2024-09-17T18:16:25.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:25.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336437+0000", 2024-09-17T18:16:25.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8164000000000001e-05 2024-09-17T18:16:25.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.346433+0000", 2024-09-17T18:16:25.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099956569999999998 2024-09-17T18:16:25.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:25.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.346606+0000", 2024-09-17T18:16:25.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000172907 2024-09-17T18:16:25.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.347436+0000", 2024-09-17T18:16:25.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082997400000000003 2024-09-17T18:16:25.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.367922+0000", 2024-09-17T18:16:25.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020486163000000002 2024-09-17T18:16:25.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:25.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.376366+0000", 2024-09-17T18:16:25.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084442900000000001 2024-09-17T18:16:25.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.376521+0000", 2024-09-17T18:16:25.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015477199999999999 2024-09-17T18:16:25.871 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.871 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.871 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.871 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.es5 86/31 ECSubWrite(tid=53, reqid=client.4565.0:929, at_version=86'44, trim_to=0'0, roll_forward_to=85'42))", 2024-09-17T18:16:25.871 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.345124+0000", 2024-09-17T18:16:25.871 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4639357459999998, 2024-09-17T18:16:25.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027796991, 2024-09-17T18:16:25.871 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.871 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.872 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.872 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.345124+0000", 2024-09-17T18:16:25.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.345124+0000", 2024-09-17T18:16:25.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.345125+0000", 2024-09-17T18:16:25.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T18:16:25.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.345228+0000", 2024-09-17T18:16:25.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103053 2024-09-17T18:16:25.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.345253+0000", 2024-09-17T18:16:25.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5023000000000001e-05 2024-09-17T18:16:25.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.345274+0000", 2024-09-17T18:16:25.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0472999999999999e-05 2024-09-17T18:16:25.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.345415+0000", 2024-09-17T18:16:25.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014096599999999999 2024-09-17T18:16:25.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.345431+0000", 2024-09-17T18:16:25.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6141999999999999e-05 2024-09-17T18:16:25.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.372851+0000", 2024-09-17T18:16:25.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027420421 2024-09-17T18:16:25.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.372921+0000", 2024-09-17T18:16:25.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9505999999999995e-05 2024-09-17T18:16:25.875 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.875 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.876 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.876 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs3 86/31 ECSubWrite(tid=198, reqid=osd.5.0:198, at_version=86'119, trim_to=0'0, roll_forward_to=85'117))", 2024-09-17T18:16:25.876 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.348145+0000", 2024-09-17T18:16:25.876 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4609143749999998, 2024-09-17T18:16:25.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.024788406999999998, 2024-09-17T18:16:25.876 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.876 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.876 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.876 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.348145+0000", 2024-09-17T18:16:25.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.348145+0000", 2024-09-17T18:16:25.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.348146+0000", 2024-09-17T18:16:25.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T18:16:25.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.348184+0000", 2024-09-17T18:16:25.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7632000000000002e-05 2024-09-17T18:16:25.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.348206+0000", 2024-09-17T18:16:25.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2255999999999998e-05 2024-09-17T18:16:25.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.348221+0000", 2024-09-17T18:16:25.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4902999999999999e-05 2024-09-17T18:16:25.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349433+0000", 2024-09-17T18:16:25.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001211801 2024-09-17T18:16:25.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349448+0000", 2024-09-17T18:16:25.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5177999999999999e-05 2024-09-17T18:16:25.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.372874+0000", 2024-09-17T18:16:25.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023425964000000001 2024-09-17T18:16:25.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.372934+0000", 2024-09-17T18:16:25.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9953e-05 2024-09-17T18:16:25.880 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.880 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.880 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.880 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s6 86/31 ECSubWrite(tid=193, reqid=osd.7.0:193, at_version=86'188, trim_to=0'0, roll_forward_to=85'186))", 2024-09-17T18:16:25.880 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.350270+0000", 2024-09-17T18:16:25.881 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4587901380000003, 2024-09-17T18:16:25.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.024691966999999999, 2024-09-17T18:16:25.881 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.881 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.881 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.881 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350270+0000", 2024-09-17T18:16:25.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350270+0000", 2024-09-17T18:16:25.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350272+0000", 2024-09-17T18:16:25.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0940000000000002e-06 2024-09-17T18:16:25.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350322+0000", 2024-09-17T18:16:25.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0498999999999999e-05 2024-09-17T18:16:25.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350368+0000", 2024-09-17T18:16:25.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5714999999999999e-05 2024-09-17T18:16:25.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350391+0000", 2024-09-17T18:16:25.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3033000000000001e-05 2024-09-17T18:16:25.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350639+0000", 2024-09-17T18:16:25.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024811700000000001 2024-09-17T18:16:25.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350670+0000", 2024-09-17T18:16:25.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1012000000000001e-05 2024-09-17T18:16:25.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.374874+0000", 2024-09-17T18:16:25.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.024203991000000001 2024-09-17T18:16:25.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.374961+0000", 2024-09-17T18:16:25.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7505999999999999e-05 2024-09-17T18:16:25.885 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.885 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.885 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.885 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.es5 86/31 ECSubWrite(tid=54, reqid=osd.11.0:54, at_version=86'46, trim_to=0'0, roll_forward_to=85'42))", 2024-09-17T18:16:25.885 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.350922+0000", 2024-09-17T18:16:25.885 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4581380470000003, 2024-09-17T18:16:25.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025555799000000001, 2024-09-17T18:16:25.885 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.886 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.886 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.886 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350922+0000", 2024-09-17T18:16:25.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350922+0000", 2024-09-17T18:16:25.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350923+0000", 2024-09-17T18:16:25.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5239999999999999e-06 2024-09-17T18:16:25.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351018+0000", 2024-09-17T18:16:25.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4999000000000003e-05 2024-09-17T18:16:25.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351038+0000", 2024-09-17T18:16:25.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9885999999999999e-05 2024-09-17T18:16:25.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351050+0000", 2024-09-17T18:16:25.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2225999999999999e-05 2024-09-17T18:16:25.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.363507+0000", 2024-09-17T18:16:25.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012456273 2024-09-17T18:16:25.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.363529+0000", 2024-09-17T18:16:25.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.264e-05 2024-09-17T18:16:25.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.376416+0000", 2024-09-17T18:16:25.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012886887 2024-09-17T18:16:25.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.376477+0000", 2024-09-17T18:16:25.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1364000000000004e-05 2024-09-17T18:16:25.889 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.889 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.890 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.890 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs3 86/31 ECSubWrite(tid=199, reqid=osd.5.0:199, at_version=86'121, trim_to=0'0, roll_forward_to=85'117))", 2024-09-17T18:16:25.890 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.351254+0000", 2024-09-17T18:16:25.890 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4578058269999996, 2024-09-17T18:16:25.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025276910999999999, 2024-09-17T18:16:25.890 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.890 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.890 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.890 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351254+0000", 2024-09-17T18:16:25.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351254+0000", 2024-09-17T18:16:25.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351255+0000", 2024-09-17T18:16:25.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5200000000000001e-06 2024-09-17T18:16:25.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351302+0000", 2024-09-17T18:16:25.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6205999999999998e-05 2024-09-17T18:16:25.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351329+0000", 2024-09-17T18:16:25.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7483000000000001e-05 2024-09-17T18:16:25.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351350+0000", 2024-09-17T18:16:25.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0656e-05 2024-09-17T18:16:25.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.363675+0000", 2024-09-17T18:16:25.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012325567000000001 2024-09-17T18:16:25.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.363700+0000", 2024-09-17T18:16:25.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.444e-05 2024-09-17T18:16:25.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.376485+0000", 2024-09-17T18:16:25.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012785675999999999 2024-09-17T18:16:25.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.376531+0000", 2024-09-17T18:16:25.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5362999999999999e-05 2024-09-17T18:16:25.894 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.894 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.894 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.895 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 86/31 ECSubWrite(tid=219, reqid=osd.6.0:219, at_version=86'108, trim_to=0'0, roll_forward_to=85'106))", 2024-09-17T18:16:25.895 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.355223+0000", 2024-09-17T18:16:25.895 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4538366839999997, 2024-09-17T18:16:25.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.026470917, 2024-09-17T18:16:25.895 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.895 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.895 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.895 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.355223+0000", 2024-09-17T18:16:25.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.355223+0000", 2024-09-17T18:16:25.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.355224+0000", 2024-09-17T18:16:25.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2079999999999999e-06 2024-09-17T18:16:25.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.355261+0000", 2024-09-17T18:16:25.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7208e-05 2024-09-17T18:16:25.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.355283+0000", 2024-09-17T18:16:25.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1588000000000001e-05 2024-09-17T18:16:25.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.355299+0000", 2024-09-17T18:16:25.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5894000000000001e-05 2024-09-17T18:16:25.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.368194+0000", 2024-09-17T18:16:25.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0128951 2024-09-17T18:16:25.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.368214+0000", 2024-09-17T18:16:25.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0023000000000001e-05 2024-09-17T18:16:25.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.381637+0000", 2024-09-17T18:16:25.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013422854999999999 2024-09-17T18:16:25.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.381694+0000", 2024-09-17T18:16:25.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7040999999999998e-05 2024-09-17T18:16:25.899 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.899 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.899 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.899 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s3 86/31 ECSubWrite(tid=220, reqid=osd.6.0:220, at_version=86'110, trim_to=0'0, roll_forward_to=85'106))", 2024-09-17T18:16:25.899 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.362403+0000", 2024-09-17T18:16:25.899 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4466569289999995, 2024-09-17T18:16:25.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023823178, 2024-09-17T18:16:25.899 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.899 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.900 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.900 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.362403+0000", 2024-09-17T18:16:25.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.362403+0000", 2024-09-17T18:16:25.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.362409+0000", 2024-09-17T18:16:25.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5629999999999997e-06 2024-09-17T18:16:25.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.362455+0000", 2024-09-17T18:16:25.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5726000000000002e-05 2024-09-17T18:16:25.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.362482+0000", 2024-09-17T18:16:25.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7126000000000001e-05 2024-09-17T18:16:25.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.362502+0000", 2024-09-17T18:16:25.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9542999999999999e-05 2024-09-17T18:16:25.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.376261+0000", 2024-09-17T18:16:25.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013758879 2024-09-17T18:16:25.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.376275+0000", 2024-09-17T18:16:25.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4318000000000001e-05 2024-09-17T18:16:25.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.386176+0000", 2024-09-17T18:16:25.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099009600000000003 2024-09-17T18:16:25.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.386226+0000", 2024-09-17T18:16:25.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0062999999999998e-05 2024-09-17T18:16:25.903 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.903 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.903 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.904 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 86/82 ECSubWrite(tid=136, reqid=client.4565.0:937, at_version=86'367, trim_to=0'0, roll_forward_to=85'361))", 2024-09-17T18:16:25.904 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.371443+0000", 2024-09-17T18:16:25.904 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.437617028, 2024-09-17T18:16:25.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021169012000000001, 2024-09-17T18:16:25.904 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.904 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.904 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.904 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371443+0000", 2024-09-17T18:16:25.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371443+0000", 2024-09-17T18:16:25.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371443+0000", 2024-09-17T18:16:25.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8599999999999997e-07 2024-09-17T18:16:25.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371483+0000", 2024-09-17T18:16:25.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9876000000000002e-05 2024-09-17T18:16:25.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371501+0000", 2024-09-17T18:16:25.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7768e-05 2024-09-17T18:16:25.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371516+0000", 2024-09-17T18:16:25.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5279999999999999e-05 2024-09-17T18:16:25.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.378475+0000", 2024-09-17T18:16:25.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069588319999999999 2024-09-17T18:16:25.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.378491+0000", 2024-09-17T18:16:25.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5906999999999999e-05 2024-09-17T18:16:25.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.392527+0000", 2024-09-17T18:16:25.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014036359 2024-09-17T18:16:25.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.392612+0000", 2024-09-17T18:16:25.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4203999999999995e-05 2024-09-17T18:16:25.908 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.908 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.908 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.908 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 86/82 ECSubWrite(tid=137, reqid=client.4565.0:938, at_version=86'368, trim_to=0'0, roll_forward_to=85'361))", 2024-09-17T18:16:25.908 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.371542+0000", 2024-09-17T18:16:25.908 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4375172899999997, 2024-09-17T18:16:25.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.026041272000000001, 2024-09-17T18:16:25.909 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.909 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.909 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.909 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371542+0000", 2024-09-17T18:16:25.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371542+0000", 2024-09-17T18:16:25.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371543+0000", 2024-09-17T18:16:25.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9400000000000004e-07 2024-09-17T18:16:25.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371580+0000", 2024-09-17T18:16:25.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7339000000000003e-05 2024-09-17T18:16:25.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371602+0000", 2024-09-17T18:16:25.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1894000000000001e-05 2024-09-17T18:16:25.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371618+0000", 2024-09-17T18:16:25.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6079e-05 2024-09-17T18:16:25.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.382200+0000", 2024-09-17T18:16:25.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010581790000000001 2024-09-17T18:16:25.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.382214+0000", 2024-09-17T18:16:25.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3818999999999999e-05 2024-09-17T18:16:25.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.397499+0000", 2024-09-17T18:16:25.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015285395 2024-09-17T18:16:25.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.397584+0000", 2024-09-17T18:16:25.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4161999999999998e-05 2024-09-17T18:16:25.913 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.913 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.913 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.913 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.ds2 86/82 ECSubWrite(tid=138, reqid=client.4565.0:939, at_version=86'369, trim_to=0'0, roll_forward_to=85'361))", 2024-09-17T18:16:25.913 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.371685+0000", 2024-09-17T18:16:25.913 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4373747940000001, 2024-09-17T18:16:25.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025955123, 2024-09-17T18:16:25.914 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:25.914 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:25.914 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:25.914 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:25.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:25.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371685+0000", 2024-09-17T18:16:25.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:25.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371685+0000", 2024-09-17T18:16:25.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:25.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:25.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371686+0000", 2024-09-17T18:16:25.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5700000000000001e-07 2024-09-17T18:16:25.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:25.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371712+0000", 2024-09-17T18:16:25.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6225e-05 2024-09-17T18:16:25.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:25.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371727+0000", 2024-09-17T18:16:25.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5543e-05 2024-09-17T18:16:25.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:25.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.371738+0000", 2024-09-17T18:16:25.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0688e-05 2024-09-17T18:16:25.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:25.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.385793+0000", 2024-09-17T18:16:25.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014054791000000001 2024-09-17T18:16:25.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:25.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.385813+0000", 2024-09-17T18:16:25.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0299999999999999e-05 2024-09-17T18:16:25.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:25.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.397596+0000", 2024-09-17T18:16:25.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011783128 2024-09-17T18:16:25.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:25.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:25.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:25.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.397640+0000", 2024-09-17T18:16:25.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3591000000000003e-05 2024-09-17T18:16:25.917 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.918 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.918 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.918 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:25.918 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:25.918 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:25.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T18:16:25.920 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:25.917+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:26.020 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:26.017+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:26.089 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:26.090 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:26.090 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T18:16:26.090 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:26.104 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T18:16:26.147 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:26.145+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:26.223 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:26.217+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:26.267 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:26.267 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:26.267 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T18:16:26.267 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T18:16:26.267 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:26.281 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T18:16:26.325 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:26.321+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:26.344 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T18:16:26.368 INFO:teuthology.orchestra.run.smithi087.stderr:set 3.6 pg_upmap mapping to [6,0,12,7,15,13,8] 2024-09-17T18:16:26.375 INFO:tasks.rados.rados.0.smithi154.stdout:388: done (3 left) 2024-09-17T18:16:26.375 INFO:tasks.rados.rados.0.smithi154.stdout:389: snap_create 2024-09-17T18:16:26.375 INFO:tasks.rados.rados.0.smithi154.stdout:385: finishing write tid 1 to smithi15432074-1 2024-09-17T18:16:26.375 INFO:tasks.rados.rados.0.smithi154.stdout:385: finishing write tid 2 to smithi15432074-1 2024-09-17T18:16:26.375 INFO:tasks.rados.rados.0.smithi154.stdout:386: finishing rollback tid 0 to smithi15432074-41 2024-09-17T18:16:26.376 INFO:tasks.rados.rados.0.smithi154.stdout:385: finishing write tid 3 to smithi15432074-1 2024-09-17T18:16:26.376 INFO:tasks.rados.rados.0.smithi154.stdout:385: oid 1 updating version 0 to 119 2024-09-17T18:16:26.376 INFO:tasks.rados.rados.0.smithi154.stdout:385: oid 1 updating version 119 to 120 2024-09-17T18:16:26.376 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 1 v 120 (ObjNum 153 snap 33 seq_num 153) dirty exists 2024-09-17T18:16:26.376 INFO:tasks.rados.rados.0.smithi154.stdout:385: left oid 1 (ObjNum 153 snap 33 seq_num 153) 2024-09-17T18:16:26.376 INFO:tasks.rados.rados.0.smithi154.stdout:386: finishing rollback tid 1 to smithi15432074-41 2024-09-17T18:16:26.376 INFO:tasks.rados.rados.0.smithi154.stdout:386: finishing rollback tid 2 to smithi15432074-41 2024-09-17T18:16:26.376 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 41 v 398 (ObjNum 94 snap 15 seq_num 94) dirty exists 2024-09-17T18:16:26.376 INFO:tasks.rados.rados.0.smithi154.stdout:387: finishing write tid 1 to smithi15432074-5 2024-09-17T18:16:26.376 INFO:tasks.rados.rados.0.smithi154.stdout:387: finishing write tid 2 to smithi15432074-5 2024-09-17T18:16:26.376 INFO:tasks.rados.rados.0.smithi154.stdout:387: finishing write tid 3 to smithi15432074-5 2024-09-17T18:16:26.376 INFO:tasks.rados.rados.0.smithi154.stdout:387: oid 5 updating version 0 to 83 2024-09-17T18:16:26.377 INFO:tasks.rados.rados.0.smithi154.stdout:387: oid 5 updating version 83 to 84 2024-09-17T18:16:26.377 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 5 v 84 (ObjNum 154 snap 33 seq_num 154) dirty exists 2024-09-17T18:16:26.377 INFO:tasks.rados.rados.0.smithi154.stdout:387: left oid 5 (ObjNum 154 snap 33 seq_num 154) 2024-09-17T18:16:26.443 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:26.440+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:26.458 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T18:16:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T18:16:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T18:16:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:363 3.9s0 3:9d124c8a:::smithi15432074-25:head [delete] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+full_force+supports_pool_eio e42)", 2024-09-17T18:16:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:37.764061+0000", 2024-09-17T18:16:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.691135576000001, 2024-09-17T18:16:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025800416999999999, 2024-09-17T18:16:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 363 2024-09-17T18:16:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764061+0000", 2024-09-17T18:16:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764061+0000", 2024-09-17T18:16:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764063+0000", 2024-09-17T18:16:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0640000000000001e-06 2024-09-17T18:16:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764072+0000", 2024-09-17T18:16:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5799999999999992e-06 2024-09-17T18:16:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764093+0000", 2024-09-17T18:16:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1495e-05 2024-09-17T18:16:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764107+0000", 2024-09-17T18:16:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3923999999999999e-05 2024-09-17T18:16:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764184+0000", 2024-09-17T18:16:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7185e-05 2024-09-17T18:16:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-17T18:16:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.764194+0000", 2024-09-17T18:16:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.798e-06 2024-09-17T18:16:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.765898+0000", 2024-09-17T18:16:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0017036530000000001 2024-09-17T18:16:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766028+0000", 2024-09-17T18:16:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012982299999999999 2024-09-17T18:16:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.766720+0000", 2024-09-17T18:16:26.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069236299999999998 2024-09-17T18:16:26.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.775694+0000", 2024-09-17T18:16:26.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0089743789999999993 2024-09-17T18:16:26.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:26.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.789778+0000", 2024-09-17T18:16:26.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014084051 2024-09-17T18:16:26.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.789862+0000", 2024-09-17T18:16:26.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3102000000000005e-05 2024-09-17T18:16:26.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.465 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.465 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(osd.5.22:2 3.9s0 3:9634a0c7:::smithi15432074-24:head [assert-version v19,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:26.465 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:37.770314+0000", 2024-09-17T18:16:26.466 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.684882846000001, 2024-09-17T18:16:26.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033325575000000003, 2024-09-17T18:16:26.466 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.466 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.466 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:26.466 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770314+0000", 2024-09-17T18:16:26.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770314+0000", 2024-09-17T18:16:26.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770317+0000", 2024-09-17T18:16:26.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.627e-06 2024-09-17T18:16:26.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770327+0000", 2024-09-17T18:16:26.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0789e-05 2024-09-17T18:16:26.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770356+0000", 2024-09-17T18:16:26.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8940000000000001e-05 2024-09-17T18:16:26.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.770377+0000", 2024-09-17T18:16:26.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0361999999999999e-05 2024-09-17T18:16:26.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.775952+0000", 2024-09-17T18:16:26.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005575333 2024-09-17T18:16:26.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:26.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.776188+0000", 2024-09-17T18:16:26.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000235982 2024-09-17T18:16:26.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.795949+0000", 2024-09-17T18:16:26.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019760771999999999 2024-09-17T18:16:26.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.796074+0000", 2024-09-17T18:16:26.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012547900000000001 2024-09-17T18:16:26.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:37.803639+0000", 2024-09-17T18:16:26.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007565291 2024-09-17T18:16:26.470 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.470 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.470 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.471 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:398 3.9s0 3:91028b13:::smithi15432074-34:head [append 0~606208] snapc d=[d,c,b,a,9,8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T18:16:26.471 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:43.828873+0000", 2024-09-17T18:16:26.471 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.626323612999997, 2024-09-17T18:16:26.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022798233000000001, 2024-09-17T18:16:26.471 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.471 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.471 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:26.471 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:26.471 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:26.471 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:26.471 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 398 2024-09-17T18:16:26.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.471 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.828873+0000", 2024-09-17T18:16:26.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.828873+0000", 2024-09-17T18:16:26.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.828877+0000", 2024-09-17T18:16:26.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6569999999999999e-06 2024-09-17T18:16:26.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.829552+0000", 2024-09-17T18:16:26.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00067549600000000004 2024-09-17T18:16:26.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.829586+0000", 2024-09-17T18:16:26.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3923e-05 2024-09-17T18:16:26.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.829604+0000", 2024-09-17T18:16:26.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7425999999999999e-05 2024-09-17T18:16:26.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.829883+0000", 2024-09-17T18:16:26.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027969300000000002 2024-09-17T18:16:26.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-17T18:16:26.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.829965+0000", 2024-09-17T18:16:26.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1755000000000006e-05 2024-09-17T18:16:26.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.833780+0000", 2024-09-17T18:16:26.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038152870000000001 2024-09-17T18:16:26.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.834070+0000", 2024-09-17T18:16:26.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028968 2024-09-17T18:16:26.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.837763+0000", 2024-09-17T18:16:26.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036926369999999999 2024-09-17T18:16:26.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843381+0000", 2024-09-17T18:16:26.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056183989999999996 2024-09-17T18:16:26.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:26.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.851445+0000", 2024-09-17T18:16:26.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0080642149999999996 2024-09-17T18:16:26.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.851671+0000", 2024-09-17T18:16:26.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022606500000000001 2024-09-17T18:16:26.477 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.477 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.477 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.477 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:402 3.9s0 3:91028b13:::smithi15432074-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48)", 2024-09-17T18:16:26.477 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:43.843801+0000", 2024-09-17T18:16:26.478 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.61139541, 2024-09-17T18:16:26.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016980807000000001, 2024-09-17T18:16:26.478 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.478 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.478 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:26.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:26.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:26.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:26.478 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 402 2024-09-17T18:16:26.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.478 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843801+0000", 2024-09-17T18:16:26.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843801+0000", 2024-09-17T18:16:26.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843803+0000", 2024-09-17T18:16:26.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5689999999999999e-06 2024-09-17T18:16:26.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843810+0000", 2024-09-17T18:16:26.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5329999999999997e-06 2024-09-17T18:16:26.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843834+0000", 2024-09-17T18:16:26.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3354e-05 2024-09-17T18:16:26.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.843854+0000", 2024-09-17T18:16:26.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0438999999999999e-05 2024-09-17T18:16:26.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.855070+0000", 2024-09-17T18:16:26.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011216248999999999 2024-09-17T18:16:26.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:26.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.855397+0000", 2024-09-17T18:16:26.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032609499999999999 2024-09-17T18:16:26.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.858525+0000", 2024-09-17T18:16:26.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031287849999999998 2024-09-17T18:16:26.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.858731+0000", 2024-09-17T18:16:26.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020568600000000001 2024-09-17T18:16:26.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:43.860782+0000", 2024-09-17T18:16:26.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002051097 2024-09-17T18:16:26.482 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.483 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.483 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.483 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(osd.4.23:3 3.9s0 3:91028b13:::smithi15432074-34:head [assert-version v49,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-17T18:16:26.483 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:49.322844+0000", 2024-09-17T18:16:26.483 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.132352494999999, 2024-09-17T18:16:26.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021374363, 2024-09-17T18:16:26.483 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.483 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.483 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:26.483 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.322844+0000", 2024-09-17T18:16:26.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.322844+0000", 2024-09-17T18:16:26.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.322848+0000", 2024-09-17T18:16:26.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5640000000000001e-06 2024-09-17T18:16:26.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.322863+0000", 2024-09-17T18:16:26.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5559000000000001e-05 2024-09-17T18:16:26.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.322896+0000", 2024-09-17T18:16:26.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2688999999999998e-05 2024-09-17T18:16:26.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.322917+0000", 2024-09-17T18:16:26.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1406000000000001e-05 2024-09-17T18:16:26.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.326995+0000", 2024-09-17T18:16:26.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040777790000000001 2024-09-17T18:16:26.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.327260+0000", 2024-09-17T18:16:26.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026509400000000001 2024-09-17T18:16:26.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:49.344219+0000", 2024-09-17T18:16:26.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016958272 2024-09-17T18:16:26.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.487 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.487 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:529 3.9s0 3:9c3858d0:::smithi15432074-4:head [read 0~1327104,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-17T18:16:26.487 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:50.318545+0000", 2024-09-17T18:16:26.487 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.136651835000002, 2024-09-17T18:16:26.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017043862999999999, 2024-09-17T18:16:26.488 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.488 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.488 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:26.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:26.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:26.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:26.488 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 529 2024-09-17T18:16:26.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.488 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318545+0000", 2024-09-17T18:16:26.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318545+0000", 2024-09-17T18:16:26.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318546+0000", 2024-09-17T18:16:26.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1799999999999999e-06 2024-09-17T18:16:26.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318555+0000", 2024-09-17T18:16:26.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4500000000000004e-06 2024-09-17T18:16:26.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318574+0000", 2024-09-17T18:16:26.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9066e-05 2024-09-17T18:16:26.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318591+0000", 2024-09-17T18:16:26.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7223000000000001e-05 2024-09-17T18:16:26.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318710+0000", 2024-09-17T18:16:26.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119418 2024-09-17T18:16:26.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:26.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.318718+0000", 2024-09-17T18:16:26.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7109999999999995e-06 2024-09-17T18:16:26.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.328068+0000", 2024-09-17T18:16:26.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093504609999999991 2024-09-17T18:16:26.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.328355+0000", 2024-09-17T18:16:26.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028624 2024-09-17T18:16:26.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:50.335589+0000", 2024-09-17T18:16:26.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072341139999999998 2024-09-17T18:16:26.493 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.493 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.493 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.493 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:679 3.9s0 3:9d124c8a:::smithi15432074-25:head [append 0~458752] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:26.493 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.453487+0000", 2024-09-17T18:16:26.493 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 20.001709738999999, 2024-09-17T18:16:26.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020100080999999999, 2024-09-17T18:16:26.493 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.493 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.493 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:26.493 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:26.493 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:26.494 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:26.494 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 679 2024-09-17T18:16:26.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.494 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.453487+0000", 2024-09-17T18:16:26.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.453487+0000", 2024-09-17T18:16:26.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.453490+0000", 2024-09-17T18:16:26.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.056e-06 2024-09-17T18:16:26.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.454020+0000", 2024-09-17T18:16:26.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053003700000000002 2024-09-17T18:16:26.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.454055+0000", 2024-09-17T18:16:26.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5332e-05 2024-09-17T18:16:26.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.454078+0000", 2024-09-17T18:16:26.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2952999999999999e-05 2024-09-17T18:16:26.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.454265+0000", 2024-09-17T18:16:26.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000186405 2024-09-17T18:16:26.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-17T18:16:26.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.454277+0000", 2024-09-17T18:16:26.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2683e-05 2024-09-17T18:16:26.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.458599+0000", 2024-09-17T18:16:26.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043215179999999999 2024-09-17T18:16:26.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.458804+0000", 2024-09-17T18:16:26.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000205341 2024-09-17T18:16:26.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.460687+0000", 2024-09-17T18:16:26.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0018830369999999999 2024-09-17T18:16:26.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.466403+0000", 2024-09-17T18:16:26.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057153830000000001 2024-09-17T18:16:26.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:26.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.473312+0000", 2024-09-17T18:16:26.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069090030000000004 2024-09-17T18:16:26.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.473587+0000", 2024-09-17T18:16:26.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000275333 2024-09-17T18:16:26.499 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.499 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.500 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.500 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:682 3.9s0 3:9d124c8a:::smithi15432074-25:head [append 0~458752] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:26.500 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.469190+0000", 2024-09-17T18:16:26.500 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.986006937999999, 2024-09-17T18:16:26.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019040099000000001, 2024-09-17T18:16:26.500 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.500 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.500 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:26.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:26.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:26.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:26.501 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 682 2024-09-17T18:16:26.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.501 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.469190+0000", 2024-09-17T18:16:26.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.469190+0000", 2024-09-17T18:16:26.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.469254+0000", 2024-09-17T18:16:26.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4513999999999999e-05 2024-09-17T18:16:26.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.469973+0000", 2024-09-17T18:16:26.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00071838499999999999 2024-09-17T18:16:26.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470013+0000", 2024-09-17T18:16:26.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9922000000000002e-05 2024-09-17T18:16:26.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470033+0000", 2024-09-17T18:16:26.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0869e-05 2024-09-17T18:16:26.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.476274+0000", 2024-09-17T18:16:26.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00624057 2024-09-17T18:16:26.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.476600+0000", 2024-09-17T18:16:26.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032577499999999999 2024-09-17T18:16:26.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.478586+0000", 2024-09-17T18:16:26.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0019858409999999999 2024-09-17T18:16:26.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.484109+0000", 2024-09-17T18:16:26.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055233440000000003 2024-09-17T18:16:26.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:26.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.488013+0000", 2024-09-17T18:16:26.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0039038950000000001 2024-09-17T18:16:26.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.488230+0000", 2024-09-17T18:16:26.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021698400000000001 2024-09-17T18:16:26.505 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.505 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.505 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.506 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:683 3.9s0 3:9d124c8a:::smithi15432074-25:head [append 0~81920] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:26.506 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.470101+0000", 2024-09-17T18:16:26.506 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.985095972, 2024-09-17T18:16:26.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019222164, 2024-09-17T18:16:26.506 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.506 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.506 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:26.506 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:26.506 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:26.506 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:26.506 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 683 2024-09-17T18:16:26.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.507 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470101+0000", 2024-09-17T18:16:26.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470101+0000", 2024-09-17T18:16:26.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470103+0000", 2024-09-17T18:16:26.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0559999999999999e-06 2024-09-17T18:16:26.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470239+0000", 2024-09-17T18:16:26.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013583599999999999 2024-09-17T18:16:26.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470262+0000", 2024-09-17T18:16:26.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.368e-05 2024-09-17T18:16:26.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470282+0000", 2024-09-17T18:16:26.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9335999999999999e-05 2024-09-17T18:16:26.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.479986+0000", 2024-09-17T18:16:26.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097039250000000004 2024-09-17T18:16:26.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.480255+0000", 2024-09-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026984600000000002 2024-09-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.481689+0000", 2024-09-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001433882 2024-09-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.487710+0000", 2024-09-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060205620000000001 2024-09-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:26.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.489017+0000", 2024-09-17T18:16:26.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001307016 2024-09-17T18:16:26.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.489323+0000", 2024-09-17T18:16:26.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030602500000000003 2024-09-17T18:16:26.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.511 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.511 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:684 3.9s0 3:9d124c8a:::smithi15432074-25:head [setxattr _header (57) in=7b] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:26.512 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.470313+0000", 2024-09-17T18:16:26.512 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.984883532000001, 2024-09-17T18:16:26.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027914910000000001, 2024-09-17T18:16:26.512 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.512 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.512 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:26.512 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:26.512 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:26.512 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:26.512 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 684 2024-09-17T18:16:26.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.512 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470313+0000", 2024-09-17T18:16:26.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470313+0000", 2024-09-17T18:16:26.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470315+0000", 2024-09-17T18:16:26.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4440000000000001e-06 2024-09-17T18:16:26.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470323+0000", 2024-09-17T18:16:26.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4360000000000002e-06 2024-09-17T18:16:26.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470347+0000", 2024-09-17T18:16:26.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4372999999999999e-05 2024-09-17T18:16:26.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470356+0000", 2024-09-17T18:16:26.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8529999999999998e-06 2024-09-17T18:16:26.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.490506+0000", 2024-09-17T18:16:26.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020149571000000002 2024-09-17T18:16:26.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.490780+0000", 2024-09-17T18:16:26.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027409299999999999 2024-09-17T18:16:26.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.492119+0000", 2024-09-17T18:16:26.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001339151 2024-09-17T18:16:26.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.494495+0000", 2024-09-17T18:16:26.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023762980000000002 2024-09-17T18:16:26.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:26.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.498058+0000", 2024-09-17T18:16:26.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035630079999999999 2024-09-17T18:16:26.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.498228+0000", 2024-09-17T18:16:26.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016968300000000001 2024-09-17T18:16:26.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.517 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.517 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:685 3.9s0 3:9d124c8a:::smithi15432074-25:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:26.517 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.470375+0000", 2024-09-17T18:16:26.517 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.984821820000001, 2024-09-17T18:16:26.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030818741, 2024-09-17T18:16:26.518 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.518 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.518 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:26.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:26.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:26.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:26.518 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 685 2024-09-17T18:16:26.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.518 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470375+0000", 2024-09-17T18:16:26.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470375+0000", 2024-09-17T18:16:26.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470376+0000", 2024-09-17T18:16:26.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1999999999999998e-07 2024-09-17T18:16:26.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470382+0000", 2024-09-17T18:16:26.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-09-17T18:16:26.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470395+0000", 2024-09-17T18:16:26.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3427e-05 2024-09-17T18:16:26.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.470403+0000", 2024-09-17T18:16:26.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6729999999999992e-06 2024-09-17T18:16:26.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.492783+0000", 2024-09-17T18:16:26.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022380209000000002 2024-09-17T18:16:26.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:26.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.493019+0000", 2024-09-17T18:16:26.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000235367 2024-09-17T18:16:26.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.499040+0000", 2024-09-17T18:16:26.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060217049999999996 2024-09-17T18:16:26.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.499246+0000", 2024-09-17T18:16:26.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020542600000000001 2024-09-17T18:16:26.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.501194+0000", 2024-09-17T18:16:26.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0019479580000000001 2024-09-17T18:16:26.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.523 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.523 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:715 3.9s0 3:91028b13:::smithi15432074-34:head [setxattr _header (57) in=7b] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:26.523 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.613690+0000", 2024-09-17T18:16:26.523 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.841506308, 2024-09-17T18:16:26.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017636019999999999, 2024-09-17T18:16:26.523 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.523 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.523 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:26.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:26.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:26.524 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:26.524 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 715 2024-09-17T18:16:26.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.524 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613690+0000", 2024-09-17T18:16:26.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613690+0000", 2024-09-17T18:16:26.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613692+0000", 2024-09-17T18:16:26.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9099999999999999e-06 2024-09-17T18:16:26.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613700+0000", 2024-09-17T18:16:26.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9559999999999997e-06 2024-09-17T18:16:26.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613718+0000", 2024-09-17T18:16:26.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7683e-05 2024-09-17T18:16:26.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613729+0000", 2024-09-17T18:16:26.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1306e-05 2024-09-17T18:16:26.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.622011+0000", 2024-09-17T18:16:26.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082821539999999999 2024-09-17T18:16:26.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.622242+0000", 2024-09-17T18:16:26.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000230325 2024-09-17T18:16:26.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.623331+0000", 2024-09-17T18:16:26.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010896269999999999 2024-09-17T18:16:26.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.624647+0000", 2024-09-17T18:16:26.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0013159199999999999 2024-09-17T18:16:26.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:26.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.631207+0000", 2024-09-17T18:16:26.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065599949999999999 2024-09-17T18:16:26.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.631326+0000", 2024-09-17T18:16:26.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119144 2024-09-17T18:16:26.529 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.529 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.529 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.529 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:716 3.9s0 3:91028b13:::smithi15432074-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:26.529 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.613756+0000", 2024-09-17T18:16:26.529 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.841440673000001, 2024-09-17T18:16:26.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020731083000000001, 2024-09-17T18:16:26.529 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.529 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.530 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-17T18:16:26.530 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:26.530 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:26.530 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:26.530 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 716 2024-09-17T18:16:26.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.530 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613756+0000", 2024-09-17T18:16:26.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613756+0000", 2024-09-17T18:16:26.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613757+0000", 2024-09-17T18:16:26.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8599999999999996e-07 2024-09-17T18:16:26.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613761+0000", 2024-09-17T18:16:26.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0799999999999999e-06 2024-09-17T18:16:26.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613772+0000", 2024-09-17T18:16:26.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.112e-05 2024-09-17T18:16:26.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613780+0000", 2024-09-17T18:16:26.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-09-17T18:16:26.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.623948+0000", 2024-09-17T18:16:26.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010167206999999999 2024-09-17T18:16:26.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:26.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.624136+0000", 2024-09-17T18:16:26.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000188763 2024-09-17T18:16:26.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.631384+0000", 2024-09-17T18:16:26.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072478159999999998 2024-09-17T18:16:26.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.631509+0000", 2024-09-17T18:16:26.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000125112 2024-09-17T18:16:26.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.634487+0000", 2024-09-17T18:16:26.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002977876 2024-09-17T18:16:26.534 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.534 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.534 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.535 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:717 3.9s0 3:9634a0c7:::smithi15432074-24:head [append 0~0] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:26.535 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.613793+0000", 2024-09-17T18:16:26.535 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.841403807999999, 2024-09-17T18:16:26.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018392212000000002, 2024-09-17T18:16:26.535 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.535 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.535 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:26.535 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:26.535 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:26.535 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:26.535 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 717 2024-09-17T18:16:26.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.535 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613793+0000", 2024-09-17T18:16:26.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613793+0000", 2024-09-17T18:16:26.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613794+0000", 2024-09-17T18:16:26.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.44e-07 2024-09-17T18:16:26.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613798+0000", 2024-09-17T18:16:26.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3959999999999999e-06 2024-09-17T18:16:26.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613807+0000", 2024-09-17T18:16:26.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1430000000000004e-06 2024-09-17T18:16:26.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613814+0000", 2024-09-17T18:16:26.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.754e-06 2024-09-17T18:16:26.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.624823+0000", 2024-09-17T18:16:26.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011009579 2024-09-17T18:16:26.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.625014+0000", 2024-09-17T18:16:26.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019081 2024-09-17T18:16:26.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.626541+0000", 2024-09-17T18:16:26.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001526845 2024-09-17T18:16:26.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.630457+0000", 2024-09-17T18:16:26.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0039160740000000003 2024-09-17T18:16:26.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:26.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.632100+0000", 2024-09-17T18:16:26.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016427989999999999 2024-09-17T18:16:26.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.632185+0000", 2024-09-17T18:16:26.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5167999999999995e-05 2024-09-17T18:16:26.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.540 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.540 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:718 3.9s0 3:9634a0c7:::smithi15432074-24:head [rollback 7] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:26.540 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.613825+0000", 2024-09-17T18:16:26.541 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.841372095000001, 2024-09-17T18:16:26.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021046438000000001, 2024-09-17T18:16:26.541 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.541 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.541 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:26.541 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:26.541 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:26.541 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:26.541 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 718 2024-09-17T18:16:26.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.541 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613825+0000", 2024-09-17T18:16:26.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613825+0000", 2024-09-17T18:16:26.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613825+0000", 2024-09-17T18:16:26.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-17T18:16:26.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613828+0000", 2024-09-17T18:16:26.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.819e-06 2024-09-17T18:16:26.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613837+0000", 2024-09-17T18:16:26.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1099999999999992e-06 2024-09-17T18:16:26.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613844+0000", 2024-09-17T18:16:26.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7460000000000003e-06 2024-09-17T18:16:26.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.627940+0000", 2024-09-17T18:16:26.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014096042 2024-09-17T18:16:26.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.628151+0000", 2024-09-17T18:16:26.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021151199999999999 2024-09-17T18:16:26.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.629174+0000", 2024-09-17T18:16:26.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001022797 2024-09-17T18:16:26.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.630561+0000", 2024-09-17T18:16:26.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0013862569999999999 2024-09-17T18:16:26.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:26.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.634729+0000", 2024-09-17T18:16:26.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004168143 2024-09-17T18:16:26.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.634871+0000", 2024-09-17T18:16:26.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014239799999999999 2024-09-17T18:16:26.546 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.546 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.546 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.546 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:719 3.9s0 3:9634a0c7:::smithi15432074-24:head [append 0~0] snapc 1b=[1b,1a,19,18,17,16,15,14,13,11,10,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T18:16:26.546 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:06.613854+0000", 2024-09-17T18:16:26.546 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.841342599000001, 2024-09-17T18:16:26.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.024300537000000001, 2024-09-17T18:16:26.546 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.547 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.547 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:26.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:26.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:26.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:26.547 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 719 2024-09-17T18:16:26.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.547 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613854+0000", 2024-09-17T18:16:26.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613854+0000", 2024-09-17T18:16:26.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613855+0000", 2024-09-17T18:16:26.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4000000000000001e-07 2024-09-17T18:16:26.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613858+0000", 2024-09-17T18:16:26.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7930000000000002e-06 2024-09-17T18:16:26.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613866+0000", 2024-09-17T18:16:26.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9199999999999993e-06 2024-09-17T18:16:26.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.613873+0000", 2024-09-17T18:16:26.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7530000000000004e-06 2024-09-17T18:16:26.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.632546+0000", 2024-09-17T18:16:26.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018672645000000002 2024-09-17T18:16:26.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:26.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.632660+0000", 2024-09-17T18:16:26.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000113792 2024-09-17T18:16:26.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.633319+0000", 2024-09-17T18:16:26.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00065883499999999998 2024-09-17T18:16:26.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.635158+0000", 2024-09-17T18:16:26.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0018398189999999999 2024-09-17T18:16:26.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:26.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.638035+0000", 2024-09-17T18:16:26.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002876562 2024-09-17T18:16:26.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:06.638155+0000", 2024-09-17T18:16:26.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119778 2024-09-17T18:16:26.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.552 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.552 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.0s1 86/31 ECSubWrite(tid=90, reqid=client.4565.0:931, at_version=86'74, trim_to=0'0, roll_forward_to=85'71))", 2024-09-17T18:16:26.552 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.345801+0000", 2024-09-17T18:16:26.552 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.1093961109999997, 2024-09-17T18:16:26.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022993821000000001, 2024-09-17T18:16:26.553 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.553 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.553 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:26.553 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.345801+0000", 2024-09-17T18:16:26.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.345801+0000", 2024-09-17T18:16:26.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.345802+0000", 2024-09-17T18:16:26.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8700000000000001e-06 2024-09-17T18:16:26.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.345850+0000", 2024-09-17T18:16:26.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7729000000000003e-05 2024-09-17T18:16:26.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.345879+0000", 2024-09-17T18:16:26.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8691999999999999e-05 2024-09-17T18:16:26.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.345901+0000", 2024-09-17T18:16:26.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2419e-05 2024-09-17T18:16:26.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.346176+0000", 2024-09-17T18:16:26.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027436000000000002 2024-09-17T18:16:26.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.346203+0000", 2024-09-17T18:16:26.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7419e-05 2024-09-17T18:16:26.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.368707+0000", 2024-09-17T18:16:26.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022504148000000002 2024-09-17T18:16:26.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.368794+0000", 2024-09-17T18:16:26.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7183999999999997e-05 2024-09-17T18:16:26.557 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.557 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.557 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.557 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs4 86/31 ECSubWrite(tid=198, reqid=osd.5.0:198, at_version=86'119, trim_to=0'0, roll_forward_to=85'117))", 2024-09-17T18:16:26.557 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.347096+0000", 2024-09-17T18:16:26.557 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.1081002819999997, 2024-09-17T18:16:26.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019568484000000001, 2024-09-17T18:16:26.557 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.347096+0000", 2024-09-17T18:16:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.347096+0000", 2024-09-17T18:16:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.347097+0000", 2024-09-17T18:16:26.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4000000000000001e-07 2024-09-17T18:16:26.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.347144+0000", 2024-09-17T18:16:26.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6906000000000001e-05 2024-09-17T18:16:26.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.347171+0000", 2024-09-17T18:16:26.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7395000000000001e-05 2024-09-17T18:16:26.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.347192+0000", 2024-09-17T18:16:26.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0194e-05 2024-09-17T18:16:26.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.347413+0000", 2024-09-17T18:16:26.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000221654 2024-09-17T18:16:26.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.347439+0000", 2024-09-17T18:16:26.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6259e-05 2024-09-17T18:16:26.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.366541+0000", 2024-09-17T18:16:26.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019101791999999999 2024-09-17T18:16:26.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.366665+0000", 2024-09-17T18:16:26.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012364400000000001 2024-09-17T18:16:26.561 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.562 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.562 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.562 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.0s1 86/31 ECSubWrite(tid=91, reqid=client.4565.0:932, at_version=86'75, trim_to=0'0, roll_forward_to=85'71))", 2024-09-17T18:16:26.562 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.349329+0000", 2024-09-17T18:16:26.562 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.1058679800000002, 2024-09-17T18:16:26.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019536550999999999, 2024-09-17T18:16:26.562 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.562 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.562 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:26.562 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349329+0000", 2024-09-17T18:16:26.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349329+0000", 2024-09-17T18:16:26.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349331+0000", 2024-09-17T18:16:26.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0930000000000001e-06 2024-09-17T18:16:26.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349376+0000", 2024-09-17T18:16:26.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5259000000000002e-05 2024-09-17T18:16:26.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349405+0000", 2024-09-17T18:16:26.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8996000000000002e-05 2024-09-17T18:16:26.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349427+0000", 2024-09-17T18:16:26.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2149000000000001e-05 2024-09-17T18:16:26.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349595+0000", 2024-09-17T18:16:26.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016737300000000001 2024-09-17T18:16:26.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349620+0000", 2024-09-17T18:16:26.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5842000000000001e-05 2024-09-17T18:16:26.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.368808+0000", 2024-09-17T18:16:26.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019187795000000001 2024-09-17T18:16:26.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.368865+0000", 2024-09-17T18:16:26.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7043999999999998e-05 2024-09-17T18:16:26.566 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.566 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.566 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.566 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.cs4 86/31 ECSubWrite(tid=199, reqid=osd.5.0:199, at_version=86'121, trim_to=0'0, roll_forward_to=85'117))", 2024-09-17T18:16:26.567 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.351285+0000", 2024-09-17T18:16:26.567 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.1039120840000001, 2024-09-17T18:16:26.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018630335000000001, 2024-09-17T18:16:26.567 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.567 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.567 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:26.567 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351285+0000", 2024-09-17T18:16:26.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351285+0000", 2024-09-17T18:16:26.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351287+0000", 2024-09-17T18:16:26.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9860000000000001e-06 2024-09-17T18:16:26.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351336+0000", 2024-09-17T18:16:26.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9678000000000001e-05 2024-09-17T18:16:26.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351368+0000", 2024-09-17T18:16:26.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1776000000000002e-05 2024-09-17T18:16:26.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351389+0000", 2024-09-17T18:16:26.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1097000000000001e-05 2024-09-17T18:16:26.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351575+0000", 2024-09-17T18:16:26.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018564800000000001 2024-09-17T18:16:26.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351610+0000", 2024-09-17T18:16:26.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5632e-05 2024-09-17T18:16:26.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.369831+0000", 2024-09-17T18:16:26.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018220971999999998 2024-09-17T18:16:26.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.369915+0000", 2024-09-17T18:16:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3546000000000003e-05 2024-09-17T18:16:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.571 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:26.573 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T18:16:26.573 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:16:26.569+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:16:26.674 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:26.670+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:26.699 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:26.699 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:26.699 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T18:16:26.699 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:26.713 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T18:16:26.775 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:26.770+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:26.836 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:26.836 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:26.836 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T18:16:26.836 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T18:16:26.836 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:26.850 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T18:16:26.876 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:26.872+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:26.971 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T18:16:26.973 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T18:16:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T18:16:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T18:16:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.fs5 43/31 ECSubWrite(tid=186, reqid=osd.13.0:182, at_version=0'0, trim_to=0'0, roll_forward_to=43'14))", 2024-09-17T18:16:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.789240+0000", 2024-09-17T18:16:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.181350946000002, 2024-09-17T18:16:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015813436, 2024-09-17T18:16:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789240+0000", 2024-09-17T18:16:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789240+0000", 2024-09-17T18:16:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789242+0000", 2024-09-17T18:16:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7099999999999999e-06 2024-09-17T18:16:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789265+0000", 2024-09-17T18:16:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3512000000000001e-05 2024-09-17T18:16:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789308+0000", 2024-09-17T18:16:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3306000000000002e-05 2024-09-17T18:16:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.789332+0000", 2024-09-17T18:16:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.321e-05 2024-09-17T18:16:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.792912+0000", 2024-09-17T18:16:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035800799999999998 2024-09-17T18:16:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.792935+0000", 2024-09-17T18:16:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3516e-05 2024-09-17T18:16:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.804968+0000", 2024-09-17T18:16:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012033090999999999 2024-09-17T18:16:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.805053+0000", 2024-09-17T18:16:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5011000000000003e-05 2024-09-17T18:16:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.bs4 43/31 ECSubWrite(tid=110, reqid=osd.4.0:110, at_version=43'42, trim_to=0'0, roll_forward_to=43'38))", 2024-09-17T18:16:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.793414+0000", 2024-09-17T18:16:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.177176490999997, 2024-09-17T18:16:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017191942000000002, 2024-09-17T18:16:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793414+0000", 2024-09-17T18:16:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793414+0000", 2024-09-17T18:16:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793416+0000", 2024-09-17T18:16:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.68e-06 2024-09-17T18:16:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793465+0000", 2024-09-17T18:16:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8939e-05 2024-09-17T18:16:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793487+0000", 2024-09-17T18:16:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1959000000000001e-05 2024-09-17T18:16:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793506+0000", 2024-09-17T18:16:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8643000000000001e-05 2024-09-17T18:16:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794384+0000", 2024-09-17T18:16:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00087825200000000005 2024-09-17T18:16:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794407+0000", 2024-09-17T18:16:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3329e-05 2024-09-17T18:16:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810507+0000", 2024-09-17T18:16:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016100079 2024-09-17T18:16:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810606+0000", 2024-09-17T18:16:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9061000000000006e-05 2024-09-17T18:16:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s3 43/31 ECSubWrite(tid=48, reqid=osd.7.0:48, at_version=43'36, trim_to=0'0, roll_forward_to=42'32))", 2024-09-17T18:16:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.793451+0000", 2024-09-17T18:16:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.177140211999998, 2024-09-17T18:16:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016922466000000001, 2024-09-17T18:16:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793451+0000", 2024-09-17T18:16:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793451+0000", 2024-09-17T18:16:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793452+0000", 2024-09-17T18:16:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1030000000000001e-06 2024-09-17T18:16:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793498+0000", 2024-09-17T18:16:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6273000000000002e-05 2024-09-17T18:16:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793513+0000", 2024-09-17T18:16:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5270000000000001e-05 2024-09-17T18:16:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793524+0000", 2024-09-17T18:16:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1165999999999999e-05 2024-09-17T18:16:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.803042+0000", 2024-09-17T18:16:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009517111 2024-09-17T18:16:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.803071+0000", 2024-09-17T18:16:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9223000000000001e-05 2024-09-17T18:16:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810283+0000", 2024-09-17T18:16:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072125119999999999 2024-09-17T18:16:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.810373+0000", 2024-09-17T18:16:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9808000000000005e-05 2024-09-17T18:16:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.5s6 43/31 ECSubWrite(tid=46, reqid=osd.5.0:46, at_version=43'12, trim_to=0'0, roll_forward_to=42'10))", 2024-09-17T18:16:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:15:38.793629+0000", 2024-09-17T18:16:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.176961399, 2024-09-17T18:16:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015350447999999999, 2024-09-17T18:16:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793629+0000", 2024-09-17T18:16:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793629+0000", 2024-09-17T18:16:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793630+0000", 2024-09-17T18:16:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4600000000000004e-07 2024-09-17T18:16:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793671+0000", 2024-09-17T18:16:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1146000000000002e-05 2024-09-17T18:16:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793695+0000", 2024-09-17T18:16:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4015999999999998e-05 2024-09-17T18:16:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793713+0000", 2024-09-17T18:16:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8076000000000001e-05 2024-09-17T18:16:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.793976+0000", 2024-09-17T18:16:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026206999999999999 2024-09-17T18:16:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.794001+0000", 2024-09-17T18:16:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5709000000000001e-05 2024-09-17T18:16:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.808902+0000", 2024-09-17T18:16:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014900943 2024-09-17T18:16:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:15:38.808980+0000", 2024-09-17T18:16:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7742000000000002e-05 2024-09-17T18:16:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s2 76/31 ECSubWrite(tid=184, reqid=osd.6.0:184, at_version=76'68, trim_to=0'0, roll_forward_to=75'66))", 2024-09-17T18:16:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:11.333259+0000", 2024-09-17T18:16:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.637332226, 2024-09-17T18:16:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016218685, 2024-09-17T18:16:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:11.333259+0000", 2024-09-17T18:16:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:11.333259+0000", 2024-09-17T18:16:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:11.333260+0000", 2024-09-17T18:16:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2440000000000001e-06 2024-09-17T18:16:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:11.333298+0000", 2024-09-17T18:16:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8445000000000002e-05 2024-09-17T18:16:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:11.333320+0000", 2024-09-17T18:16:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1265999999999999e-05 2024-09-17T18:16:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:11.333336+0000", 2024-09-17T18:16:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6447e-05 2024-09-17T18:16:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:11.333669+0000", 2024-09-17T18:16:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00033303100000000002 2024-09-17T18:16:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:11.333692+0000", 2024-09-17T18:16:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2626e-05 2024-09-17T18:16:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:11.349400+0000", 2024-09-17T18:16:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015708598000000001 2024-09-17T18:16:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:11.349477+0000", 2024-09-17T18:16:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7027999999999995e-05 2024-09-17T18:16:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s2 80/31 ECSubWrite(tid=202, reqid=osd.6.0:202, at_version=80'89, trim_to=0'0, roll_forward_to=79'87))", 2024-09-17T18:16:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:15.502591+0000", 2024-09-17T18:16:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.467999663000001, 2024-09-17T18:16:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015778701999999999, 2024-09-17T18:16:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.502591+0000", 2024-09-17T18:16:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.502591+0000", 2024-09-17T18:16:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.502593+0000", 2024-09-17T18:16:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2839999999999999e-06 2024-09-17T18:16:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.502628+0000", 2024-09-17T18:16:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5618999999999999e-05 2024-09-17T18:16:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.502646+0000", 2024-09-17T18:16:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7703999999999999e-05 2024-09-17T18:16:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.502658+0000", 2024-09-17T18:16:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1950000000000001e-05 2024-09-17T18:16:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.502789+0000", 2024-09-17T18:16:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013138700000000001 2024-09-17T18:16:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.502814+0000", 2024-09-17T18:16:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4726e-05 2024-09-17T18:16:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.518263+0000", 2024-09-17T18:16:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015449479 2024-09-17T18:16:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:15.518370+0000", 2024-09-17T18:16:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010655299999999999 2024-09-17T18:16:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.bs4 85/31 ECSubWrite(tid=333, reqid=osd.4.0:333, at_version=85'172, trim_to=0'0, roll_forward_to=84'170))", 2024-09-17T18:16:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:20.333465+0000", 2024-09-17T18:16:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.6371263240000005, 2024-09-17T18:16:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018199894000000001, 2024-09-17T18:16:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333465+0000", 2024-09-17T18:16:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333465+0000", 2024-09-17T18:16:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333465+0000", 2024-09-17T18:16:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3e-07 2024-09-17T18:16:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333523+0000", 2024-09-17T18:16:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7955999999999999e-05 2024-09-17T18:16:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333549+0000", 2024-09-17T18:16:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5375e-05 2024-09-17T18:16:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333570+0000", 2024-09-17T18:16:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1957e-05 2024-09-17T18:16:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333749+0000", 2024-09-17T18:16:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017849200000000001 2024-09-17T18:16:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333776+0000", 2024-09-17T18:16:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7429000000000001e-05 2024-09-17T18:16:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.351591+0000", 2024-09-17T18:16:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017814989999999999 2024-09-17T18:16:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.351664+0000", 2024-09-17T18:16:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3065000000000006e-05 2024-09-17T18:16:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.3s4 85/31 ECSubWrite(tid=107, reqid=osd.10.0:107, at_version=85'65, trim_to=0'0, roll_forward_to=84'63))", 2024-09-17T18:16:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:20.333595+0000", 2024-09-17T18:16:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.636995937, 2024-09-17T18:16:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018184196999999999, 2024-09-17T18:16:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333595+0000", 2024-09-17T18:16:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333595+0000", 2024-09-17T18:16:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333596+0000", 2024-09-17T18:16:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-17T18:16:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333653+0000", 2024-09-17T18:16:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7425e-05 2024-09-17T18:16:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333748+0000", 2024-09-17T18:16:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4795000000000003e-05 2024-09-17T18:16:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333770+0000", 2024-09-17T18:16:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2325000000000001e-05 2024-09-17T18:16:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.334329+0000", 2024-09-17T18:16:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055848599999999997 2024-09-17T18:16:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.334356+0000", 2024-09-17T18:16:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7005999999999999e-05 2024-09-17T18:16:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.351719+0000", 2024-09-17T18:16:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017363725 2024-09-17T18:16:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.351779+0000", 2024-09-17T18:16:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9892000000000002e-05 2024-09-17T18:16:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.bs4 85/31 ECSubWrite(tid=335, reqid=osd.4.0:335, at_version=85'174, trim_to=0'0, roll_forward_to=84'170))", 2024-09-17T18:16:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:20.333803+0000", 2024-09-17T18:16:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.6367883689999996, 2024-09-17T18:16:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018041070999999999, 2024-09-17T18:16:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333803+0000", 2024-09-17T18:16:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333803+0000", 2024-09-17T18:16:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333804+0000", 2024-09-17T18:16:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0330000000000001e-06 2024-09-17T18:16:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333842+0000", 2024-09-17T18:16:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8732000000000001e-05 2024-09-17T18:16:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333864+0000", 2024-09-17T18:16:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1943e-05 2024-09-17T18:16:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.333881+0000", 2024-09-17T18:16:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6616000000000002e-05 2024-09-17T18:16:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.337074+0000", 2024-09-17T18:16:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031927840000000002 2024-09-17T18:16:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.337100+0000", 2024-09-17T18:16:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6842000000000002e-05 2024-09-17T18:16:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.351786+0000", 2024-09-17T18:16:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014685426 2024-09-17T18:16:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.351844+0000", 2024-09-17T18:16:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7695000000000002e-05 2024-09-17T18:16:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.3s4 85/31 ECSubWrite(tid=109, reqid=osd.10.0:109, at_version=85'67, trim_to=0'0, roll_forward_to=84'63))", 2024-09-17T18:16:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:20.334354+0000", 2024-09-17T18:16:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.6362369900000004, 2024-09-17T18:16:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018314604000000002, 2024-09-17T18:16:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.334354+0000", 2024-09-17T18:16:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.334354+0000", 2024-09-17T18:16:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.334356+0000", 2024-09-17T18:16:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8160000000000001e-06 2024-09-17T18:16:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.334408+0000", 2024-09-17T18:16:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1851999999999998e-05 2024-09-17T18:16:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.334440+0000", 2024-09-17T18:16:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2060000000000001e-05 2024-09-17T18:16:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.334465+0000", 2024-09-17T18:16:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5485000000000001e-05 2024-09-17T18:16:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.340258+0000", 2024-09-17T18:16:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057932330000000001 2024-09-17T18:16:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.340285+0000", 2024-09-17T18:16:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6305e-05 2024-09-17T18:16:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.352581+0000", 2024-09-17T18:16:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012296268000000001 2024-09-17T18:16:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.352669+0000", 2024-09-17T18:16:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7584999999999996e-05 2024-09-17T18:16:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.5s6 85/31 ECSubWrite(tid=179, reqid=osd.5.0:179, at_version=85'58, trim_to=0'0, roll_forward_to=84'56))", 2024-09-17T18:16:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:20.343942+0000", 2024-09-17T18:16:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.6266493950000003, 2024-09-17T18:16:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017349816000000001, 2024-09-17T18:16:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.343942+0000", 2024-09-17T18:16:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.343942+0000", 2024-09-17T18:16:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.343942+0000", 2024-09-17T18:16:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0699999999999997e-07 2024-09-17T18:16:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.343997+0000", 2024-09-17T18:16:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4756000000000002e-05 2024-09-17T18:16:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.344028+0000", 2024-09-17T18:16:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1182000000000001e-05 2024-09-17T18:16:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.344050+0000", 2024-09-17T18:16:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2243e-05 2024-09-17T18:16:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.344275+0000", 2024-09-17T18:16:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022496699999999999 2024-09-17T18:16:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.344301+0000", 2024-09-17T18:16:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5452999999999998e-05 2024-09-17T18:16:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.361200+0000", 2024-09-17T18:16:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016898894000000001 2024-09-17T18:16:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.361291+0000", 2024-09-17T18:16:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1713999999999996e-05 2024-09-17T18:16:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.8s2 85/31 ECSubWrite(tid=217, reqid=osd.6.0:217, at_version=85'106, trim_to=0'0, roll_forward_to=84'102))", 2024-09-17T18:16:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:20.345349+0000", 2024-09-17T18:16:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.6252419849999997, 2024-09-17T18:16:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016067680000000001, 2024-09-17T18:16:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.345349+0000", 2024-09-17T18:16:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.345349+0000", 2024-09-17T18:16:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.345350+0000", 2024-09-17T18:16:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0699999999999999e-06 2024-09-17T18:16:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.345390+0000", 2024-09-17T18:16:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0156e-05 2024-09-17T18:16:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.345417+0000", 2024-09-17T18:16:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6522000000000001e-05 2024-09-17T18:16:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.345437+0000", 2024-09-17T18:16:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.986e-05 2024-09-17T18:16:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.351805+0000", 2024-09-17T18:16:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0063680830000000001 2024-09-17T18:16:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.351830+0000", 2024-09-17T18:16:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5378999999999999e-05 2024-09-17T18:16:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.361326+0000", 2024-09-17T18:16:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094957719999999995 2024-09-17T18:16:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.361417+0000", 2024-09-17T18:16:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0838e-05 2024-09-17T18:16:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 85/31 ECSubWrite(tid=339, reqid=osd.4.0:339, at_version=85'148, trim_to=0'0, roll_forward_to=85'144))", 2024-09-17T18:16:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:20.357005+0000", 2024-09-17T18:16:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.6135859230000005, 2024-09-17T18:16:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015510097, 2024-09-17T18:16:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.357005+0000", 2024-09-17T18:16:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.357005+0000", 2024-09-17T18:16:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.357007+0000", 2024-09-17T18:16:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9199999999999998e-06 2024-09-17T18:16:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.357046+0000", 2024-09-17T18:16:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9452000000000001e-05 2024-09-17T18:16:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.357070+0000", 2024-09-17T18:16:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3952999999999999e-05 2024-09-17T18:16:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.357091+0000", 2024-09-17T18:16:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0956000000000001e-05 2024-09-17T18:16:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.359899+0000", 2024-09-17T18:16:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028073870000000002 2024-09-17T18:16:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.359933+0000", 2024-09-17T18:16:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4508999999999998e-05 2024-09-17T18:16:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.372422+0000", 2024-09-17T18:16:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012488706 2024-09-17T18:16:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:20.372515+0000", 2024-09-17T18:16:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3214000000000006e-05 2024-09-17T18:16:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4565.0:929 3.es0 3:7bd1c352:::smithi15432074-14:head [rmxattr QSP`hlVUcRehtg`kXcaYbmZtgpdRmQa[pVq`_YPe in=40b,rmxattr ZNaa^bfR]YRlUQqQeq\\nkcZ[[mt]YaRQibRreptZ in=40b,rmxattr ajaTlrOQanZ`lk[^nsfObkVfhlcrl[`QgYXZ_a]t in=40b,rmxattr gS\\OStP]mjX_jcbPUj\\h_md]Umj]boXVUZZQQlsc in=40b,rmxattr m^bg`_t^^mfPhoRq`hZaih in=22b,rmxattr nmNonb_SPsZrNeX^T^YRStm]_tpsYO^acoqtjsc[ in=40b] snapc 1f=[1f,1e,1d,1c,18,16,15,11] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-17T18:16:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.335899+0000", 2024-09-17T18:16:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.6346914330000004, 2024-09-17T18:16:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.038001121999999998, 2024-09-17T18:16:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T18:16:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4565", 2024-09-17T18:16:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 929 2024-09-17T18:16:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.335899+0000", 2024-09-17T18:16:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.335899+0000", 2024-09-17T18:16:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.335902+0000", 2024-09-17T18:16:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6840000000000001e-06 2024-09-17T18:16:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.335913+0000", 2024-09-17T18:16:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1066e-05 2024-09-17T18:16:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.335942+0000", 2024-09-17T18:16:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8436e-05 2024-09-17T18:16:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.335954+0000", 2024-09-17T18:16:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2092e-05 2024-09-17T18:16:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336119+0000", 2024-09-17T18:16:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000165336 2024-09-17T18:16:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-17T18:16:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.336141+0000", 2024-09-17T18:16:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2376000000000001e-05 2024-09-17T18:16:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.341460+0000", 2024-09-17T18:16:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053189980000000001 2024-09-17T18:16:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T18:16:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.341624+0000", 2024-09-17T18:16:27.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016332299999999999 2024-09-17T18:16:27.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:27.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.343067+0000", 2024-09-17T18:16:27.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014428679999999999 2024-09-17T18:16:27.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:27.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.356726+0000", 2024-09-17T18:16:27.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013659376000000001 2024-09-17T18:16:27.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T18:16:27.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.373686+0000", 2024-09-17T18:16:27.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016959964000000001 2024-09-17T18:16:27.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:27.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.373901+0000", 2024-09-17T18:16:27.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021460300000000001 2024-09-17T18:16:27.045 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.045 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.045 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.046 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.3s4 86/31 ECSubWrite(tid=130, reqid=osd.10.0:130, at_version=86'69, trim_to=0'0, roll_forward_to=85'67))", 2024-09-17T18:16:27.046 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.342534+0000", 2024-09-17T18:16:27.046 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.6280567770000003, 2024-09-17T18:16:27.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017745034999999999, 2024-09-17T18:16:27.046 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:27.046 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:27.046 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:27.046 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:27.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:27.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.342534+0000", 2024-09-17T18:16:27.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:27.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.342534+0000", 2024-09-17T18:16:27.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:27.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.342535+0000", 2024-09-17T18:16:27.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.37e-07 2024-09-17T18:16:27.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:27.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.342586+0000", 2024-09-17T18:16:27.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0921999999999998e-05 2024-09-17T18:16:27.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:27.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.342610+0000", 2024-09-17T18:16:27.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4096000000000001e-05 2024-09-17T18:16:27.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:27.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.342632+0000", 2024-09-17T18:16:27.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1812999999999999e-05 2024-09-17T18:16:27.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.343664+0000", 2024-09-17T18:16:27.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00103213 2024-09-17T18:16:27.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:27.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.343692+0000", 2024-09-17T18:16:27.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8619000000000002e-05 2024-09-17T18:16:27.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:27.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.360199+0000", 2024-09-17T18:16:27.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016506219999999999 2024-09-17T18:16:27.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:27.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.360279+0000", 2024-09-17T18:16:27.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0598000000000003e-05 2024-09-17T18:16:27.050 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.050 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.050 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.050 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.fs5 86/31 ECSubWrite(tid=650, reqid=osd.13.0:650, at_version=86'44, trim_to=0'0, roll_forward_to=85'42))", 2024-09-17T18:16:27.050 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.344641+0000", 2024-09-17T18:16:27.050 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.6259494849999996, 2024-09-17T18:16:27.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021660331000000001, 2024-09-17T18:16:27.050 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:27.050 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:27.051 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:27.051 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:27.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:27.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.344641+0000", 2024-09-17T18:16:27.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:27.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.344641+0000", 2024-09-17T18:16:27.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:27.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.344643+0000", 2024-09-17T18:16:27.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.81e-06 2024-09-17T18:16:27.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:27.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.344693+0000", 2024-09-17T18:16:27.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9744999999999999e-05 2024-09-17T18:16:27.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:27.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.344724+0000", 2024-09-17T18:16:27.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0639000000000003e-05 2024-09-17T18:16:27.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:27.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.344746+0000", 2024-09-17T18:16:27.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2333000000000001e-05 2024-09-17T18:16:27.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.344869+0000", 2024-09-17T18:16:27.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012323299999999999 2024-09-17T18:16:27.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:27.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.344885+0000", 2024-09-17T18:16:27.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5435999999999999e-05 2024-09-17T18:16:27.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:27.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.366240+0000", 2024-09-17T18:16:27.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021354897000000001 2024-09-17T18:16:27.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:27.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.366302+0000", 2024-09-17T18:16:27.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2237999999999996e-05 2024-09-17T18:16:27.055 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.055 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.055 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.055 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.bs4 86/31 ECSubWrite(tid=353, reqid=osd.4.0:353, at_version=86'184, trim_to=0'0, roll_forward_to=85'180))", 2024-09-17T18:16:27.055 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.347310+0000", 2024-09-17T18:16:27.055 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.6232804549999997, 2024-09-17T18:16:27.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018004841000000001, 2024-09-17T18:16:27.055 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:27.055 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:27.055 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:27.055 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:27.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:27.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.347310+0000", 2024-09-17T18:16:27.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:27.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.347310+0000", 2024-09-17T18:16:27.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:27.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.347312+0000", 2024-09-17T18:16:27.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7239999999999999e-06 2024-09-17T18:16:27.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:27.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.347360+0000", 2024-09-17T18:16:27.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8228e-05 2024-09-17T18:16:27.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:27.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.347388+0000", 2024-09-17T18:16:27.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8106000000000002e-05 2024-09-17T18:16:27.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:27.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.347410+0000", 2024-09-17T18:16:27.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1523e-05 2024-09-17T18:16:27.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351799+0000", 2024-09-17T18:16:27.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043884850000000001 2024-09-17T18:16:27.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:27.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.351826+0000", 2024-09-17T18:16:27.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7676000000000001e-05 2024-09-17T18:16:27.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:27.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.365227+0000", 2024-09-17T18:16:27.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013400801 2024-09-17T18:16:27.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:27.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.365315+0000", 2024-09-17T18:16:27.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8298000000000001e-05 2024-09-17T18:16:27.060 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.060 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.060 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.061 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 86/31 ECSubWrite(tid=354, reqid=osd.4.0:354, at_version=86'155, trim_to=0'0, roll_forward_to=85'153))", 2024-09-17T18:16:27.061 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.349674+0000", 2024-09-17T18:16:27.061 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.6209173660000005, 2024-09-17T18:16:27.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016546437000000001, 2024-09-17T18:16:27.061 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:27.061 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:27.061 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:27.061 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:27.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:27.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349674+0000", 2024-09-17T18:16:27.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:27.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349674+0000", 2024-09-17T18:16:27.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:27.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349676+0000", 2024-09-17T18:16:27.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.03e-06 2024-09-17T18:16:27.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:27.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349727+0000", 2024-09-17T18:16:27.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1431000000000003e-05 2024-09-17T18:16:27.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:27.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349768+0000", 2024-09-17T18:16:27.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0698999999999998e-05 2024-09-17T18:16:27.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:27.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349794+0000", 2024-09-17T18:16:27.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5897e-05 2024-09-17T18:16:27.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350232+0000", 2024-09-17T18:16:27.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00043793400000000001 2024-09-17T18:16:27.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:27.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350259+0000", 2024-09-17T18:16:27.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7149999999999999e-05 2024-09-17T18:16:27.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:27.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.366137+0000", 2024-09-17T18:16:27.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015877992 2024-09-17T18:16:27.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:27.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.366220+0000", 2024-09-17T18:16:27.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3304000000000001e-05 2024-09-17T18:16:27.065 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.065 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.065 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.065 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.9s3 86/31 ECSubWrite(tid=193, reqid=osd.7.0:193, at_version=86'188, trim_to=0'0, roll_forward_to=85'186))", 2024-09-17T18:16:27.065 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.349930+0000", 2024-09-17T18:16:27.066 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.6206612529999997, 2024-09-17T18:16:27.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016942773000000001, 2024-09-17T18:16:27.066 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:27.066 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:27.066 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:27.066 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:27.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:27.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349930+0000", 2024-09-17T18:16:27.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:27.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349930+0000", 2024-09-17T18:16:27.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:27.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349930+0000", 2024-09-17T18:16:27.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4600000000000005e-07 2024-09-17T18:16:27.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:27.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349970+0000", 2024-09-17T18:16:27.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9813e-05 2024-09-17T18:16:27.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:27.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.349996+0000", 2024-09-17T18:16:27.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5876000000000001e-05 2024-09-17T18:16:27.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:27.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350020+0000", 2024-09-17T18:16:27.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4145999999999999e-05 2024-09-17T18:16:27.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350169+0000", 2024-09-17T18:16:27.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000148806 2024-09-17T18:16:27.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:27.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.350189+0000", 2024-09-17T18:16:27.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0395999999999999e-05 2024-09-17T18:16:27.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:27.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.366810+0000", 2024-09-17T18:16:27.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016620276999999999 2024-09-17T18:16:27.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:27.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.366872+0000", 2024-09-17T18:16:27.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2912999999999999e-05 2024-09-17T18:16:27.070 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.070 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.070 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.070 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDECSubOpWrite(3.7s1 86/31 ECSubWrite(tid=356, reqid=client.4565.0:936, at_version=86'159, trim_to=0'0, roll_forward_to=85'153))", 2024-09-17T18:16:27.070 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T18:16:21.358401+0000", 2024-09-17T18:16:27.070 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.6121898449999996, 2024-09-17T18:16:27.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015578242000000001, 2024-09-17T18:16:27.071 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T18:16:27.071 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T18:16:27.071 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-17T18:16:27.071 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T18:16:27.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T18:16:27.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.358401+0000", 2024-09-17T18:16:27.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T18:16:27.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.358401+0000", 2024-09-17T18:16:27.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T18:16:27.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T18:16:27.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.358403+0000", 2024-09-17T18:16:27.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7090000000000001e-06 2024-09-17T18:16:27.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T18:16:27.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.358607+0000", 2024-09-17T18:16:27.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204355 2024-09-17T18:16:27.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T18:16:27.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.358635+0000", 2024-09-17T18:16:27.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7725e-05 2024-09-17T18:16:27.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T18:16:27.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.358654+0000", 2024-09-17T18:16:27.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8745000000000001e-05 2024-09-17T18:16:27.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T18:16:27.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.360556+0000", 2024-09-17T18:16:27.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0019028960000000001 2024-09-17T18:16:27.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_started", 2024-09-17T18:16:27.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.360580+0000", 2024-09-17T18:16:27.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3285000000000002e-05 2024-09-17T18:16:27.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_committed", 2024-09-17T18:16:27.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.373901+0000", 2024-09-17T18:16:27.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013321553999999999 2024-09-17T18:16:27.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T18:16:27.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T18:16:27.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T18:16:27.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T18:16:21.373979+0000", 2024-09-17T18:16:27.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7972999999999994e-05 2024-09-17T18:16:27.075 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.075 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.075 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.075 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T18:16:27.075 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T18:16:27.075 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:27.077 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T18:16:27.078 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:27.074+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:27.124 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:16:27.124 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:16:27.145 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:16:27.145 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:16:27.165 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:16:27.165 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:16:27.177 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:27.173+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:27.187 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:16:27.187 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:16:27.206 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:27.206 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:27.206 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T18:16:27.206 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:27.207 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:16:27.208 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:16:27.220 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T18:16:27.230 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:16:27.230 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:16:27.252 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:16:27.253 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:16:27.273 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:16:27.273 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:16:27.277 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-17T18:16:27.273+0000 7fe81cd2e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26602) UID: 0 2024-09-17T18:16:27.293 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:16:27.293 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:16:27.317 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:16:27.317 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:16:27.339 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T18:16:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T18:16:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T18:16:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T18:16:27.339 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T18:16:27.339 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:16:27.340 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:16:27.353 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T18:16:27.361 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:16:27.361 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:16:27.378 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:27.373+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:27.379 INFO:teuthology.orchestra.run.smithi087.stderr:nodeep-scrub is set 2024-09-17T18:16:27.383 INFO:tasks.rados.rados.0.smithi154.stdout:385: done (3 left) 2024-09-17T18:16:27.383 INFO:tasks.rados.rados.0.smithi154.stdout:386: done (2 left) 2024-09-17T18:16:27.383 INFO:tasks.rados.rados.0.smithi154.stdout:387: done (1 left) 2024-09-17T18:16:27.383 INFO:tasks.rados.rados.0.smithi154.stdout:389: done (0 left) 2024-09-17T18:16:27.383 INFO:tasks.rados.rados.0.smithi154.stdout:390: setattr oid 1 current snap is 34 2024-09-17T18:16:27.384 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:16:27.385 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:16:27.386 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 7 current snap is 34 2024-09-17T18:16:27.386 INFO:tasks.rados.rados.0.smithi154.stdout:391: seq_num 155 ranges {4997120=212992} 2024-09-17T18:16:27.415 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:16:27.415 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:16:27.422 INFO:tasks.rados.rados.0.smithi154.stdout:391: writing smithi15432074-7 from 4997120 to 5210112 tid 1 2024-09-17T18:16:27.422 INFO:tasks.rados.rados.0.smithi154.stdout:392: snap_remove snap 30 2024-09-17T18:16:27.439 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:16:27.439 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:16:27.456 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:16:27.457 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:16:27.479 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:27.477+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:27.506 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:27.506 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:27.520 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T18:16:27.580 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:27.576+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:27.641 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:27.641 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:27.655 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T18:16:27.700 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:27.696+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:27.782 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:27.777+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:27.819 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:27.820 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:27.835 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T18:16:27.884 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:16:27.881+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:16:27.957 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:27.957 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:27.971 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T18:16:27.984 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:27.981+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:28.085 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:28.081+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:28.094 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:28.095 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:28.109 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T18:16:28.186 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:28.181+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:28.225 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:28.225 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:28.239 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T18:16:28.287 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:28.281+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:28.326 INFO:tasks.rados.rados.0.smithi154.stdout:392: done (2 left) 2024-09-17T18:16:28.326 INFO:tasks.rados.rados.0.smithi154.stdout:393: snap_create 2024-09-17T18:16:28.326 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 1 v 126 (ObjNum 153 snap 33 seq_num 153) dirty exists 2024-09-17T18:16:28.326 INFO:tasks.rados.rados.0.smithi154.stdout:391: finishing write tid 1 to smithi15432074-7 2024-09-17T18:16:28.326 INFO:tasks.rados.rados.0.smithi154.stdout:391: finishing write tid 2 to smithi15432074-7 2024-09-17T18:16:28.326 INFO:tasks.rados.rados.0.smithi154.stdout:391: finishing write tid 3 to smithi15432074-7 2024-09-17T18:16:28.326 INFO:tasks.rados.rados.0.smithi154.stdout:391: oid 7 updating version 0 to 194 2024-09-17T18:16:28.327 INFO:tasks.rados.rados.0.smithi154.stdout:391: oid 7 updating version 194 to 195 2024-09-17T18:16:28.327 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 7 v 195 (ObjNum 155 snap 34 seq_num 155) dirty exists 2024-09-17T18:16:28.327 INFO:tasks.rados.rados.0.smithi154.stdout:391: left oid 7 (ObjNum 155 snap 34 seq_num 155) 2024-09-17T18:16:28.374 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:28.375 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:28.392 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:28.389+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:28.393 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T18:16:28.493 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:28.489+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:28.511 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:28.511 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:28.525 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T18:16:28.595 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:28.589+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:28.652 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:28.652 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:28.668 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T18:16:28.696 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:28.693+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:28.796 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-17T18:16:28.793+0000 7f0206bb2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26366) UID: 0 2024-09-17T18:16:28.799 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:28.799 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:28.814 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T18:16:28.897 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:28.892+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:28.935 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:28.935 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:28.949 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T18:16:29.040 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:29.036+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:29.098 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:29.093+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:29.120 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:29.120 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:29.134 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T18:16:29.199 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:29.197+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:29.298 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:29.299 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:29.300 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:29.296+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:29.313 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T18:16:29.326 INFO:tasks.rados.rados.0.smithi154.stdout:390: done (2 left) 2024-09-17T18:16:29.326 INFO:tasks.rados.rados.0.smithi154.stdout:391: done (1 left) 2024-09-17T18:16:29.326 INFO:tasks.rados.rados.0.smithi154.stdout:393: done (0 left) 2024-09-17T18:16:29.326 INFO:tasks.rados.rados.0.smithi154.stdout:append oid 11 current snap is 35 2024-09-17T18:16:29.326 INFO:tasks.rados.rados.0.smithi154.stdout:394: seq_num 156 ranges {2211840=229376} 2024-09-17T18:16:29.351 INFO:tasks.rados.rados.0.smithi154.stdout:394: writing smithi15432074-11 from 2211840 to 2441216 tid 1 2024-09-17T18:16:29.351 INFO:tasks.rados.rados.0.smithi154.stdout:395: read oid 34 snap -1 2024-09-17T18:16:29.351 INFO:tasks.rados.rados.0.smithi154.stdout:395: expect deleted 2024-09-17T18:16:29.351 INFO:tasks.rados.rados.0.smithi154.stdout:396: read oid 47 snap -1 2024-09-17T18:16:29.351 INFO:tasks.rados.rados.0.smithi154.stdout:396: expect (ObjNum 145 snap 30 seq_num 145) 2024-09-17T18:16:29.351 INFO:tasks.rados.rados.0.smithi154.stdout:397: read oid 14 snap 29 2024-09-17T18:16:29.351 INFO:tasks.rados.rados.0.smithi154.stdout:397: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-17T18:16:29.351 INFO:tasks.rados.rados.0.smithi154.stdout:398: setattr oid 2 current snap is 35 2024-09-17T18:16:29.353 INFO:tasks.rados.rados.0.smithi154.stdout:395: done (4 left) 2024-09-17T18:16:29.353 INFO:tasks.rados.rados.0.smithi154.stdout:399: snap_remove snap 34 2024-09-17T18:16:29.401 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:29.397+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:29.408 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T18:16:29.448 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:29.448 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:29.462 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T18:16:29.474 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T18:16:29.502 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T18:16:29.497+0000 7f93ce238640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26363) UID: 0 2024-09-17T18:16:29.603 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:29.600+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:29.625 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:29.626 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:29.626 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:16:29.626 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:16:29.639 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T18:16:29.647 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:16:29.647 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:16:29.668 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:16:29.669 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:16:29.689 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:16:29.690 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:16:29.704 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:29.700+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:29.706 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:16:29.706 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:16:29.725 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:16:29.725 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:16:29.746 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:16:29.747 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 75/31 ECSubWrite(tid=245, reqid=client.4565.0:761, at_version=75'123, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.337231+0000", 2024-09-17T18:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.420171279000002, 2024-09-17T18:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020931967999999999, 2024-09-17T18:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337231+0000", 2024-09-17T18:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337231+0000", 2024-09-17T18:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337233+0000", 2024-09-17T18:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1670000000000002e-06 2024-09-17T18:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337289+0000", 2024-09-17T18:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5639e-05 2024-09-17T18:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337328+0000", 2024-09-17T18:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8955000000000002e-05 2024-09-17T18:16:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337353+0000", 2024-09-17T18:16:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5100999999999999e-05 2024-09-17T18:16:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337531+0000", 2024-09-17T18:16:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000177694 2024-09-17T18:16:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337560+0000", 2024-09-17T18:16:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9482e-05 2024-09-17T18:16:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.358060+0000", 2024-09-17T18:16:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020499864 2024-09-17T18:16:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.358163+0000", 2024-09-17T18:16:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010306600000000001 2024-09-17T18:16:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 75/31 ECSubWrite(tid=247, reqid=client.4565.0:762, at_version=75'124, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.337404+0000", 2024-09-17T18:16:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.419998667000002, 2024-09-17T18:16:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026944722000000001, 2024-09-17T18:16:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337404+0000", 2024-09-17T18:16:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337404+0000", 2024-09-17T18:16:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337405+0000", 2024-09-17T18:16:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1999999999999999e-06 2024-09-17T18:16:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337488+0000", 2024-09-17T18:16:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3294000000000006e-05 2024-09-17T18:16:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337517+0000", 2024-09-17T18:16:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8761000000000001e-05 2024-09-17T18:16:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337540+0000", 2024-09-17T18:16:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3538999999999999e-05 2024-09-17T18:16:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.340275+0000", 2024-09-17T18:16:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002734429 2024-09-17T18:16:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.340294+0000", 2024-09-17T18:16:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9286000000000001e-05 2024-09-17T18:16:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364261+0000", 2024-09-17T18:16:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023966794999999999 2024-09-17T18:16:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364348+0000", 2024-09-17T18:16:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7417999999999995e-05 2024-09-17T18:16:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 75/31 ECSubWrite(tid=248, reqid=client.4565.0:763, at_version=75'125, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.337574+0000", 2024-09-17T18:16:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.419828676000002, 2024-09-17T18:16:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026838753, 2024-09-17T18:16:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337574+0000", 2024-09-17T18:16:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337574+0000", 2024-09-17T18:16:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337575+0000", 2024-09-17T18:16:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0270000000000001e-06 2024-09-17T18:16:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337618+0000", 2024-09-17T18:16:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3059999999999998e-05 2024-09-17T18:16:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337639+0000", 2024-09-17T18:16:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1426000000000001e-05 2024-09-17T18:16:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.337657+0000", 2024-09-17T18:16:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7812000000000002e-05 2024-09-17T18:16:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.351067+0000", 2024-09-17T18:16:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013410131 2024-09-17T18:16:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.351093+0000", 2024-09-17T18:16:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6404999999999999e-05 2024-09-17T18:16:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364357+0000", 2024-09-17T18:16:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013263079000000001 2024-09-17T18:16:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364412+0000", 2024-09-17T18:16:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5813000000000002e-05 2024-09-17T18:16:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 75/31 ECSubWrite(tid=180, reqid=osd.6.0:180, at_version=75'64, trim_to=0'0, roll_forward_to=73'60))", 2024-09-17T18:16:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.338219+0000", 2024-09-17T18:16:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.419183341, 2024-09-17T18:16:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025663440999999999, 2024-09-17T18:16:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.338219+0000", 2024-09-17T18:16:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.338219+0000", 2024-09-17T18:16:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.338220+0000", 2024-09-17T18:16:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9999999999999995e-07 2024-09-17T18:16:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.338260+0000", 2024-09-17T18:16:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0377999999999999e-05 2024-09-17T18:16:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.338282+0000", 2024-09-17T18:16:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1661000000000001e-05 2024-09-17T18:16:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.338299+0000", 2024-09-17T18:16:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6895999999999999e-05 2024-09-17T18:16:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.340926+0000", 2024-09-17T18:16:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026275169999999998 2024-09-17T18:16:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.340963+0000", 2024-09-17T18:16:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6284e-05 2024-09-17T18:16:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.363741+0000", 2024-09-17T18:16:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022777954999999999 2024-09-17T18:16:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.363882+0000", 2024-09-17T18:16:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014175 2024-09-17T18:16:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 75/31 ECSubWrite(tid=519, reqid=osd.13.0:519, at_version=75'170, trim_to=0'0, roll_forward_to=73'168))", 2024-09-17T18:16:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.339069+0000", 2024-09-17T18:16:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.418332920000001, 2024-09-17T18:16:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024986121, 2024-09-17T18:16:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339069+0000", 2024-09-17T18:16:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339069+0000", 2024-09-17T18:16:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339070+0000", 2024-09-17T18:16:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1999999999999999e-07 2024-09-17T18:16:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339120+0000", 2024-09-17T18:16:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0197000000000001e-05 2024-09-17T18:16:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339150+0000", 2024-09-17T18:16:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9873999999999999e-05 2024-09-17T18:16:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339185+0000", 2024-09-17T18:16:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4578e-05 2024-09-17T18:16:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339350+0000", 2024-09-17T18:16:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016585800000000001 2024-09-17T18:16:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.339376+0000", 2024-09-17T18:16:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5655000000000001e-05 2024-09-17T18:16:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.363994+0000", 2024-09-17T18:16:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024617587999999999 2024-09-17T18:16:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364055+0000", 2024-09-17T18:16:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1750999999999999e-05 2024-09-17T18:16:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 75/31 ECSubWrite(tid=249, reqid=client.4565.0:764, at_version=75'126, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.340585+0000", 2024-09-17T18:16:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.416817082000001, 2024-09-17T18:16:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023897931000000001, 2024-09-17T18:16:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.340585+0000", 2024-09-17T18:16:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.340585+0000", 2024-09-17T18:16:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.340587+0000", 2024-09-17T18:16:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.029e-06 2024-09-17T18:16:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341053+0000", 2024-09-17T18:16:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046546199999999998 2024-09-17T18:16:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341164+0000", 2024-09-17T18:16:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011100200000000001 2024-09-17T18:16:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341188+0000", 2024-09-17T18:16:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4125e-05 2024-09-17T18:16:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.351772+0000", 2024-09-17T18:16:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010583785 2024-09-17T18:16:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.351801+0000", 2024-09-17T18:16:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9348000000000001e-05 2024-09-17T18:16:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364418+0000", 2024-09-17T18:16:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012616571 2024-09-17T18:16:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364483+0000", 2024-09-17T18:16:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5609000000000002e-05 2024-09-17T18:16:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s3 75/31 ECSubWrite(tid=54, reqid=osd.14.0:54, at_version=75'48, trim_to=0'0, roll_forward_to=73'46))", 2024-09-17T18:16:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.341346+0000", 2024-09-17T18:16:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.416056506, 2024-09-17T18:16:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022638376000000002, 2024-09-17T18:16:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341346+0000", 2024-09-17T18:16:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341346+0000", 2024-09-17T18:16:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341346+0000", 2024-09-17T18:16:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4700000000000001e-07 2024-09-17T18:16:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341411+0000", 2024-09-17T18:16:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4498999999999994e-05 2024-09-17T18:16:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341437+0000", 2024-09-17T18:16:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6095e-05 2024-09-17T18:16:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341469+0000", 2024-09-17T18:16:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1918000000000002e-05 2024-09-17T18:16:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341608+0000", 2024-09-17T18:16:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013927000000000001 2024-09-17T18:16:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.341635+0000", 2024-09-17T18:16:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6308e-05 2024-09-17T18:16:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.363901+0000", 2024-09-17T18:16:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022266411 2024-09-17T18:16:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.363984+0000", 2024-09-17T18:16:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3227999999999997e-05 2024-09-17T18:16:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 75/31 ECSubWrite(tid=520, reqid=osd.13.0:520, at_version=75'267, trim_to=0'0, roll_forward_to=73'265))", 2024-09-17T18:16:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.343521+0000", 2024-09-17T18:16:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.413881409999998, 2024-09-17T18:16:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020513732, 2024-09-17T18:16:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343521+0000", 2024-09-17T18:16:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343521+0000", 2024-09-17T18:16:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343524+0000", 2024-09-17T18:16:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7690000000000001e-06 2024-09-17T18:16:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343579+0000", 2024-09-17T18:16:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5677000000000002e-05 2024-09-17T18:16:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343614+0000", 2024-09-17T18:16:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4539999999999998e-05 2024-09-17T18:16:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343639+0000", 2024-09-17T18:16:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4969000000000001e-05 2024-09-17T18:16:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343852+0000", 2024-09-17T18:16:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000213258 2024-09-17T18:16:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343880+0000", 2024-09-17T18:16:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7484999999999999e-05 2024-09-17T18:16:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.363937+0000", 2024-09-17T18:16:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020057760000000001 2024-09-17T18:16:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364035+0000", 2024-09-17T18:16:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7274000000000004e-05 2024-09-17T18:16:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 75/31 ECSubWrite(tid=250, reqid=client.4565.0:765, at_version=75'127, trim_to=0'0, roll_forward_to=75'121))", 2024-09-17T18:16:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:10.343833+0000", 2024-09-17T18:16:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.413569381999999, 2024-09-17T18:16:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020738876999999999, 2024-09-17T18:16:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343833+0000", 2024-09-17T18:16:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343833+0000", 2024-09-17T18:16:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.343841+0000", 2024-09-17T18:16:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3489999999999992e-06 2024-09-17T18:16:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.344201+0000", 2024-09-17T18:16:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00035977200000000001 2024-09-17T18:16:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.344239+0000", 2024-09-17T18:16:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7963999999999998e-05 2024-09-17T18:16:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.344259+0000", 2024-09-17T18:16:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0482000000000001e-05 2024-09-17T18:16:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.353501+0000", 2024-09-17T18:16:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092414249999999993 2024-09-17T18:16:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.353526+0000", 2024-09-17T18:16:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5182e-05 2024-09-17T18:16:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364512+0000", 2024-09-17T18:16:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010986278 2024-09-17T18:16:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:10.364572+0000", 2024-09-17T18:16:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9425000000000001e-05 2024-09-17T18:16:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(osd.10.22:1 3.ds1 3:bae030be:::smithi15432074-12:head [assert-version v82,copy-get max 8388608] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e80)", 2024-09-17T18:16:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.493174+0000", 2024-09-17T18:16:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.264228421, 2024-09-17T18:16:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.471630424, 2024-09-17T18:16:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493174+0000", 2024-09-17T18:16:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493174+0000", 2024-09-17T18:16:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493178+0000", 2024-09-17T18:16:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2270000000000004e-06 2024-09-17T18:16:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493195+0000", 2024-09-17T18:16:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6769000000000002e-05 2024-09-17T18:16:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493244+0000", 2024-09-17T18:16:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8900000000000003e-05 2024-09-17T18:16:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493269+0000", 2024-09-17T18:16:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4936e-05 2024-09-17T18:16:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493462+0000", 2024-09-17T18:16:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019376500000000001 2024-09-17T18:16:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.493485+0000", 2024-09-17T18:16:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2078000000000001e-05 2024-09-17T18:16:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.501833+0000", 2024-09-17T18:16:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083483529999999993 2024-09-17T18:16:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-17T18:16:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.501838+0000", 2024-09-17T18:16:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.293e-06 2024-09-17T18:16:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.938624+0000", 2024-09-17T18:16:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4367860379999999 2024-09-17T18:16:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.939089+0000", 2024-09-17T18:16:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046498500000000001 2024-09-17T18:16:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.964804+0000", 2024-09-17T18:16:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025715080000000001 2024-09-17T18:16:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:866 3.ds1 3:b4393ba6:::smithi15432074-18:head [read 0~2179072,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-17T18:16:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.501981+0000", 2024-09-17T18:16:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.255421392000001, 2024-09-17T18:16:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4713632839999999, 2024-09-17T18:16:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 866 2024-09-17T18:16:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.501981+0000", 2024-09-17T18:16:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.501981+0000", 2024-09-17T18:16:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.501984+0000", 2024-09-17T18:16:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4460000000000001e-06 2024-09-17T18:16:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.501998+0000", 2024-09-17T18:16:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4015999999999999e-05 2024-09-17T18:16:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502031+0000", 2024-09-17T18:16:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2721000000000001e-05 2024-09-17T18:16:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502053+0000", 2024-09-17T18:16:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1948999999999999e-05 2024-09-17T18:16:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502310+0000", 2024-09-17T18:16:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025703100000000001 2024-09-17T18:16:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-17T18:16:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502315+0000", 2024-09-17T18:16:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7500000000000003e-06 2024-09-17T18:16:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.947111+0000", 2024-09-17T18:16:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.444795864 2024-09-17T18:16:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.947940+0000", 2024-09-17T18:16:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00082896499999999998 2024-09-17T18:16:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.973344+0000", 2024-09-17T18:16:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025404541999999999 2024-09-17T18:16:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:867 3.ds1 3:b4393ba6:::smithi15432074-18:head [read 1912030~267042,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-17T18:16:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.502112+0000", 2024-09-17T18:16:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.255289994, 2024-09-17T18:16:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4743501290000001, 2024-09-17T18:16:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 867 2024-09-17T18:16:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502112+0000", 2024-09-17T18:16:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502112+0000", 2024-09-17T18:16:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502114+0000", 2024-09-17T18:16:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.66e-06 2024-09-17T18:16:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502124+0000", 2024-09-17T18:16:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5629999999999998e-06 2024-09-17T18:16:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502145+0000", 2024-09-17T18:16:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1671999999999999e-05 2024-09-17T18:16:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502162+0000", 2024-09-17T18:16:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7246000000000001e-05 2024-09-17T18:16:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503001+0000", 2024-09-17T18:16:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00083880900000000004 2024-09-17T18:16:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-17T18:16:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503006+0000", 2024-09-17T18:16:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-09-17T18:16:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.948752+0000", 2024-09-17T18:16:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.44574552 2024-09-17T18:16:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.949259+0000", 2024-09-17T18:16:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00050740699999999998 2024-09-17T18:16:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.976462+0000", 2024-09-17T18:16:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027203409000000001 2024-09-17T18:16:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:868 3.ds1 3:b4393ba6:::smithi15432074-18:head [read 0~2179072,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e80)", 2024-09-17T18:16:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.502486+0000", 2024-09-17T18:16:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.254915802999999, 2024-09-17T18:16:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4835850749999999, 2024-09-17T18:16:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 868 2024-09-17T18:16:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502486+0000", 2024-09-17T18:16:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502486+0000", 2024-09-17T18:16:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502488+0000", 2024-09-17T18:16:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9199999999999998e-06 2024-09-17T18:16:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502501+0000", 2024-09-17T18:16:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2519e-05 2024-09-17T18:16:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502565+0000", 2024-09-17T18:16:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4425999999999996e-05 2024-09-17T18:16:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.502597+0000", 2024-09-17T18:16:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1782000000000002e-05 2024-09-17T18:16:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503086+0000", 2024-09-17T18:16:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048855299999999997 2024-09-17T18:16:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-17T18:16:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503088+0000", 2024-09-17T18:16:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.21e-06 2024-09-17T18:16:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.976787+0000", 2024-09-17T18:16:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.473699176 2024-09-17T18:16:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.977128+0000", 2024-09-17T18:16:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034063700000000003 2024-09-17T18:16:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.986072+0000", 2024-09-17T18:16:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0089438520000000004 2024-09-17T18:16:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.ds1 81/80 ECSubReadReply(tid=1, attrs_read=0))", 2024-09-17T18:16:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:16.952759+0000", 2024-09-17T18:16:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.804643370000001, 2024-09-17T18:16:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020700592, 2024-09-17T18:16:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.952759+0000", 2024-09-17T18:16:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.952759+0000", 2024-09-17T18:16:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.952760+0000", 2024-09-17T18:16:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7699999999999992e-07 2024-09-17T18:16:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953686+0000", 2024-09-17T18:16:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092626899999999996 2024-09-17T18:16:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953706+0000", 2024-09-17T18:16:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0086e-05 2024-09-17T18:16:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953717+0000", 2024-09-17T18:16:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1141999999999999e-05 2024-09-17T18:16:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.966031+0000", 2024-09-17T18:16:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012313774 2024-09-17T18:16:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.973459+0000", 2024-09-17T18:16:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074283439999999999 2024-09-17T18:16:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.ds1 81/80 ECSubReadReply(tid=2, attrs_read=0))", 2024-09-17T18:16:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:16.953720+0000", 2024-09-17T18:16:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.803682245999999, 2024-09-17T18:16:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020043406, 2024-09-17T18:16:29.833 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953720+0000", 2024-09-17T18:16:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953720+0000", 2024-09-17T18:16:29.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953720+0000", 2024-09-17T18:16:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953720+0000", 2024-09-17T18:16:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953754+0000", 2024-09-17T18:16:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4085000000000003e-05 2024-09-17T18:16:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953769+0000", 2024-09-17T18:16:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4455e-05 2024-09-17T18:16:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.973593+0000", 2024-09-17T18:16:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019824636 2024-09-17T18:16:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.973763+0000", 2024-09-17T18:16:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017023 2024-09-17T18:16:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.ds1 81/80 ECSubReadReply(tid=2, attrs_read=0))", 2024-09-17T18:16:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:16.953751+0000", 2024-09-17T18:16:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.803651575, 2024-09-17T18:16:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020219452999999998, 2024-09-17T18:16:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953751+0000", 2024-09-17T18:16:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953751+0000", 2024-09-17T18:16:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953751+0000", 2024-09-17T18:16:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8400000000000003e-07 2024-09-17T18:16:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953857+0000", 2024-09-17T18:16:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010503 2024-09-17T18:16:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953872+0000", 2024-09-17T18:16:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5373e-05 2024-09-17T18:16:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953881+0000", 2024-09-17T18:16:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4290000000000007e-06 2024-09-17T18:16:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.973870+0000", 2024-09-17T18:16:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019988922999999999 2024-09-17T18:16:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.973970+0000", 2024-09-17T18:16:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9914000000000006e-05 2024-09-17T18:16:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.ds1 81/80 ECSubReadReply(tid=2, attrs_read=0))", 2024-09-17T18:16:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:16.953945+0000", 2024-09-17T18:16:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.803457528999999, 2024-09-17T18:16:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022557495, 2024-09-17T18:16:29.841 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953945+0000", 2024-09-17T18:16:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953945+0000", 2024-09-17T18:16:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953946+0000", 2024-09-17T18:16:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8700000000000005e-07 2024-09-17T18:16:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953986+0000", 2024-09-17T18:16:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0154000000000002e-05 2024-09-17T18:16:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.953997+0000", 2024-09-17T18:16:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1789e-05 2024-09-17T18:16:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.954005+0000", 2024-09-17T18:16:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3529999999999997e-06 2024-09-17T18:16:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.974053+0000", 2024-09-17T18:16:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020048076000000001 2024-09-17T18:16:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.976502+0000", 2024-09-17T18:16:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024493359999999999 2024-09-17T18:16:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 86/82 ECSubWrite(tid=136, reqid=client.4565.0:937, at_version=86'367, trim_to=0'0, roll_forward_to=85'361))", 2024-09-17T18:16:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.379743+0000", 2024-09-17T18:16:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.3776589280000007, 2024-09-17T18:16:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027154621, 2024-09-17T18:16:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.845 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379743+0000", 2024-09-17T18:16:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379743+0000", 2024-09-17T18:16:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379744+0000", 2024-09-17T18:16:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.04e-06 2024-09-17T18:16:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379795+0000", 2024-09-17T18:16:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0274e-05 2024-09-17T18:16:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379817+0000", 2024-09-17T18:16:29.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2181999999999999e-05 2024-09-17T18:16:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379917+0000", 2024-09-17T18:16:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9938000000000004e-05 2024-09-17T18:16:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.390590+0000", 2024-09-17T18:16:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010672849999999999 2024-09-17T18:16:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.390610+0000", 2024-09-17T18:16:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0652000000000001e-05 2024-09-17T18:16:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.406832+0000", 2024-09-17T18:16:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016221348999999999 2024-09-17T18:16:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.406898+0000", 2024-09-17T18:16:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6335999999999996e-05 2024-09-17T18:16:29.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 86/82 ECSubWrite(tid=137, reqid=client.4565.0:938, at_version=86'368, trim_to=0'0, roll_forward_to=85'361))", 2024-09-17T18:16:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.379952+0000", 2024-09-17T18:16:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.3774505319999992, 2024-09-17T18:16:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028793836, 2024-09-17T18:16:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379952+0000", 2024-09-17T18:16:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379952+0000", 2024-09-17T18:16:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379953+0000", 2024-09-17T18:16:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.083e-06 2024-09-17T18:16:29.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379991+0000", 2024-09-17T18:16:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8321999999999997e-05 2024-09-17T18:16:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380014+0000", 2024-09-17T18:16:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3224999999999999e-05 2024-09-17T18:16:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380032+0000", 2024-09-17T18:16:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7753000000000001e-05 2024-09-17T18:16:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.395808+0000", 2024-09-17T18:16:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015776199000000001 2024-09-17T18:16:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.395828+0000", 2024-09-17T18:16:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-09-17T18:16:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.408687+0000", 2024-09-17T18:16:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012858824 2024-09-17T18:16:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.408746+0000", 2024-09-17T18:16:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8876999999999999e-05 2024-09-17T18:16:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 86/82 ECSubWrite(tid=138, reqid=client.4565.0:939, at_version=86'369, trim_to=0'0, roll_forward_to=85'361))", 2024-09-17T18:16:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.380062+0000", 2024-09-17T18:16:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.3773405879999991, 2024-09-17T18:16:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028735995, 2024-09-17T18:16:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380062+0000", 2024-09-17T18:16:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380062+0000", 2024-09-17T18:16:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380063+0000", 2024-09-17T18:16:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.540000000000001e-07 2024-09-17T18:16:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:29.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380105+0000", 2024-09-17T18:16:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2304e-05 2024-09-17T18:16:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380125+0000", 2024-09-17T18:16:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0075999999999999e-05 2024-09-17T18:16:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.380142+0000", 2024-09-17T18:16:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7286e-05 2024-09-17T18:16:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.398645+0000", 2024-09-17T18:16:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018502304000000001 2024-09-17T18:16:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.398684+0000", 2024-09-17T18:16:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8906000000000003e-05 2024-09-17T18:16:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.408754+0000", 2024-09-17T18:16:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01007043 2024-09-17T18:16:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:29.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.408798+0000", 2024-09-17T18:16:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3735000000000001e-05 2024-09-17T18:16:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:29.859 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:29.859 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:29.860 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:16:29.861 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:16:29.861 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:16:29.862 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:16:29.862 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T18:16:29.862 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:16:29.863 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:16:29.863 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:16:29.863 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:16:29.863 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:16:29.864 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:16:29.864 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:29.857+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:29.867 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:16:29.868 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:16:29.887 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:16:29.888 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:16:29.909 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:16:29.909 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:16:29.930 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:16:29.931 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:16:29.991 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:16:29.991 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:29.992 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-17T18:16:29.988+0000 7fb813fd4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26449) UID: 0 2024-09-17T18:16:30.006 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T18:16:30.062 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:30.057+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:30.122 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:30.123 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:30.123 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:16:30.123 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:16:30.123 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:30.137 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T18:16:30.184 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:30.181+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:361 3.cs0 3:38dc802b:::smithi15432074-44:head [copy-from ver 19] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764426+0000", 2024-09-17T18:16:30.258 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.489550162999997, 2024-09-17T18:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059937576999999999, 2024-09-17T18:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 361 2024-09-17T18:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764426+0000", 2024-09-17T18:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764426+0000", 2024-09-17T18:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764430+0000", 2024-09-17T18:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1930000000000003e-06 2024-09-17T18:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764447+0000", 2024-09-17T18:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6461999999999999e-05 2024-09-17T18:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764481+0000", 2024-09-17T18:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3905999999999997e-05 2024-09-17T18:16:30.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764498+0000", 2024-09-17T18:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7102e-05 2024-09-17T18:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764652+0000", 2024-09-17T18:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015383000000000001 2024-09-17T18:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:30.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764670+0000", 2024-09-17T18:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7946000000000001e-05 2024-09-17T18:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.769352+0000", 2024-09-17T18:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046824400000000004 2024-09-17T18:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.769609+0000", 2024-09-17T18:16:30.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025651899999999997 2024-09-17T18:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.818303+0000", 2024-09-17T18:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048694505999999999 2024-09-17T18:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.823809+0000", 2024-09-17T18:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055063359999999997 2024-09-17T18:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.824248+0000", 2024-09-17T18:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043867 2024-09-17T18:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.824364+0000", 2024-09-17T18:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115667 2024-09-17T18:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:362 3.cs0 3:38dc802b:::smithi15432074-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764538+0000", 2024-09-17T18:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.489438368000002, 2024-09-17T18:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058448629000000002, 2024-09-17T18:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:30.266 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 362 2024-09-17T18:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764538+0000", 2024-09-17T18:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764538+0000", 2024-09-17T18:16:30.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764540+0000", 2024-09-17T18:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.556e-06 2024-09-17T18:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764548+0000", 2024-09-17T18:16:30.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1030000000000002e-06 2024-09-17T18:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764570+0000", 2024-09-17T18:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2093e-05 2024-09-17T18:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764587+0000", 2024-09-17T18:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7048999999999999e-05 2024-09-17T18:16:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764835+0000", 2024-09-17T18:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024845899999999997 2024-09-17T18:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764853+0000", 2024-09-17T18:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7452000000000002e-05 2024-09-17T18:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.771487+0000", 2024-09-17T18:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066343749999999996 2024-09-17T18:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-09-17T18:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.771582+0000", 2024-09-17T18:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5038999999999996e-05 2024-09-17T18:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.822681+0000", 2024-09-17T18:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.051098466000000002 2024-09-17T18:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.822841+0000", 2024-09-17T18:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016044 2024-09-17T18:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.822987+0000", 2024-09-17T18:16:30.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145597 2024-09-17T18:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:473 3.5s0 3:a2c8c783:::smithi15432074-23:head [setxattr _header (57) in=7b] snapc 10=[10,e,d,c,b,a,9,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.402167+0000", 2024-09-17T18:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.851809256000003, 2024-09-17T18:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017279360000000001, 2024-09-17T18:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.273 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 473 2024-09-17T18:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402167+0000", 2024-09-17T18:16:30.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402167+0000", 2024-09-17T18:16:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402169+0000", 2024-09-17T18:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.916e-06 2024-09-17T18:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402190+0000", 2024-09-17T18:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1223e-05 2024-09-17T18:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402216+0000", 2024-09-17T18:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5309000000000001e-05 2024-09-17T18:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402231+0000", 2024-09-17T18:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5509e-05 2024-09-17T18:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.410884+0000", 2024-09-17T18:16:30.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0086531990000000003 2024-09-17T18:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.411174+0000", 2024-09-17T18:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028940299999999998 2024-09-17T18:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.412548+0000", 2024-09-17T18:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001374754 2024-09-17T18:16:30.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.413961+0000", 2024-09-17T18:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014127390000000001 2024-09-17T18:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.419201+0000", 2024-09-17T18:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052399170000000002 2024-09-17T18:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.419446+0000", 2024-09-17T18:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024539100000000002 2024-09-17T18:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:474 3.5s0 3:a2c8c783:::smithi15432074-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e53)", 2024-09-17T18:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:48.402261+0000", 2024-09-17T18:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.851715570000003, 2024-09-17T18:16:30.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023005754, 2024-09-17T18:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 474 2024-09-17T18:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402261+0000", 2024-09-17T18:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402261+0000", 2024-09-17T18:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402262+0000", 2024-09-17T18:16:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4899999999999999e-06 2024-09-17T18:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402269+0000", 2024-09-17T18:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-17T18:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402292+0000", 2024-09-17T18:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3223000000000001e-05 2024-09-17T18:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.402307+0000", 2024-09-17T18:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4698999999999999e-05 2024-09-17T18:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.414926+0000", 2024-09-17T18:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012618704999999999 2024-09-17T18:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.415062+0000", 2024-09-17T18:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135962 2024-09-17T18:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.421765+0000", 2024-09-17T18:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006702871 2024-09-17T18:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.422025+0000", 2024-09-17T18:16:30.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026092800000000001 2024-09-17T18:16:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:48.425267+0000", 2024-09-17T18:16:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032411229999999998 2024-09-17T18:16:30.286 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:599 3.cs0 3:38dc802b:::smithi15432074-44:10 [read 0~1523712,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-09-17T18:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:01.316724+0000", 2024-09-17T18:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.937252087000001, 2024-09-17T18:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021213203, 2024-09-17T18:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.291 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 599 2024-09-17T18:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316724+0000", 2024-09-17T18:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316724+0000", 2024-09-17T18:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316728+0000", 2024-09-17T18:16:30.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5300000000000001e-06 2024-09-17T18:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316744+0000", 2024-09-17T18:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.645e-05 2024-09-17T18:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316786+0000", 2024-09-17T18:16:30.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1535999999999997e-05 2024-09-17T18:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316853+0000", 2024-09-17T18:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6973999999999999e-05 2024-09-17T18:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317003+0000", 2024-09-17T18:16:30.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015050600000000001 2024-09-17T18:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317027+0000", 2024-09-17T18:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3864000000000001e-05 2024-09-17T18:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.324538+0000", 2024-09-17T18:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075108040000000003 2024-09-17T18:16:30.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.324814+0000", 2024-09-17T18:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027571699999999998 2024-09-17T18:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.337937+0000", 2024-09-17T18:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013123822 2024-09-17T18:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:600 3.cs0 3:38dc802b:::smithi15432074-44:10 [read 0~1523712,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-09-17T18:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:01.316912+0000", 2024-09-17T18:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.937064204999999, 2024-09-17T18:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023099135999999999, 2024-09-17T18:16:30.298 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 600 2024-09-17T18:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316912+0000", 2024-09-17T18:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316912+0000", 2024-09-17T18:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316914+0000", 2024-09-17T18:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8169999999999999e-06 2024-09-17T18:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316927+0000", 2024-09-17T18:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3339000000000001e-05 2024-09-17T18:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316950+0000", 2024-09-17T18:16:30.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2220000000000001e-05 2024-09-17T18:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316965+0000", 2024-09-17T18:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5248999999999999e-05 2024-09-17T18:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317186+0000", 2024-09-17T18:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022110899999999999 2024-09-17T18:16:30.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317203+0000", 2024-09-17T18:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6979000000000001e-05 2024-09-17T18:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.325935+0000", 2024-09-17T18:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087319549999999996 2024-09-17T18:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.326231+0000", 2024-09-17T18:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000295846 2024-09-17T18:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.340011+0000", 2024-09-17T18:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013780621999999999 2024-09-17T18:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:601 3.cs0 3:38dc802b:::smithi15432074-44:10 [read 0~1523712,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-09-17T18:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:01.316998+0000", 2024-09-17T18:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.93697791, 2024-09-17T18:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024730305000000001, 2024-09-17T18:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 601 2024-09-17T18:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316998+0000", 2024-09-17T18:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.316998+0000", 2024-09-17T18:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317000+0000", 2024-09-17T18:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.42e-06 2024-09-17T18:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317007+0000", 2024-09-17T18:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0829999999999998e-06 2024-09-17T18:16:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317025+0000", 2024-09-17T18:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7796e-05 2024-09-17T18:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317038+0000", 2024-09-17T18:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3322999999999999e-05 2024-09-17T18:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317646+0000", 2024-09-17T18:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00060809199999999996 2024-09-17T18:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.317697+0000", 2024-09-17T18:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0478e-05 2024-09-17T18:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.327064+0000", 2024-09-17T18:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093677059999999999 2024-09-17T18:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.327616+0000", 2024-09-17T18:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055202599999999995 2024-09-17T18:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:01.341729+0000", 2024-09-17T18:16:30.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014112381 2024-09-17T18:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:789 3.cs0 3:391d6b13:::smithi15432074-45:head [read 0~2621440,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-17T18:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:11.383995+0000", 2024-09-17T18:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.869981855999999, 2024-09-17T18:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017170373999999999, 2024-09-17T18:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.311 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 789 2024-09-17T18:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.383995+0000", 2024-09-17T18:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.383995+0000", 2024-09-17T18:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.383996+0000", 2024-09-17T18:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5629999999999999e-06 2024-09-17T18:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.384005+0000", 2024-09-17T18:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5820000000000002e-06 2024-09-17T18:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.384026+0000", 2024-09-17T18:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1299000000000001e-05 2024-09-17T18:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.384042+0000", 2024-09-17T18:16:30.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5913000000000002e-05 2024-09-17T18:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.385735+0000", 2024-09-17T18:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00169294 2024-09-17T18:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.385959+0000", 2024-09-17T18:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022444500000000001 2024-09-17T18:16:30.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.401165+0000", 2024-09-17T18:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015205632 2024-09-17T18:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:790 3.cs0 3:391d6b13:::smithi15432074-45:head [read 1758211~863229,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-17T18:16:30.316 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:11.384093+0000", 2024-09-17T18:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.869883243, 2024-09-17T18:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018037331, 2024-09-17T18:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 790 2024-09-17T18:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.384093+0000", 2024-09-17T18:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.384093+0000", 2024-09-17T18:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.384095+0000", 2024-09-17T18:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-17T18:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.384103+0000", 2024-09-17T18:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4500000000000004e-06 2024-09-17T18:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.384123+0000", 2024-09-17T18:16:30.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9817999999999999e-05 2024-09-17T18:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.384138+0000", 2024-09-17T18:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5092000000000001e-05 2024-09-17T18:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.387727+0000", 2024-09-17T18:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003588651 2024-09-17T18:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.387970+0000", 2024-09-17T18:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024296100000000001 2024-09-17T18:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.402130+0000", 2024-09-17T18:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014160809 2024-09-17T18:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s6 80/31 ECSubWrite(tid=67, reqid=osd.10.0:67, at_version=80'53, trim_to=0'0, roll_forward_to=79'51))", 2024-09-17T18:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.494884+0000", 2024-09-17T18:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.759092553, 2024-09-17T18:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022391479999999998, 2024-09-17T18:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.494884+0000", 2024-09-17T18:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.494884+0000", 2024-09-17T18:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.494885+0000", 2024-09-17T18:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8299999999999996e-07 2024-09-17T18:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.494940+0000", 2024-09-17T18:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5787e-05 2024-09-17T18:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.494982+0000", 2024-09-17T18:16:30.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1919999999999998e-05 2024-09-17T18:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.495006+0000", 2024-09-17T18:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3768999999999999e-05 2024-09-17T18:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.495157+0000", 2024-09-17T18:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015092400000000001 2024-09-17T18:16:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.495173+0000", 2024-09-17T18:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5936000000000001e-05 2024-09-17T18:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.517108+0000", 2024-09-17T18:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021934987999999999 2024-09-17T18:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.517275+0000", 2024-09-17T18:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016747299999999999 2024-09-17T18:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s6 80/31 ECSubWrite(tid=68, reqid=osd.10.0:68, at_version=80'55, trim_to=0'0, roll_forward_to=79'51))", 2024-09-17T18:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.495787+0000", 2024-09-17T18:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.758189221, 2024-09-17T18:16:30.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027083552, 2024-09-17T18:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.495787+0000", 2024-09-17T18:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.495787+0000", 2024-09-17T18:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.495789+0000", 2024-09-17T18:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0930000000000001e-06 2024-09-17T18:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.495847+0000", 2024-09-17T18:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7985999999999997e-05 2024-09-17T18:16:30.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.495879+0000", 2024-09-17T18:16:30.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1415000000000003e-05 2024-09-17T18:16:30.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.495900+0000", 2024-09-17T18:16:30.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1654999999999998e-05 2024-09-17T18:16:30.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.508252+0000", 2024-09-17T18:16:30.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012351604 2024-09-17T18:16:30.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.508278+0000", 2024-09-17T18:16:30.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5687999999999999e-05 2024-09-17T18:16:30.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.522757+0000", 2024-09-17T18:16:30.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014479228 2024-09-17T18:16:30.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.522871+0000", 2024-09-17T18:16:30.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011388299999999999 2024-09-17T18:16:30.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.332 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.333 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 80/31 ECSubWrite(tid=179, reqid=osd.7.0:179, at_version=80'170, trim_to=0'0, roll_forward_to=79'168))", 2024-09-17T18:16:30.333 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.503473+0000", 2024-09-17T18:16:30.333 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.750503155000001, 2024-09-17T18:16:30.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019380813, 2024-09-17T18:16:30.333 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.333 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.333 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.333 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503473+0000", 2024-09-17T18:16:30.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503473+0000", 2024-09-17T18:16:30.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503474+0000", 2024-09-17T18:16:30.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6599999999999995e-07 2024-09-17T18:16:30.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503534+0000", 2024-09-17T18:16:30.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0350000000000003e-05 2024-09-17T18:16:30.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503566+0000", 2024-09-17T18:16:30.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2085000000000002e-05 2024-09-17T18:16:30.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503588+0000", 2024-09-17T18:16:30.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2065e-05 2024-09-17T18:16:30.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503873+0000", 2024-09-17T18:16:30.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028426299999999999 2024-09-17T18:16:30.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.503900+0000", 2024-09-17T18:16:30.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6792e-05 2024-09-17T18:16:30.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.522786+0000", 2024-09-17T18:16:30.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01888625 2024-09-17T18:16:30.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.522854+0000", 2024-09-17T18:16:30.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8242000000000002e-05 2024-09-17T18:16:30.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.338 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.338 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 80/31 ECSubWrite(tid=180, reqid=osd.7.0:180, at_version=80'172, trim_to=0'0, roll_forward_to=79'168))", 2024-09-17T18:16:30.338 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.512297+0000", 2024-09-17T18:16:30.338 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.741679394, 2024-09-17T18:16:30.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017071692999999999, 2024-09-17T18:16:30.338 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.338 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.338 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.339 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.512297+0000", 2024-09-17T18:16:30.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.512297+0000", 2024-09-17T18:16:30.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.512299+0000", 2024-09-17T18:16:30.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7430000000000001e-06 2024-09-17T18:16:30.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.512348+0000", 2024-09-17T18:16:30.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9044e-05 2024-09-17T18:16:30.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.512377+0000", 2024-09-17T18:16:30.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9285000000000002e-05 2024-09-17T18:16:30.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.512406+0000", 2024-09-17T18:16:30.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9400999999999999e-05 2024-09-17T18:16:30.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.513537+0000", 2024-09-17T18:16:30.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001130809 2024-09-17T18:16:30.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.513566+0000", 2024-09-17T18:16:30.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9017999999999999e-05 2024-09-17T18:16:30.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.529263+0000", 2024-09-17T18:16:30.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015696386999999999 2024-09-17T18:16:30.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.529369+0000", 2024-09-17T18:16:30.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106006 2024-09-17T18:16:30.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.343 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.343 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as3 80/31 ECSubWrite(tid=622, reqid=osd.13.0:622, at_version=80'218, trim_to=0'0, roll_forward_to=79'214))", 2024-09-17T18:16:30.343 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.512457+0000", 2024-09-17T18:16:30.344 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.741519597, 2024-09-17T18:16:30.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016759249, 2024-09-17T18:16:30.344 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.344 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.344 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.344 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.512457+0000", 2024-09-17T18:16:30.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.512457+0000", 2024-09-17T18:16:30.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.512458+0000", 2024-09-17T18:16:30.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7099999999999999e-06 2024-09-17T18:16:30.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.512508+0000", 2024-09-17T18:16:30.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9849999999999999e-05 2024-09-17T18:16:30.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.512535+0000", 2024-09-17T18:16:30.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6384999999999999e-05 2024-09-17T18:16:30.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.512556+0000", 2024-09-17T18:16:30.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0874999999999999e-05 2024-09-17T18:16:30.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.513593+0000", 2024-09-17T18:16:30.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001037704 2024-09-17T18:16:30.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.513617+0000", 2024-09-17T18:16:30.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4122e-05 2024-09-17T18:16:30.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.529144+0000", 2024-09-17T18:16:30.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015526633999999999 2024-09-17T18:16:30.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.529216+0000", 2024-09-17T18:16:30.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1969000000000002e-05 2024-09-17T18:16:30.348 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.348 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.349 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.349 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s4 80/31 ECSubWrite(tid=110, reqid=osd.0.0:110, at_version=80'98, trim_to=0'0, roll_forward_to=79'94))", 2024-09-17T18:16:30.349 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.516456+0000", 2024-09-17T18:16:30.349 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.737520237, 2024-09-17T18:16:30.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017957219999999999, 2024-09-17T18:16:30.349 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.349 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.349 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.349 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.516456+0000", 2024-09-17T18:16:30.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.516456+0000", 2024-09-17T18:16:30.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.516457+0000", 2024-09-17T18:16:30.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.13e-06 2024-09-17T18:16:30.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.516521+0000", 2024-09-17T18:16:30.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3572999999999996e-05 2024-09-17T18:16:30.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.516540+0000", 2024-09-17T18:16:30.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8805e-05 2024-09-17T18:16:30.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.516551+0000", 2024-09-17T18:16:30.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1446e-05 2024-09-17T18:16:30.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.519068+0000", 2024-09-17T18:16:30.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025169110000000001 2024-09-17T18:16:30.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.519092+0000", 2024-09-17T18:16:30.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4125e-05 2024-09-17T18:16:30.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.534311+0000", 2024-09-17T18:16:30.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015218736 2024-09-17T18:16:30.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.534413+0000", 2024-09-17T18:16:30.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102494 2024-09-17T18:16:30.354 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.354 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.354 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.354 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:924 3.cs0 3:3377584e:::smithi15432074-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e85)", 2024-09-17T18:16:30.354 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:20.477857+0000", 2024-09-17T18:16:30.354 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7761190120000006, 2024-09-17T18:16:30.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018806073, 2024-09-17T18:16:30.355 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.355 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.355 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:30.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:30.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:30.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:30.355 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 924 2024-09-17T18:16:30.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.355 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.477857+0000", 2024-09-17T18:16:30.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.477857+0000", 2024-09-17T18:16:30.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.477859+0000", 2024-09-17T18:16:30.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1299999999999999e-06 2024-09-17T18:16:30.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.477868+0000", 2024-09-17T18:16:30.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8030000000000003e-06 2024-09-17T18:16:30.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.477891+0000", 2024-09-17T18:16:30.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2762e-05 2024-09-17T18:16:30.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.477908+0000", 2024-09-17T18:16:30.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7309e-05 2024-09-17T18:16:30.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.486092+0000", 2024-09-17T18:16:30.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081837090000000008 2024-09-17T18:16:30.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:30.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.486302+0000", 2024-09-17T18:16:30.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020957500000000001 2024-09-17T18:16:30.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.493880+0000", 2024-09-17T18:16:30.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075778709999999999 2024-09-17T18:16:30.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:30.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.494105+0000", 2024-09-17T18:16:30.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022571399999999999 2024-09-17T18:16:30.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.496663+0000", 2024-09-17T18:16:30.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025582000000000001 2024-09-17T18:16:30.360 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.360 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.360 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.361 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:927 3.5s0 3:a2c8c783:::smithi15432074-23:head [append 0~0] snapc 1f=[1f,1e,1d,1c,18,16,15,11,8] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-09-17T18:16:30.361 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:20.478059+0000", 2024-09-17T18:16:30.361 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7759176189999994, 2024-09-17T18:16:30.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017966409999999999, 2024-09-17T18:16:30.361 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.361 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.361 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:30.361 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:30.361 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:30.361 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:30.361 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 927 2024-09-17T18:16:30.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.362 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.478059+0000", 2024-09-17T18:16:30.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.478059+0000", 2024-09-17T18:16:30.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.478060+0000", 2024-09-17T18:16:30.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.463e-06 2024-09-17T18:16:30.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.478068+0000", 2024-09-17T18:16:30.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5429999999999996e-06 2024-09-17T18:16:30.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.478086+0000", 2024-09-17T18:16:30.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8643000000000001e-05 2024-09-17T18:16:30.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.478102+0000", 2024-09-17T18:16:30.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892e-05 2024-09-17T18:16:30.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.490576+0000", 2024-09-17T18:16:30.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012473549 2024-09-17T18:16:30.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:30.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.490789+0000", 2024-09-17T18:16:30.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021358 2024-09-17T18:16:30.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.491841+0000", 2024-09-17T18:16:30.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001051909 2024-09-17T18:16:30.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.493902+0000", 2024-09-17T18:16:30.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020609030000000002 2024-09-17T18:16:30.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:30.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.495942+0000", 2024-09-17T18:16:30.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020397789999999998 2024-09-17T18:16:30.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.496025+0000", 2024-09-17T18:16:30.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3149e-05 2024-09-17T18:16:30.367 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.367 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.367 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.367 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:943 3.cs0 3:3377584e:::smithi15432074-19:1d [read 0~65536,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-17T18:16:30.367 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.354150+0000", 2024-09-17T18:16:30.367 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.8998259589999993, 2024-09-17T18:16:30.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017229343000000001, 2024-09-17T18:16:30.368 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.368 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.368 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:30.368 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:30.368 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:30.368 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:30.368 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 943 2024-09-17T18:16:30.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.368 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.354150+0000", 2024-09-17T18:16:30.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.354150+0000", 2024-09-17T18:16:30.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.354154+0000", 2024-09-17T18:16:30.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5329999999999999e-06 2024-09-17T18:16:30.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.354168+0000", 2024-09-17T18:16:30.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4396000000000001e-05 2024-09-17T18:16:30.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.354199+0000", 2024-09-17T18:16:30.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0868999999999999e-05 2024-09-17T18:16:30.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.354249+0000", 2024-09-17T18:16:30.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9663000000000002e-05 2024-09-17T18:16:30.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.354754+0000", 2024-09-17T18:16:30.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00050515499999999997 2024-09-17T18:16:30.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:30.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.355178+0000", 2024-09-17T18:16:30.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042362200000000002 2024-09-17T18:16:30.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.371380+0000", 2024-09-17T18:16:30.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016202105000000001 2024-09-17T18:16:30.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.372 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.373 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:944 3.cs0 3:3377584e:::smithi15432074-19:1d [read 0~65536,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-17T18:16:30.373 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.354312+0000", 2024-09-17T18:16:30.373 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.8996647170000003, 2024-09-17T18:16:30.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017916300999999999, 2024-09-17T18:16:30.373 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.373 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.373 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:30.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:30.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:30.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:30.373 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 944 2024-09-17T18:16:30.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.374 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.354312+0000", 2024-09-17T18:16:30.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.354312+0000", 2024-09-17T18:16:30.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.354314+0000", 2024-09-17T18:16:30.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.04e-06 2024-09-17T18:16:30.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.354325+0000", 2024-09-17T18:16:30.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1664999999999999e-05 2024-09-17T18:16:30.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.354348+0000", 2024-09-17T18:16:30.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3033000000000001e-05 2024-09-17T18:16:30.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.354370+0000", 2024-09-17T18:16:30.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1824999999999999e-05 2024-09-17T18:16:30.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.358858+0000", 2024-09-17T18:16:30.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044876869999999998 2024-09-17T18:16:30.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:30.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.359257+0000", 2024-09-17T18:16:30.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039908599999999999 2024-09-17T18:16:30.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.372228+0000", 2024-09-17T18:16:30.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012970964999999999 2024-09-17T18:16:30.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.378 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.379 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:945 3.cs0 3:3377584e:::smithi15432074-19:1d [read 31772~33764,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-17T18:16:30.379 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.355665+0000", 2024-09-17T18:16:30.379 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.898311863, 2024-09-17T18:16:30.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018507853000000001, 2024-09-17T18:16:30.379 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.379 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.379 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:30.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:30.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:30.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:30.379 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 945 2024-09-17T18:16:30.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.380 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.355665+0000", 2024-09-17T18:16:30.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.355665+0000", 2024-09-17T18:16:30.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.355667+0000", 2024-09-17T18:16:30.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.853e-06 2024-09-17T18:16:30.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.355681+0000", 2024-09-17T18:16:30.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3363000000000001e-05 2024-09-17T18:16:30.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.355708+0000", 2024-09-17T18:16:30.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7342e-05 2024-09-17T18:16:30.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.355728+0000", 2024-09-17T18:16:30.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9525999999999999e-05 2024-09-17T18:16:30.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.360421+0000", 2024-09-17T18:16:30.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046931990000000003 2024-09-17T18:16:30.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:30.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.360757+0000", 2024-09-17T18:16:30.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033649999999999999 2024-09-17T18:16:30.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.374172+0000", 2024-09-17T18:16:30.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013415069999999999 2024-09-17T18:16:30.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.384 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.384 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.384 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.384 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.384 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:30.387 INFO:teuthology.orchestra.run.smithi087.stderr:noscrub is unset 2024-09-17T18:16:30.387 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T18:16:30.388 INFO:tasks.ceph.osd.8.smithi087.stderr:2024-09-17T18:16:30.380+0000 7f3a5d531640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26451) UID: 0 2024-09-17T18:16:30.388 INFO:tasks.rados.rados.0.smithi154.stdout:399: done (4 left) 2024-09-17T18:16:30.388 INFO:tasks.rados.rados.0.smithi154.stdout: waiting on 4 2024-09-17T18:16:30.388 INFO:tasks.rados.rados.0.smithi154.stdout:394: finishing write tid 1 to smithi15432074-11 2024-09-17T18:16:30.388 INFO:tasks.rados.rados.0.smithi154.stdout:394: finishing write tid 2 to smithi15432074-11 2024-09-17T18:16:30.388 INFO:tasks.rados.rados.0.smithi154.stdout:394: finishing write tid 3 to smithi15432074-11 2024-09-17T18:16:30.389 INFO:tasks.rados.rados.0.smithi154.stdout:394: oid 11 updating version 0 to 268 2024-09-17T18:16:30.389 INFO:tasks.rados.rados.0.smithi154.stdout:394: oid 11 version 268 is already newer than 267 2024-09-17T18:16:30.389 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 11 v 268 (ObjNum 156 snap 35 seq_num 156) dirty exists 2024-09-17T18:16:30.389 INFO:tasks.rados.rados.0.smithi154.stdout:394: left oid 11 (ObjNum 156 snap 35 seq_num 156) 2024-09-17T18:16:30.389 INFO:tasks.rados.rados.0.smithi154.stdout:397: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-17T18:16:30.389 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:30.389 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:30.389 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 0 2024-09-17T18:16:30.389 INFO:tasks.rados.rados.0.smithi154.stdout:update_object_version oid 2 v 414 (ObjNum 92 snap 15 seq_num 92) dirty exists 2024-09-17T18:16:30.389 INFO:tasks.rados.rados.0.smithi154.stdout:394: done (3 left) 2024-09-17T18:16:30.390 INFO:tasks.rados.rados.0.smithi154.stdout:397: done (2 left) 2024-09-17T18:16:30.390 INFO:tasks.rados.rados.0.smithi154.stdout:398: done (1 left) 2024-09-17T18:16:30.390 INFO:tasks.rados.rados.0.smithi154.stdout: waiting on 1 2024-09-17T18:16:30.390 INFO:tasks.rados.rados.0.smithi154.stdout:396: expect (ObjNum 145 snap 30 seq_num 145) 2024-09-17T18:16:30.390 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 38730 2024-09-17T18:16:30.390 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 633186 2024-09-17T18:16:30.409 INFO:tasks.rados.rados.0.smithi154.stdout:seeking to 704823 2024-09-17T18:16:30.422 INFO:tasks.rados.rados.0.smithi154.stdout:396: done (0 left) 2024-09-17T18:16:30.425 INFO:tasks.rados.rados.0.smithi154.stderr:0 errors. 2024-09-17T18:16:30.425 INFO:tasks.rados.rados.0.smithi154.stderr: 2024-09-17T18:16:30.437 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T18:16:30.487 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:30.481+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:30.559 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:30.559 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:30.559 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:16:30.559 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:30.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T18:16:30.587 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:16:30.581+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:16:30.688 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:30.685+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:30.698 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:30.698 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:30.698 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:16:30.698 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:16:30.698 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:30.710 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T18:16:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:16:30.757 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":95,"fsid":"61bbf164-0ac7-4613-95ea-b1c3bf551ccb","created":"2024-09-17T18:14:58.620399+0000","modified":"2024-09-17T18:16:30.319413+0000","last_up_change":"2024-09-17T18:15:12.533086+0000","last_in_change":"2024-09-17T18:15:03.053866+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T18:15:11.543279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T18:15:13.520321+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2024-09-17T18:15:25.661590+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":3,"size":7,"min_size":5,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":36,"snap_epoch":95,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"shecprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":16384,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"15f80e97-3ed0-4557-b1f4-7ffa88c188dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6803","nonce":2391985960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6805","nonce":2391985960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6809","nonce":2391985960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6807","nonce":2391985960}]},"public_addr":"172.21.15.87:6803/2391985960","cluster_addr":"172.21.15.87:6805/2391985960","heartbeat_back_addr":"172.21.15.87:6809/2391985960","heartbeat_front_addr":"172.21.15.87:6807/2391985960","state":["exists","up"]},{"osd":1,"uuid":"a9b255d0-e8d9-4d9a-9118-742dc2ac013f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6817","nonce":692679878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6819","nonce":692679878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6823","nonce":692679878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6821","nonce":692679878}]},"public_addr":"172.21.15.134:6817/692679878","cluster_addr":"172.21.15.134:6819/692679878","heartbeat_back_addr":"172.21.15.134:6823/692679878","heartbeat_front_addr":"172.21.15.134:6821/692679878","state":["exists","up"]},{"osd":2,"uuid":"76ad6be0-c351-4265-893f-cec4a82ecd76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6825","nonce":197002546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6827","nonce":197002546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6831","nonce":197002546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6829","nonce":197002546}]},"public_addr":"172.21.15.146:6825/197002546","cluster_addr":"172.21.15.146:6827/197002546","heartbeat_back_addr":"172.21.15.146:6831/197002546","heartbeat_front_addr":"172.21.15.146:6829/197002546","state":["exists","up"]},{"osd":3,"uuid":"325d4c94-b21d-48cd-8f47-446e6a8bcbcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6817","nonce":450535216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6819","nonce":450535216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6823","nonce":450535216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6821","nonce":450535216}]},"public_addr":"172.21.15.154:6817/450535216","cluster_addr":"172.21.15.154:6819/450535216","heartbeat_back_addr":"172.21.15.154:6823/450535216","heartbeat_front_addr":"172.21.15.154:6821/450535216","state":["exists","up"]},{"osd":4,"uuid":"58b12ec9-29f5-4fea-a835-594fe03cd376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6827","nonce":1911207814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6829","nonce":1911207814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6833","nonce":1911207814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6831","nonce":1911207814}]},"public_addr":"172.21.15.87:6827/1911207814","cluster_addr":"172.21.15.87:6829/1911207814","heartbeat_back_addr":"172.21.15.87:6833/1911207814","heartbeat_front_addr":"172.21.15.87:6831/1911207814","state":["exists","up"]},{"osd":5,"uuid":"27d3075f-32f4-4032-b0d4-fb7604c8bfda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6825","nonce":391215769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6827","nonce":391215769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6831","nonce":391215769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6829","nonce":391215769}]},"public_addr":"172.21.15.134:6825/391215769","cluster_addr":"172.21.15.134:6827/391215769","heartbeat_back_addr":"172.21.15.134:6831/391215769","heartbeat_front_addr":"172.21.15.134:6829/391215769","state":["exists","up"]},{"osd":6,"uuid":"4326073e-338d-47f1-9860-5e44455f49ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6801","nonce":1495925642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6803","nonce":1495925642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6807","nonce":1495925642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6805","nonce":1495925642}]},"public_addr":"172.21.15.146:6801/1495925642","cluster_addr":"172.21.15.146:6803/1495925642","heartbeat_back_addr":"172.21.15.146:6807/1495925642","heartbeat_front_addr":"172.21.15.146:6805/1495925642","state":["exists","up"]},{"osd":7,"uuid":"455a2636-b754-4e1f-8933-16cd3fc126fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6809","nonce":3979156181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6811","nonce":3979156181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6815","nonce":3979156181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6813","nonce":3979156181}]},"public_addr":"172.21.15.154:6809/3979156181","cluster_addr":"172.21.15.154:6811/3979156181","heartbeat_back_addr":"172.21.15.154:6815/3979156181","heartbeat_front_addr":"172.21.15.154:6813/3979156181","state":["exists","up"]},{"osd":8,"uuid":"e64c05c6-2dce-4abc-8693-3e06b69723b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6819","nonce":740946583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6821","nonce":740946583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6825","nonce":740946583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6823","nonce":740946583}]},"public_addr":"172.21.15.87:6819/740946583","cluster_addr":"172.21.15.87:6821/740946583","heartbeat_back_addr":"172.21.15.87:6825/740946583","heartbeat_front_addr":"172.21.15.87:6823/740946583","state":["exists","up"]},{"osd":9,"uuid":"10bcf7b0-b22d-4a33-b090-b3c8083b6445","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6809","nonce":2811218890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6811","nonce":2811218890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6815","nonce":2811218890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6813","nonce":2811218890}]},"public_addr":"172.21.15.134:6809/2811218890","cluster_addr":"172.21.15.134:6811/2811218890","heartbeat_back_addr":"172.21.15.134:6815/2811218890","heartbeat_front_addr":"172.21.15.134:6813/2811218890","state":["exists","up"]},{"osd":10,"uuid":"a69d3d5e-353a-41aa-8b1c-fe7b0a68865f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6817","nonce":1660646458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6819","nonce":1660646458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6823","nonce":1660646458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6821","nonce":1660646458}]},"public_addr":"172.21.15.146:6817/1660646458","cluster_addr":"172.21.15.146:6819/1660646458","heartbeat_back_addr":"172.21.15.146:6823/1660646458","heartbeat_front_addr":"172.21.15.146:6821/1660646458","state":["exists","up"]},{"osd":11,"uuid":"0a0e715b-1804-4e14-87e1-8c5de231b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6801","nonce":2080834051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6803","nonce":2080834051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6807","nonce":2080834051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6805","nonce":2080834051}]},"public_addr":"172.21.15.154:6801/2080834051","cluster_addr":"172.21.15.154:6803/2080834051","heartbeat_back_addr":"172.21.15.154:6807/2080834051","heartbeat_front_addr":"172.21.15.154:6805/2080834051","state":["exists","up"]},{"osd":12,"uuid":"bdb1a692-4d6e-4a0c-a21f-db10b3af5025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6811","nonce":249183944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6813","nonce":249183944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6817","nonce":249183944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6815","nonce":249183944}]},"public_addr":"172.21.15.87:6811/249183944","cluster_addr":"172.21.15.87:6813/249183944","heartbeat_back_addr":"172.21.15.87:6817/249183944","heartbeat_front_addr":"172.21.15.87:6815/249183944","state":["exists","up"]},{"osd":13,"uuid":"225fb253-25c2-4a10-a169-97971cb06e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6801","nonce":3397465529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6803","nonce":3397465529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6807","nonce":3397465529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6805","nonce":3397465529}]},"public_addr":"172.21.15.134:6801/3397465529","cluster_addr":"172.21.15.134:6803/3397465529","heartbeat_back_addr":"172.21.15.134:6807/3397465529","heartbeat_front_addr":"172.21.15.134:6805/3397465529","state":["exists","up"]},{"osd":14,"uuid":"43d0e878-9725-4208-ab75-04407b592477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6809","nonce":950976813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6811","nonce":950976813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6815","nonce":950976813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6813","nonce":950976813}]},"public_addr":"172.21.15.146:6809/950976813","cluster_addr":"172.21.15.146:6811/950976813","heartbeat_back_addr":"172.21.15.146:6815/950976813","heartbeat_front_addr":"172.21.15.146:6813/950976813","state":["exists","up"]},{"osd":15,"uuid":"1c97e00d-ee0d-4bed-953c-c99a67afe33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6825","nonce":3670919160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6827","nonce":3670919160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6831","nonce":3670919160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6829","nonce":3670919160}]},"public_addr":"172.21.15.154:6825/3670919160","cluster_addr":"172.21.15.154:6827/3670919160","heartbeat_back_addr":"172.21.15.154:6831/3670919160","heartbeat_front_addr":"172.21.15.154:6829/3670919160","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.473183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:11.844633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:15.197431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:29.139808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:17.886509+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:17.377166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.773040+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:24.507253+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:23.502749+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.445477+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:11.740729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.296968+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.903544+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:15:09.548371+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:15.089100+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:28.822698+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.6","osds":[6,0,12,7,15,13,8]}],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":13,"to":10},{"from":11,"to":3},{"from":8,"to":12},{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":29,"length":2},{"begin":32,"length":1},{"begin":36,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":36,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T18:16:30.776 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:16:30.789 INFO:tasks.ceph.osd.11.smithi154.stderr:2024-09-17T18:16:30.789+0000 7f38e1955640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26605) UID: 0 2024-09-17T18:16:30.873 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:30.873 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:16:30.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:16:30.873 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:16:30.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.873 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 59/31 ECSubWrite(tid=341, reqid=client.4565.0:547, at_version=59'182, trim_to=0'0, roll_forward_to=58'180))", 2024-09-17T18:16:30.873 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:54.407175+0000", 2024-09-17T18:16:30.873 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.461722313000003, 2024-09-17T18:16:30.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012035451000000001, 2024-09-17T18:16:30.873 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.873 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.874 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.874 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.407175+0000", 2024-09-17T18:16:30.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.407175+0000", 2024-09-17T18:16:30.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.407176+0000", 2024-09-17T18:16:30.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4799999999999998e-07 2024-09-17T18:16:30.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.409218+0000", 2024-09-17T18:16:30.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020420830000000001 2024-09-17T18:16:30.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.409257+0000", 2024-09-17T18:16:30.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9007000000000001e-05 2024-09-17T18:16:30.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.409281+0000", 2024-09-17T18:16:30.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4536e-05 2024-09-17T18:16:30.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.409466+0000", 2024-09-17T18:16:30.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018473799999999999 2024-09-17T18:16:30.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.409492+0000", 2024-09-17T18:16:30.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6302e-05 2024-09-17T18:16:30.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.419122+0000", 2024-09-17T18:16:30.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096294169999999995 2024-09-17T18:16:30.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.419211+0000", 2024-09-17T18:16:30.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8819999999999993e-05 2024-09-17T18:16:30.878 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.878 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.878 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.879 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 76/31 ECSubWrite(tid=537, reqid=osd.13.0:537, at_version=76'279, trim_to=0'0, roll_forward_to=75'277))", 2024-09-17T18:16:30.879 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:11.335913+0000", 2024-09-17T18:16:30.879 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.532984384999999, 2024-09-17T18:16:30.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012447022, 2024-09-17T18:16:30.879 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.880 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.880 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.880 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.335913+0000", 2024-09-17T18:16:30.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.335913+0000", 2024-09-17T18:16:30.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.335914+0000", 2024-09-17T18:16:30.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5600000000000004e-07 2024-09-17T18:16:30.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.335971+0000", 2024-09-17T18:16:30.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6603e-05 2024-09-17T18:16:30.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.336004+0000", 2024-09-17T18:16:30.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3534000000000001e-05 2024-09-17T18:16:30.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.336027+0000", 2024-09-17T18:16:30.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2812000000000001e-05 2024-09-17T18:16:30.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.336177+0000", 2024-09-17T18:16:30.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150557 2024-09-17T18:16:30.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.336203+0000", 2024-09-17T18:16:30.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5198000000000002e-05 2024-09-17T18:16:30.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.348261+0000", 2024-09-17T18:16:30.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012058378 2024-09-17T18:16:30.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.348360+0000", 2024-09-17T18:16:30.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8984e-05 2024-09-17T18:16:30.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.884 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.885 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.0s2 76/31 ECSubWrite(tid=51, reqid=osd.3.0:51, at_version=76'43, trim_to=0'0, roll_forward_to=75'41))", 2024-09-17T18:16:30.885 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:11.336134+0000", 2024-09-17T18:16:30.885 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.532763589999998, 2024-09-17T18:16:30.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011971407999999999, 2024-09-17T18:16:30.885 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.885 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.885 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.885 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.336134+0000", 2024-09-17T18:16:30.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.336134+0000", 2024-09-17T18:16:30.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.336134+0000", 2024-09-17T18:16:30.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5000000000000002e-07 2024-09-17T18:16:30.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.336176+0000", 2024-09-17T18:16:30.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1526999999999997e-05 2024-09-17T18:16:30.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.336200+0000", 2024-09-17T18:16:30.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3665000000000001e-05 2024-09-17T18:16:30.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.336220+0000", 2024-09-17T18:16:30.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0724999999999999e-05 2024-09-17T18:16:30.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.336369+0000", 2024-09-17T18:16:30.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000148364 2024-09-17T18:16:30.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.336394+0000", 2024-09-17T18:16:30.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5148e-05 2024-09-17T18:16:30.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.348014+0000", 2024-09-17T18:16:30.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011619785000000001 2024-09-17T18:16:30.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:11.348105+0000", 2024-09-17T18:16:30.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1544000000000003e-05 2024-09-17T18:16:30.892 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.892 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.892 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.892 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s1 80/31 ECSubWrite(tid=67, reqid=osd.10.0:67, at_version=80'53, trim_to=0'0, roll_forward_to=79'51))", 2024-09-17T18:16:30.892 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.494726+0000", 2024-09-17T18:16:30.892 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.374171714999999, 2024-09-17T18:16:30.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014985439999999999, 2024-09-17T18:16:30.892 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.893 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.893 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.893 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.494726+0000", 2024-09-17T18:16:30.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.494726+0000", 2024-09-17T18:16:30.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.494726+0000", 2024-09-17T18:16:30.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5000000000000002e-07 2024-09-17T18:16:30.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.494783+0000", 2024-09-17T18:16:30.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6993999999999997e-05 2024-09-17T18:16:30.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.494815+0000", 2024-09-17T18:16:30.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2163999999999999e-05 2024-09-17T18:16:30.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.494840+0000", 2024-09-17T18:16:30.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4022000000000001e-05 2024-09-17T18:16:30.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.495560+0000", 2024-09-17T18:16:30.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00072052300000000004 2024-09-17T18:16:30.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.495577+0000", 2024-09-17T18:16:30.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7031999999999999e-05 2024-09-17T18:16:30.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.509584+0000", 2024-09-17T18:16:30.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014007063 2024-09-17T18:16:30.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.509711+0000", 2024-09-17T18:16:30.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012699200000000001 2024-09-17T18:16:30.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.897 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.897 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s1 80/31 ECSubWrite(tid=68, reqid=osd.10.0:68, at_version=80'55, trim_to=0'0, roll_forward_to=79'51))", 2024-09-17T18:16:30.897 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.496108+0000", 2024-09-17T18:16:30.897 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.372789575000001, 2024-09-17T18:16:30.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01926899, 2024-09-17T18:16:30.897 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.897 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.897 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.897 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.496108+0000", 2024-09-17T18:16:30.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.496108+0000", 2024-09-17T18:16:30.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.496110+0000", 2024-09-17T18:16:30.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2960000000000001e-06 2024-09-17T18:16:30.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.496161+0000", 2024-09-17T18:16:30.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516999999999998e-05 2024-09-17T18:16:30.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.496193+0000", 2024-09-17T18:16:30.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2821999999999998e-05 2024-09-17T18:16:30.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.496220+0000", 2024-09-17T18:16:30.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6074000000000001e-05 2024-09-17T18:16:30.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.500900+0000", 2024-09-17T18:16:30.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046800330000000001 2024-09-17T18:16:30.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.500926+0000", 2024-09-17T18:16:30.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6384999999999999e-05 2024-09-17T18:16:30.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.515294+0000", 2024-09-17T18:16:30.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014368034 2024-09-17T18:16:30.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.515377+0000", 2024-09-17T18:16:30.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2829000000000003e-05 2024-09-17T18:16:30.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.904 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.904 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s3 80/31 ECSubWrite(tid=167, reqid=osd.5.0:167, at_version=80'54, trim_to=0'0, roll_forward_to=79'52))", 2024-09-17T18:16:30.904 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:15.507146+0000", 2024-09-17T18:16:30.904 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.361751045, 2024-09-17T18:16:30.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011784864000000001, 2024-09-17T18:16:30.905 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.905 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.905 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.905 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.507146+0000", 2024-09-17T18:16:30.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.507146+0000", 2024-09-17T18:16:30.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.507147+0000", 2024-09-17T18:16:30.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3600000000000002e-07 2024-09-17T18:16:30.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.507203+0000", 2024-09-17T18:16:30.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.554e-05 2024-09-17T18:16:30.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.507232+0000", 2024-09-17T18:16:30.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9719000000000001e-05 2024-09-17T18:16:30.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.507255+0000", 2024-09-17T18:16:30.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2395000000000002e-05 2024-09-17T18:16:30.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.507633+0000", 2024-09-17T18:16:30.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037791000000000002 2024-09-17T18:16:30.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.507659+0000", 2024-09-17T18:16:30.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5962e-05 2024-09-17T18:16:30.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.518835+0000", 2024-09-17T18:16:30.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011176034 2024-09-17T18:16:30.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:15.518931+0000", 2024-09-17T18:16:30.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6467999999999999e-05 2024-09-17T18:16:30.909 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.909 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.909 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.909 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s1 81/31 ECSubWrite(tid=72, reqid=client.4565.0:863, at_version=81'59, trim_to=0'0, roll_forward_to=80'57))", 2024-09-17T18:16:30.909 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:16.987763+0000", 2024-09-17T18:16:30.910 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.881134098, 2024-09-17T18:16:30.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017048908000000002, 2024-09-17T18:16:30.910 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.910 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.910 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.910 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.987763+0000", 2024-09-17T18:16:30.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.987763+0000", 2024-09-17T18:16:30.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.987764+0000", 2024-09-17T18:16:30.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7999999999999993e-07 2024-09-17T18:16:30.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.993560+0000", 2024-09-17T18:16:30.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057957590000000002 2024-09-17T18:16:30.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.993605+0000", 2024-09-17T18:16:30.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5327999999999997e-05 2024-09-17T18:16:30.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.993647+0000", 2024-09-17T18:16:30.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1340000000000001e-05 2024-09-17T18:16:30.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.993840+0000", 2024-09-17T18:16:30.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000193322 2024-09-17T18:16:30.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:16.993876+0000", 2024-09-17T18:16:30.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5935000000000001e-05 2024-09-17T18:16:30.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:17.004714+0000", 2024-09-17T18:16:30.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010838383 2024-09-17T18:16:30.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:17.004812+0000", 2024-09-17T18:16:30.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7861000000000004e-05 2024-09-17T18:16:30.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.915 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.915 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s1 85/31 ECSubWrite(tid=107, reqid=osd.10.0:107, at_version=85'65, trim_to=0'0, roll_forward_to=84'63))", 2024-09-17T18:16:30.915 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:20.330993+0000", 2024-09-17T18:16:30.915 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.537904717, 2024-09-17T18:16:30.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017995025000000001, 2024-09-17T18:16:30.915 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.915 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.915 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.916 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.330993+0000", 2024-09-17T18:16:30.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.330993+0000", 2024-09-17T18:16:30.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.330993+0000", 2024-09-17T18:16:30.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1699999999999997e-07 2024-09-17T18:16:30.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.331051+0000", 2024-09-17T18:16:30.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7930000000000003e-05 2024-09-17T18:16:30.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.331086+0000", 2024-09-17T18:16:30.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4442e-05 2024-09-17T18:16:30.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.331110+0000", 2024-09-17T18:16:30.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4668000000000002e-05 2024-09-17T18:16:30.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.331340+0000", 2024-09-17T18:16:30.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000229998 2024-09-17T18:16:30.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.331368+0000", 2024-09-17T18:16:30.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7308999999999999e-05 2024-09-17T18:16:30.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.348899+0000", 2024-09-17T18:16:30.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017531205000000001 2024-09-17T18:16:30.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.348988+0000", 2024-09-17T18:16:30.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8756000000000002e-05 2024-09-17T18:16:30.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.919 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.920 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 85/82 ECSubWrite(tid=108, reqid=osd.10.0:108, at_version=85'340, trim_to=0'0, roll_forward_to=84'338))", 2024-09-17T18:16:30.920 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:20.332241+0000", 2024-09-17T18:16:30.920 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.536656073, 2024-09-17T18:16:30.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016572090000000001, 2024-09-17T18:16:30.920 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.920 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.920 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.920 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.332241+0000", 2024-09-17T18:16:30.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.332241+0000", 2024-09-17T18:16:30.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.332243+0000", 2024-09-17T18:16:30.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5939999999999999e-06 2024-09-17T18:16:30.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.332291+0000", 2024-09-17T18:16:30.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8344000000000003e-05 2024-09-17T18:16:30.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.332319+0000", 2024-09-17T18:16:30.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8098000000000001e-05 2024-09-17T18:16:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.332342+0000", 2024-09-17T18:16:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2365e-05 2024-09-17T18:16:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.332507+0000", 2024-09-17T18:16:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016544500000000001 2024-09-17T18:16:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.332536+0000", 2024-09-17T18:16:30.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8351999999999999e-05 2024-09-17T18:16:30.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.348720+0000", 2024-09-17T18:16:30.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016184436999999999 2024-09-17T18:16:30.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.348813+0000", 2024-09-17T18:16:30.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3455000000000006e-05 2024-09-17T18:16:30.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.924 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.925 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.925 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s1 85/31 ECSubWrite(tid=109, reqid=osd.10.0:109, at_version=85'67, trim_to=0'0, roll_forward_to=84'63))", 2024-09-17T18:16:30.925 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:20.333867+0000", 2024-09-17T18:16:30.925 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.535030538000001, 2024-09-17T18:16:30.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017393146000000002, 2024-09-17T18:16:30.925 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.925 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.925 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.925 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.333867+0000", 2024-09-17T18:16:30.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.333867+0000", 2024-09-17T18:16:30.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.333869+0000", 2024-09-17T18:16:30.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.283e-06 2024-09-17T18:16:30.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.333941+0000", 2024-09-17T18:16:30.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1588999999999995e-05 2024-09-17T18:16:30.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.333973+0000", 2024-09-17T18:16:30.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2005999999999998e-05 2024-09-17T18:16:30.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.333996+0000", 2024-09-17T18:16:30.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3380999999999999e-05 2024-09-17T18:16:30.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.334444+0000", 2024-09-17T18:16:30.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044787100000000002 2024-09-17T18:16:30.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.334473+0000", 2024-09-17T18:16:30.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8683999999999998e-05 2024-09-17T18:16:30.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.351146+0000", 2024-09-17T18:16:30.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016673171000000001 2024-09-17T18:16:30.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.351260+0000", 2024-09-17T18:16:30.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011416099999999999 2024-09-17T18:16:30.930 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.930 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.930 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.930 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 85/82 ECSubWrite(tid=110, reqid=osd.10.0:110, at_version=85'342, trim_to=0'0, roll_forward_to=84'338))", 2024-09-17T18:16:30.930 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:20.336362+0000", 2024-09-17T18:16:30.930 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.532535786, 2024-09-17T18:16:30.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016259922, 2024-09-17T18:16:30.930 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.930 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.930 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.930 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.336362+0000", 2024-09-17T18:16:30.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.336362+0000", 2024-09-17T18:16:30.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.336364+0000", 2024-09-17T18:16:30.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4990000000000001e-06 2024-09-17T18:16:30.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.336419+0000", 2024-09-17T18:16:30.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5043999999999997e-05 2024-09-17T18:16:30.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.336450+0000", 2024-09-17T18:16:30.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0445000000000001e-05 2024-09-17T18:16:30.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.336472+0000", 2024-09-17T18:16:30.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2648999999999999e-05 2024-09-17T18:16:30.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.336689+0000", 2024-09-17T18:16:30.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021705199999999999 2024-09-17T18:16:30.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.336716+0000", 2024-09-17T18:16:30.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6545000000000001e-05 2024-09-17T18:16:30.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.352519+0000", 2024-09-17T18:16:30.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015803041 2024-09-17T18:16:30.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.352622+0000", 2024-09-17T18:16:30.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010264699999999999 2024-09-17T18:16:30.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.935 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.935 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s3 85/31 ECSubWrite(tid=179, reqid=osd.5.0:179, at_version=85'58, trim_to=0'0, roll_forward_to=84'56))", 2024-09-17T18:16:30.935 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:20.342565+0000", 2024-09-17T18:16:30.936 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.52633236, 2024-09-17T18:16:30.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015618003, 2024-09-17T18:16:30.936 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.936 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.936 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.936 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.342565+0000", 2024-09-17T18:16:30.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.342565+0000", 2024-09-17T18:16:30.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.342566+0000", 2024-09-17T18:16:30.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1299999999999999e-07 2024-09-17T18:16:30.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.342621+0000", 2024-09-17T18:16:30.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5693999999999999e-05 2024-09-17T18:16:30.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.342652+0000", 2024-09-17T18:16:30.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0491999999999999e-05 2024-09-17T18:16:30.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.342676+0000", 2024-09-17T18:16:30.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3981999999999998e-05 2024-09-17T18:16:30.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.348252+0000", 2024-09-17T18:16:30.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055764179999999997 2024-09-17T18:16:30.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.348277+0000", 2024-09-17T18:16:30.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4919e-05 2024-09-17T18:16:30.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.358047+0000", 2024-09-17T18:16:30.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0097698119999999992 2024-09-17T18:16:30.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.358183+0000", 2024-09-17T18:16:30.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013597300000000001 2024-09-17T18:16:30.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.941 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.941 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.0s2 86/31 ECSubWrite(tid=89, reqid=client.4565.0:930, at_version=86'73, trim_to=0'0, roll_forward_to=85'71))", 2024-09-17T18:16:30.941 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.340916+0000", 2024-09-17T18:16:30.941 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5279815120000002, 2024-09-17T18:16:30.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015865002, 2024-09-17T18:16:30.941 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.941 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.941 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.941 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.340916+0000", 2024-09-17T18:16:30.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.340916+0000", 2024-09-17T18:16:30.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.340917+0000", 2024-09-17T18:16:30.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4000000000000001e-07 2024-09-17T18:16:30.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.340977+0000", 2024-09-17T18:16:30.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0173999999999997e-05 2024-09-17T18:16:30.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.341026+0000", 2024-09-17T18:16:30.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9079999999999998e-05 2024-09-17T18:16:30.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.341052+0000", 2024-09-17T18:16:30.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6173000000000002e-05 2024-09-17T18:16:30.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.341494+0000", 2024-09-17T18:16:30.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044148100000000002 2024-09-17T18:16:30.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.341523+0000", 2024-09-17T18:16:30.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9045000000000001e-05 2024-09-17T18:16:30.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.356686+0000", 2024-09-17T18:16:30.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015163533999999999 2024-09-17T18:16:30.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.356781+0000", 2024-09-17T18:16:30.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4775e-05 2024-09-17T18:16:30.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.945 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.946 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s3 86/31 ECSubWrite(tid=197, reqid=osd.5.0:197, at_version=86'64, trim_to=0'0, roll_forward_to=85'62))", 2024-09-17T18:16:30.946 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.345807+0000", 2024-09-17T18:16:30.946 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5230906500000003, 2024-09-17T18:16:30.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013395704, 2024-09-17T18:16:30.946 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.946 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.946 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.946 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.345807+0000", 2024-09-17T18:16:30.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.345807+0000", 2024-09-17T18:16:30.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.345807+0000", 2024-09-17T18:16:30.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.44e-07 2024-09-17T18:16:30.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.345864+0000", 2024-09-17T18:16:30.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6719999999999999e-05 2024-09-17T18:16:30.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.345896+0000", 2024-09-17T18:16:30.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1538000000000002e-05 2024-09-17T18:16:30.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.345919+0000", 2024-09-17T18:16:30.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3056000000000001e-05 2024-09-17T18:16:30.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.346227+0000", 2024-09-17T18:16:30.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030842 2024-09-17T18:16:30.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.346253+0000", 2024-09-17T18:16:30.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5843e-05 2024-09-17T18:16:30.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.359106+0000", 2024-09-17T18:16:30.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012852951 2024-09-17T18:16:30.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.359202+0000", 2024-09-17T18:16:30.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6632000000000006e-05 2024-09-17T18:16:30.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.950 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.950 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.0s2 86/31 ECSubWrite(tid=90, reqid=client.4565.0:931, at_version=86'74, trim_to=0'0, roll_forward_to=85'71))", 2024-09-17T18:16:30.950 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.347542+0000", 2024-09-17T18:16:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.5213557449999993, 2024-09-17T18:16:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012721886, 2024-09-17T18:16:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.347542+0000", 2024-09-17T18:16:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.347542+0000", 2024-09-17T18:16:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.347544+0000", 2024-09-17T18:16:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0839999999999999e-06 2024-09-17T18:16:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.347594+0000", 2024-09-17T18:16:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0064e-05 2024-09-17T18:16:30.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.347623+0000", 2024-09-17T18:16:30.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9575000000000001e-05 2024-09-17T18:16:30.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.347648+0000", 2024-09-17T18:16:30.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4722000000000001e-05 2024-09-17T18:16:30.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.351198+0000", 2024-09-17T18:16:30.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003549913 2024-09-17T18:16:30.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.351223+0000", 2024-09-17T18:16:30.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5418999999999998e-05 2024-09-17T18:16:30.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.360177+0000", 2024-09-17T18:16:30.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0089539029999999992 2024-09-17T18:16:30.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.360264+0000", 2024-09-17T18:16:30.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6205999999999994e-05 2024-09-17T18:16:30.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.955 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.955 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 86/82 ECSubWrite(tid=135, reqid=osd.10.0:135, at_version=86'365, trim_to=0'0, roll_forward_to=85'361))", 2024-09-17T18:16:30.955 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.379346+0000", 2024-09-17T18:16:30.955 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.4895514649999999, 2024-09-17T18:16:30.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012198151000000001, 2024-09-17T18:16:30.955 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.955 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.956 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.956 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379346+0000", 2024-09-17T18:16:30.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379346+0000", 2024-09-17T18:16:30.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379347+0000", 2024-09-17T18:16:30.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.147e-06 2024-09-17T18:16:30.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379386+0000", 2024-09-17T18:16:30.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8940999999999999e-05 2024-09-17T18:16:30.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379408+0000", 2024-09-17T18:16:30.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1599000000000001e-05 2024-09-17T18:16:30.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379443+0000", 2024-09-17T18:16:30.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4925000000000002e-05 2024-09-17T18:16:30.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.382393+0000", 2024-09-17T18:16:30.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029502209999999998 2024-09-17T18:16:30.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.382419+0000", 2024-09-17T18:16:30.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6044999999999999e-05 2024-09-17T18:16:30.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.391477+0000", 2024-09-17T18:16:30.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090580480000000008 2024-09-17T18:16:30.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.391544+0000", 2024-09-17T18:16:30.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7224999999999994e-05 2024-09-17T18:16:30.959 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.959 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.960 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 86/82 ECSubWrite(tid=136, reqid=client.4565.0:937, at_version=86'367, trim_to=0'0, roll_forward_to=85'361))", 2024-09-17T18:16:30.960 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.379473+0000", 2024-09-17T18:16:30.960 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.4894246209999995, 2024-09-17T18:16:30.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012545325, 2024-09-17T18:16:30.960 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.960 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.960 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.960 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379473+0000", 2024-09-17T18:16:30.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379473+0000", 2024-09-17T18:16:30.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379474+0000", 2024-09-17T18:16:30.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0100000000000001e-06 2024-09-17T18:16:30.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379565+0000", 2024-09-17T18:16:30.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0834999999999993e-05 2024-09-17T18:16:30.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379588+0000", 2024-09-17T18:16:30.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2909e-05 2024-09-17T18:16:30.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379611+0000", 2024-09-17T18:16:30.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3332e-05 2024-09-17T18:16:30.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.383666+0000", 2024-09-17T18:16:30.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040551049999999998 2024-09-17T18:16:30.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.383688+0000", 2024-09-17T18:16:30.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1591999999999999e-05 2024-09-17T18:16:30.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.391954+0000", 2024-09-17T18:16:30.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082660170000000005 2024-09-17T18:16:30.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.392018+0000", 2024-09-17T18:16:30.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4524999999999996e-05 2024-09-17T18:16:30.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.964 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.964 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 86/82 ECSubWrite(tid=137, reqid=client.4565.0:938, at_version=86'368, trim_to=0'0, roll_forward_to=85'361))", 2024-09-17T18:16:30.965 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.379640+0000", 2024-09-17T18:16:30.965 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.4892575830000006, 2024-09-17T18:16:30.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015873864000000001, 2024-09-17T18:16:30.965 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.965 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.965 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.965 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379640+0000", 2024-09-17T18:16:30.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379640+0000", 2024-09-17T18:16:30.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379641+0000", 2024-09-17T18:16:30.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2299999999999999e-07 2024-09-17T18:16:30.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379683+0000", 2024-09-17T18:16:30.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2351000000000002e-05 2024-09-17T18:16:30.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379703+0000", 2024-09-17T18:16:30.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0049000000000001e-05 2024-09-17T18:16:30.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379719+0000", 2024-09-17T18:16:30.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5429000000000001e-05 2024-09-17T18:16:30.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.386640+0000", 2024-09-17T18:16:30.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069211489999999997 2024-09-17T18:16:30.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.386659+0000", 2024-09-17T18:16:30.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9106999999999998e-05 2024-09-17T18:16:30.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.395454+0000", 2024-09-17T18:16:30.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087948190000000006 2024-09-17T18:16:30.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.395514+0000", 2024-09-17T18:16:30.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0037000000000001e-05 2024-09-17T18:16:30.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.969 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.969 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds4 86/82 ECSubWrite(tid=138, reqid=client.4565.0:939, at_version=86'369, trim_to=0'0, roll_forward_to=85'361))", 2024-09-17T18:16:30.969 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:21.379741+0000", 2024-09-17T18:16:30.969 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.4891559149999996, 2024-09-17T18:16:30.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015817860999999999, 2024-09-17T18:16:30.970 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.970 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.970 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.970 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379741+0000", 2024-09-17T18:16:30.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379741+0000", 2024-09-17T18:16:30.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379742+0000", 2024-09-17T18:16:30.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5700000000000002e-07 2024-09-17T18:16:30.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379808+0000", 2024-09-17T18:16:30.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5973e-05 2024-09-17T18:16:30.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379829+0000", 2024-09-17T18:16:30.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1123000000000001e-05 2024-09-17T18:16:30.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.379846+0000", 2024-09-17T18:16:30.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6449000000000001e-05 2024-09-17T18:16:30.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.390907+0000", 2024-09-17T18:16:30.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011060814 2024-09-17T18:16:30.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.390927+0000", 2024-09-17T18:16:30.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0990000000000001e-05 2024-09-17T18:16:30.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.395519+0000", 2024-09-17T18:16:30.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045919810000000002 2024-09-17T18:16:30.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:21.395559+0000", 2024-09-17T18:16:30.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9873999999999998e-05 2024-09-17T18:16:30.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.974 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.974 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.0s2 91/31 ECSubWrite(tid=97, reqid=osd.3.0:97, at_version=91'83, trim_to=0'0, roll_forward_to=88'81))", 2024-09-17T18:16:30.974 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:26.378617+0000", 2024-09-17T18:16:30.974 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.4902800159999998, 2024-09-17T18:16:30.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014136338, 2024-09-17T18:16:30.974 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:30.974 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:30.974 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-17T18:16:30.975 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:30.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:30.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:26.378617+0000", 2024-09-17T18:16:30.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:30.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:26.378617+0000", 2024-09-17T18:16:30.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:30.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:30.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:26.378618+0000", 2024-09-17T18:16:30.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5300000000000003e-07 2024-09-17T18:16:30.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:30.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:26.378679+0000", 2024-09-17T18:16:30.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0701e-05 2024-09-17T18:16:30.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:30.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:26.378711+0000", 2024-09-17T18:16:30.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1924000000000001e-05 2024-09-17T18:16:30.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:30.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:26.378734+0000", 2024-09-17T18:16:30.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3189000000000001e-05 2024-09-17T18:16:30.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:30.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:26.378893+0000", 2024-09-17T18:16:30.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015940299999999999 2024-09-17T18:16:30.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:30.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:26.378910+0000", 2024-09-17T18:16:30.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6532999999999999e-05 2024-09-17T18:16:30.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:30.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:26.392653+0000", 2024-09-17T18:16:30.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013743316 2024-09-17T18:16:30.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:30.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:30.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:30.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:26.392754+0000", 2024-09-17T18:16:30.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100519 2024-09-17T18:16:30.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.979 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:30.980 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:30.980 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:30.981 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T18:16:30.982 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:16:30.977+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:16:31.082 INFO:tasks.ceph.osd.15.smithi154.stderr:2024-09-17T18:16:31.077+0000 7efefc157640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26607) UID: 0 2024-09-17T18:16:31.106 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:31.107 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:31.107 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-17T18:16:31.108 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:31.120 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T18:16:31.183 INFO:tasks.ceph.osd.9.smithi134.stderr:2024-09-17T18:16:31.177+0000 7f1001346640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26376) UID: 0 2024-09-17T18:16:31.193 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:16:31.193 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:16:31.211 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2024-09-17T18:16:30.323652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":155877939,"num_objects":126,"num_object_clones":73,"num_object_copies":862,"num_objects_missing_on_primary":12,"num_objects_missing":12,"num_objects_degraded":84,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":7,"num_read":526,"num_read_kb":195069,"num_write":1021,"num_write_kb":176850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":46055424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2154,"ondisk_log_size":2154,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":871132,"kb_used_data":285984,"kb_used_omap":24,"kb_used_meta":584743,"kb_avail":1509078308,"statfs":{"total":1546188226560,"available":1545296187392,"internally_reserved":0,"allocated":292847616,"data_stored":429994862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":598776913},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2916352,"num_objects":5,"num_object_clones":5,"num_object_copies":35,"num_objects_missing_on_primary":12,"num_objects_missing":12,"num_objects_degraded":84,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":-1,"num_read":9,"num_read_kb":6848,"num_write":31,"num_write_kb":2848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.952508"},"pg_stats":[{"pgid":"3.f","version":"91'49","reported_seq":351,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T18:16:27.395438+0000","last_change":"2024-09-17T18:16:26.406047+0000","last_active":"2024-09-17T18:16:27.395438+0000","last_peered":"2024-09-17T18:16:27.395438+0000","last_clean":"2024-09-17T18:16:27.395438+0000","last_became_active":"2024-09-17T18:15:28.090920+0000","last_became_peered":"2024-09-17T18:15:28.090920+0000","last_unstale":"2024-09-17T18:16:27.395438+0000","last_undegraded":"2024-09-17T18:16:27.395438+0000","last_fullsized":"2024-09-17T18:16:27.395438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021980071,"stat_sum":{"num_bytes":10059776,"num_objects":5,"num_object_clones":3,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":26815,"num_write":20,"num_write_kb":9904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3,15,14,2,11,0],"acting":[13,3,15,14,2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"17","length":"1"},{"start":"1d","length":"2"}]},{"pgid":"3.e","version":"91'50","reported_seq":344,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T18:16:27.393609+0000","last_change":"2024-09-17T18:16:26.393186+0000","last_active":"2024-09-17T18:16:27.393609+0000","last_peered":"2024-09-17T18:16:27.393609+0000","last_clean":"2024-09-17T18:16:27.393609+0000","last_became_active":"2024-09-17T18:15:28.110648+0000","last_became_peered":"2024-09-17T18:15:28.110648+0000","last_unstale":"2024-09-17T18:16:27.393609+0000","last_undegraded":"2024-09-17T18:16:27.393609+0000","last_fullsized":"2024-09-17T18:16:27.393609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:38.165676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019714611,"stat_sum":{"num_bytes":1982464,"num_objects":5,"num_object_clones":3,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":14,"num_read_kb":946,"num_write":36,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14,6,13,8,3,12],"acting":[11,14,6,13,8,3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"17","length":"1"},{"start":"1d","length":"2"}]},{"pgid":"3.d","version":"91'408","reported_seq":756,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T18:16:27.419734+0000","last_change":"2024-09-17T18:16:26.434706+0000","last_active":"2024-09-17T18:16:27.419734+0000","last_peered":"2024-09-17T18:16:27.419734+0000","last_clean":"2024-09-17T18:16:27.419734+0000","last_became_active":"2024-09-17T18:16:18.338570+0000","last_became_peered":"2024-09-17T18:16:18.338570+0000","last_unstale":"2024-09-17T18:16:27.419734+0000","last_undegraded":"2024-09-17T18:16:27.419734+0000","last_fullsized":"2024-09-17T18:16:27.419734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:40.151932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048843166,"stat_sum":{"num_bytes":33161216,"num_objects":23,"num_object_clones":14,"num_object_copies":161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":1,"num_read":106,"num_read_kb":44704,"num_write":189,"num_write_kb":35216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":46055424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,3,15,9,12,4],"acting":[10,1,3,15,9,12,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"17","length":"1"},{"start":"1d","length":"2"}]},{"pgid":"3.c","version":"91'133","reported_seq":416,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T18:16:27.394342+0000","last_change":"2024-09-17T18:16:26.399726+0000","last_active":"2024-09-17T18:16:27.394342+0000","last_peered":"2024-09-17T18:16:27.394342+0000","last_clean":"2024-09-17T18:16:27.394342+0000","last_became_active":"2024-09-17T18:15:28.112093+0000","last_became_peered":"2024-09-17T18:15:28.112093+0000","last_unstale":"2024-09-17T18:16:27.394342+0000","last_undegraded":"2024-09-17T18:16:27.394342+0000","last_fullsized":"2024-09-17T18:16:27.394342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:43.156541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026523428000000002,"stat_sum":{"num_bytes":3424256,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":25,"num_read_kb":8129,"num_write":33,"num_write_kb":7248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,3,7,12,14],"acting":[5,8,13,3,7,12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"17","length":"1"},{"start":"1d","length":"2"}]},{"pgid":"3.b","version":"93'197","reported_seq":472,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T18:16:28.331109+0000","last_change":"2024-09-17T18:16:28.332779+0000","last_active":"2024-09-17T18:16:28.331109+0000","last_peered":"2024-09-17T18:16:28.331109+0000","last_clean":"2024-09-17T18:16:28.331109+0000","last_became_active":"2024-09-17T18:15:28.111526+0000","last_became_peered":"2024-09-17T18:15:28.111526+0000","last_unstale":"2024-09-17T18:16:28.331109+0000","last_undegraded":"2024-09-17T18:16:28.331109+0000","last_fullsized":"2024-09-17T18:16:28.331109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011846282,"stat_sum":{"num_bytes":17793024,"num_objects":11,"num_object_clones":6,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":1,"num_read":27,"num_read_kb":111,"num_write":118,"num_write_kb":19616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,10,12,11,1,14],"acting":[4,0,10,12,11,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1d","length":"2"},{"start":"20","length":"1"}]},{"pgid":"3.a","version":"91'265","reported_seq":537,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T18:16:27.395754+0000","last_change":"2024-09-17T18:16:26.405781+0000","last_active":"2024-09-17T18:16:27.395754+0000","last_peered":"2024-09-17T18:16:27.395754+0000","last_clean":"2024-09-17T18:16:27.395754+0000","last_became_active":"2024-09-17T18:15:28.089449+0000","last_became_peered":"2024-09-17T18:15:28.089449+0000","last_unstale":"2024-09-17T18:16:27.395754+0000","last_undegraded":"2024-09-17T18:16:27.395754+0000","last_fullsized":"2024-09-17T18:16:27.395754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.272463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023139211999999999,"stat_sum":{"num_bytes":20774912,"num_objects":14,"num_object_clones":9,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":52,"num_read_kb":24861,"num_write":63,"num_write_kb":21328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,6,5,3,15,4],"acting":[13,1,6,5,3,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"17","length":"1"},{"start":"1d","length":"2"}]},{"pgid":"3.9","version":"86'194","reported_seq":476,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T18:16:28.325116+0000","last_change":"2024-09-17T18:16:28.325733+0000","last_active":"2024-09-17T18:16:28.325116+0000","last_peered":"2024-09-17T18:16:28.325116+0000","last_clean":"2024-09-17T18:16:28.325116+0000","last_became_active":"2024-09-17T18:15:28.095114+0000","last_became_peered":"2024-09-17T18:15:28.095114+0000","last_unstale":"2024-09-17T18:16:28.325116+0000","last_undegraded":"2024-09-17T18:16:28.325116+0000","last_fullsized":"2024-09-17T18:16:28.325116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:46.932086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014539519999999999,"stat_sum":{"num_bytes":11157504,"num_objects":8,"num_object_clones":4,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":31,"num_read_kb":11905,"num_write":74,"num_write_kb":14144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,10,11,5,8,3],"acting":[7,2,10,11,5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1d","length":"2"},{"start":"20","length":"1"}]},{"pgid":"3.8","version":"93'128","reported_seq":407,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T18:16:28.349078+0000","last_change":"2024-09-17T18:16:28.351773+0000","last_active":"2024-09-17T18:16:28.349078+0000","last_peered":"2024-09-17T18:16:28.349078+0000","last_clean":"2024-09-17T18:16:28.349078+0000","last_became_active":"2024-09-17T18:15:28.088066+0000","last_became_peered":"2024-09-17T18:15:28.088066+0000","last_unstale":"2024-09-17T18:16:28.349078+0000","last_undegraded":"2024-09-17T18:16:28.349078+0000","last_fullsized":"2024-09-17T18:16:28.349078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:42.281999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022100445999999999,"stat_sum":{"num_bytes":9846784,"num_objects":9,"num_object_clones":6,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":13,"num_read_kb":10,"num_write":57,"num_write_kb":10272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,11,3,15,1,7],"acting":[6,0,11,3,15,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1d","length":"2"},{"start":"20","length":"1"}]},{"pgid":"1.0","version":"25'112","reported_seq":282,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T18:16:28.331474+0000","last_change":"2024-09-17T18:15:13.924291+0000","last_active":"2024-09-17T18:16:28.331474+0000","last_peered":"2024-09-17T18:16:28.331474+0000","last_clean":"2024-09-17T18:16:28.331474+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:16:28.331474+0000","last_undegraded":"2024-09-17T18:16:28.331474+0000","last_fullsized":"2024-09-17T18:16:28.331474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:15:12.533086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:37.379235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":151,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T18:16:28.329292+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:16:28.329292+0000","last_peered":"2024-09-17T18:16:28.329292+0000","last_clean":"2024-09-17T18:16:28.329292+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:16:28.329292+0000","last_undegraded":"2024-09-17T18:16:28.329292+0000","last_fullsized":"2024-09-17T18:16:28.329292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:25.064319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"91'93","reported_seq":383,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T18:16:28.329652+0000","last_change":"2024-09-17T18:16:28.330421+0000","last_active":"2024-09-17T18:16:28.329652+0000","last_peered":"2024-09-17T18:16:28.329652+0000","last_clean":"2024-09-17T18:16:28.329652+0000","last_became_active":"2024-09-17T18:15:28.089102+0000","last_became_peered":"2024-09-17T18:15:28.089102+0000","last_unstale":"2024-09-17T18:16:28.329652+0000","last_undegraded":"2024-09-17T18:16:28.329652+0000","last_fullsized":"2024-09-17T18:16:28.329652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:45.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00187127,"stat_sum":{"num_bytes":6504448,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":13,"num_read_kb":115,"num_write":37,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3,13,1,5,10,7],"acting":[14,3,13,1,5,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"1d","length":"2"},{"start":"20","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T18:16:26.385799+0000","last_change":"2024-09-17T18:15:16.990099+0000","last_active":"2024-09-17T18:16:26.385799+0000","last_peered":"2024-09-17T18:16:26.385799+0000","last_clean":"2024-09-17T18:16:26.385799+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:16:26.385799+0000","last_undegraded":"2024-09-17T18:16:26.385799+0000","last_fullsized":"2024-09-17T18:16:26.385799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:39.933228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":292,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T18:16:28.321422+0000","last_change":"2024-09-17T18:16:28.321774+0000","last_active":"2024-09-17T18:16:28.321422+0000","last_peered":"2024-09-17T18:16:28.321422+0000","last_clean":"2024-09-17T18:16:28.321422+0000","last_became_active":"2024-09-17T18:15:28.094455+0000","last_became_peered":"2024-09-17T18:15:28.094455+0000","last_unstale":"2024-09-17T18:16:28.321422+0000","last_undegraded":"2024-09-17T18:16:28.321422+0000","last_fullsized":"2024-09-17T18:16:28.321422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:38.438579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011475560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,14,10,7,3,2],"acting":[4,13,14,10,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1d","length":"2"},{"start":"20","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T18:16:28.328346+0000","last_change":"2024-09-17T18:15:17.499886+0000","last_active":"2024-09-17T18:16:28.328346+0000","last_peered":"2024-09-17T18:16:28.328346+0000","last_clean":"2024-09-17T18:16:28.328346+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:16:28.328346+0000","last_undegraded":"2024-09-17T18:16:28.328346+0000","last_fullsized":"2024-09-17T18:16:28.328346+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:34.366017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"91'83","reported_seq":384,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T18:16:28.344217+0000","last_change":"2024-09-17T18:16:28.345158+0000","last_active":"2024-09-17T18:16:28.344217+0000","last_peered":"2024-09-17T18:16:28.344217+0000","last_clean":"2024-09-17T18:16:28.344217+0000","last_became_active":"2024-09-17T18:15:28.273637+0000","last_became_peered":"2024-09-17T18:15:28.273637+0000","last_unstale":"2024-09-17T18:16:28.344217+0000","last_undegraded":"2024-09-17T18:16:28.344217+0000","last_fullsized":"2024-09-17T18:16:28.344217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:29.233102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031650039999999999,"stat_sum":{"num_bytes":9797632,"num_objects":7,"num_object_clones":5,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":32071,"num_write":28,"num_write_kb":11424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,9,2,6,15,4],"acting":[3,7,9,2,6,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"2"},{"start":"20","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":151,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T18:16:27.395890+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:16:27.395890+0000","last_peered":"2024-09-17T18:16:27.395890+0000","last_clean":"2024-09-17T18:16:27.395890+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:16:27.395890+0000","last_undegraded":"2024-09-17T18:16:27.395890+0000","last_fullsized":"2024-09-17T18:16:27.395890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"91'76","reported_seq":372,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T18:16:27.419544+0000","last_change":"2024-09-17T18:16:26.405276+0000","last_active":"2024-09-17T18:16:27.419544+0000","last_peered":"2024-09-17T18:16:27.419544+0000","last_clean":"2024-09-17T18:16:27.419544+0000","last_became_active":"2024-09-17T18:15:28.272974+0000","last_became_peered":"2024-09-17T18:15:28.272974+0000","last_unstale":"2024-09-17T18:16:27.419544+0000","last_undegraded":"2024-09-17T18:16:27.419544+0000","last_fullsized":"2024-09-17T18:16:27.419544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:48.660998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020561718999999999,"stat_sum":{"num_bytes":10846208,"num_objects":6,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":22,"num_read_kb":9400,"num_write":20,"num_write_kb":10592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4,13,11,2,5],"acting":[10,9,4,13,11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"17","length":"1"},{"start":"1d","length":"2"}]},{"pgid":"3.5","version":"91'68","reported_seq":364,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T18:16:27.394353+0000","last_change":"2024-09-17T18:16:26.388346+0000","last_active":"2024-09-17T18:16:27.394353+0000","last_peered":"2024-09-17T18:16:27.394353+0000","last_clean":"2024-09-17T18:16:27.394353+0000","last_became_active":"2024-09-17T18:15:28.275306+0000","last_became_peered":"2024-09-17T18:15:28.275306+0000","last_unstale":"2024-09-17T18:16:27.394353+0000","last_undegraded":"2024-09-17T18:16:27.394353+0000","last_fullsized":"2024-09-17T18:16:27.394353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:30.998290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015263618,"stat_sum":{"num_bytes":6914048,"num_objects":3,"num_object_clones":2,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":8243,"num_write":35,"num_write_kb":8560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,11],"acting":[5,8,4,9,12,0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"17","length":"1"},{"start":"1d","length":"2"}]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T18:16:28.320145+0000","last_change":"2024-09-17T18:16:23.688825+0000","last_active":"2024-09-17T18:16:28.320145+0000","last_peered":"2024-09-17T18:16:28.320145+0000","last_clean":"2024-09-17T18:16:28.320145+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:16:28.320145+0000","last_undegraded":"2024-09-17T18:16:28.320145+0000","last_fullsized":"2024-09-17T18:16:28.320145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:23.688677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:23.688677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:33.289925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":289,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T18:16:27.391261+0000","last_change":"2024-09-17T18:16:26.379896+0000","last_active":"2024-09-17T18:16:27.391261+0000","last_peered":"2024-09-17T18:16:27.391261+0000","last_clean":"2024-09-17T18:16:27.391261+0000","last_became_active":"2024-09-17T18:15:28.090551+0000","last_became_peered":"2024-09-17T18:15:28.090551+0000","last_unstale":"2024-09-17T18:16:27.391261+0000","last_undegraded":"2024-09-17T18:16:27.391261+0000","last_fullsized":"2024-09-17T18:16:27.391261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001983636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15,4,2,6,10,7],"acting":[8,15,4,2,6,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"6","length":"3"},{"start":"10","length":"1"},{"start":"17","length":"1"},{"start":"1d","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T18:16:28.323281+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:16:28.323281+0000","last_peered":"2024-09-17T18:16:28.323281+0000","last_clean":"2024-09-17T18:16:28.323281+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:16:28.323281+0000","last_undegraded":"2024-09-17T18:16:28.323281+0000","last_fullsized":"2024-09-17T18:16:28.323281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:15.290413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"91'173","reported_seq":466,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T18:16:28.321484+0000","last_change":"2024-09-17T18:16:28.322126+0000","last_active":"2024-09-17T18:16:28.321484+0000","last_peered":"2024-09-17T18:16:28.321484+0000","last_clean":"2024-09-17T18:16:28.321484+0000","last_became_active":"2024-09-17T18:15:27.692814+0000","last_became_peered":"2024-09-17T18:15:27.692814+0000","last_unstale":"2024-09-17T18:16:28.321484+0000","last_undegraded":"2024-09-17T18:16:28.321484+0000","last_fullsized":"2024-09-17T18:16:28.321484+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:47.730875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001289204,"stat_sum":{"num_bytes":3047424,"num_objects":11,"num_object_clones":6,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":1,"num_read":47,"num_read_kb":10980,"num_write":130,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,0,14,10,13],"acting":[4,11,6,0,14,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1d","length":"2"},{"start":"20","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":149,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T18:16:27.391577+0000","last_change":"2024-09-17T18:15:17.502621+0000","last_active":"2024-09-17T18:16:27.391577+0000","last_peered":"2024-09-17T18:16:27.391577+0000","last_clean":"2024-09-17T18:16:27.391577+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:16:27.391577+0000","last_undegraded":"2024-09-17T18:16:27.391577+0000","last_fullsized":"2024-09-17T18:16:27.391577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:33.990534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"88'122","reported_seq":11,"reported_epoch":93,"state":"activating+undersized+degraded+remapped","last_fresh":"2024-09-17T18:16:28.372222+0000","last_change":"2024-09-17T18:16:28.348695+0000","last_active":"2024-09-17T18:16:28.329607+0000","last_peered":"2024-09-17T18:16:25.377365+0000","last_clean":"2024-09-17T18:16:25.377365+0000","last_became_active":"2024-09-17T18:15:28.272963+0000","last_became_peered":"2024-09-17T18:15:28.272963+0000","last_unstale":"2024-09-17T18:16:28.372222+0000","last_undegraded":"2024-09-17T18:16:28.343646+0000","last_fullsized":"2024-09-17T18:16:28.329607+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:26.648141+0000","last_clean_scrub_stamp":"2024-09-17T18:15:26.648141+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013779463,"stat_sum":{"num_bytes":9977856,"num_objects":8,"num_object_clones":5,"num_object_copies":56,"num_objects_missing_on_primary":12,"num_objects_missing":12,"num_objects_degraded":84,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":16706,"num_write":34,"num_write_kb":9744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,12,7,15,13,8],"acting":[6,0,12,7,2147483647,2147483647,8],"avail_no_missing":["0(0)","2(3)","5(4)","6(2)","9(5)","14(1)","15(6)"],"object_location_counts":[{"shards":"0(0),2(3),5(4),6(2),9(5),14(1),15(6)","objects":8}],"blocked_by":[6],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1d","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":149,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T18:16:27.395979+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:16:27.395979+0000","last_peered":"2024-09-17T18:16:27.395979+0000","last_clean":"2024-09-17T18:16:27.395979+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:16:27.395979+0000","last_undegraded":"2024-09-17T18:16:27.395979+0000","last_fullsized":"2024-09-17T18:16:27.395979+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:26.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":155287552,"num_objects":122,"num_object_clones":73,"num_object_copies":854,"num_objects_missing_on_primary":12,"num_objects_missing":12,"num_objects_degraded":84,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":7,"num_read":440,"num_read_kb":194996,"num_write":874,"num_write_kb":174176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":46055424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270499840,"data_stored":417116160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2039,"ondisk_log_size":2039,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247827,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73364,"kb_used_data":24128,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94298476,"statfs":{"total":96636764160,"available":96561639424,"internally_reserved":0,"allocated":24707072,"data_stored":39471633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247827,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45388,"kb_used_data":14200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326452,"statfs":{"total":96636764160,"available":96590286848,"internally_reserved":0,"allocated":14540800,"data_stored":21940209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280531,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44240,"kb_used_data":17204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94327600,"statfs":{"total":96636764160,"available":96591462400,"internally_reserved":0,"allocated":17616896,"data_stored":22298307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313235,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46496,"kb_used_data":15308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94325344,"statfs":{"total":96636764160,"available":96589152256,"internally_reserved":0,"allocated":15675392,"data_stored":24940208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280531,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64228,"kb_used_data":14984,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307612,"statfs":{"total":96636764160,"available":96570994688,"internally_reserved":0,"allocated":15343616,"data_stored":20504259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313235,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49324,"kb_used_data":18132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322516,"statfs":{"total":96636764160,"available":96586256384,"internally_reserved":0,"allocated":18567168,"data_stored":27579760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280529,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49340,"kb_used_data":18144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322500,"statfs":{"total":96636764160,"available":96586240000,"internally_reserved":0,"allocated":18579456,"data_stored":25570992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,3,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280530,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53092,"kb_used_data":21896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94318748,"statfs":{"total":96636764160,"available":96582397952,"internally_reserved":0,"allocated":22421504,"data_stored":26861232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[1,2,3,4,5,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313234,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68036,"kb_used_data":18796,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94303804,"statfs":{"total":96636764160,"available":96567095296,"internally_reserved":0,"allocated":19247104,"data_stored":29476849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280530,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71492,"kb_used_data":22256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94300348,"statfs":{"total":96636764160,"available":96563556352,"internally_reserved":0,"allocated":22790144,"data_stored":33040369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280530,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40988,"kb_used_data":13952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330852,"statfs":{"total":96636764160,"available":96594792448,"internally_reserved":0,"allocated":14286848,"data_stored":21753520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247825,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58908,"kb_used_data":27720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94312932,"statfs":{"total":96636764160,"available":96576442368,"internally_reserved":0,"allocated":28385280,"data_stored":41961457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247827,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79140,"kb_used_data":25744,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94292700,"statfs":{"total":96636764160,"available":96555724800,"internally_reserved":0,"allocated":26361856,"data_stored":38516721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247827,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46416,"kb_used_data":15228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94325424,"statfs":{"total":96636764160,"available":96589234176,"internally_reserved":0,"allocated":15593472,"data_stored":26882993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247826,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42456,"kb_used_data":11264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329384,"statfs":{"total":96636764160,"available":96593289216,"internally_reserved":0,"allocated":11534336,"data_stored":19378577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280529,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38224,"kb_used_data":7028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333616,"statfs":{"total":96636764160,"available":96597622784,"internally_reserved":0,"allocated":7196672,"data_stored":9817776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14348288,"data_stored":24166400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21446656,"data_stored":31768576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12959744,"data_stored":20979712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27041792,"data_stored":40689664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25018368,"data_stored":37244928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17252352,"data_stored":24797184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13701120,"data_stored":25559040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10174464,"data_stored":18583552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":5869568,"data_stored":9043968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":17256448,"data_stored":26816512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":21147648,"data_stored":27389952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":17903616,"data_stored":28692480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":16338944,"data_stored":22827008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":14012416,"data_stored":19730432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":13197312,"data_stored":21155840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":22831104,"data_stored":37670912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:16:31.213 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-17T18:16:31.213 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-17T18:16:31.237 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:31.238 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-17T18:16:31.238 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-17T18:16:31.238 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-17T18:16:31.238 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:31.252 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T18:16:31.285 INFO:tasks.ceph.osd.10.smithi146.stderr:2024-09-17T18:16:31.281+0000 7fa27fce0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26368) UID: 0 2024-09-17T18:16:31.386 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:31.381+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:31.401 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T18:16:31.401 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T18:16:31.422 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-17T18:16:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-17T18:16:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-17T18:16:31.422 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-17T18:16:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:339 3.ds0 3:b554fbc1:::smithi15432074-41:head [create,setxattr h^blbcaNtSmmsQtZPdaRtPkhOOgN_Vi\\f`NtsZ[V (561) in=40b,setxattr T (17332) in=1b,setxattr UVoaZteYfmpthpcfl[gebaR\\TdqcNkhPRRdrgsX] (279) in=40b,setxattr bTPgfXb\\YXtXkQag\\Qh`hlXr[posd]]cje]^eebl (1121) in=40b,setxattr hm^gakWSOOOfNOTph^tma]iaNsaqfjqZYb\\seZNW (3297) in=40b,setxattr YiNn[]m_q`YlQlaV^mRn^ (17332) in=21b,setxattr \\tllpkXThmWXSkOopogrdtjY]f^a^sem_krafjfi (947) in=40b,setxattr RXiRZRQVSaUTaZmQT^bfqZhS^mZsqadaPdW]ijm` (1963) in=40b,setxattr WTmsTZhNpU`tZY\\^aROaNdmtYsjjsgWWboehPOP` (19508) in=40b,setxattr UZmWZeWaoiX]jmbn][UadnNkcZc_hdcjidtNsRYo (1999) in=40b,setxattr NSebjRYYQ`SbaatVjZWNab`cenkljRq`^]Xr\\jRm (11788) in=40b,setxattr ip`daUaop[rdbNPo\\^c[Wcelsl]a][RScQZ[kfa^ (18524) in=40b,setxattr qU_qcNcQpNkegs_Od`jieTXX[mto]lsR^jTcYprR (593) in=40b,setxattr dboVg`srq[bReagdR]fX\\Pe`Warrp]\\[XpSipTN[ (1683) in=40b,setxattr ZdTaVj[ScjsOiQ]a_]R[RQWoYohnjd`fi[dYmfs` (840) in=40b,setxattr N_[blmbpstWhtUgW]ZjZ[\\O_erqcnQN]R_V^U\\RT (1015) in=40b,setxattr jXbP_mNsadnq`UVfmc^lfZUs\\r_[ZnrahqTUk^Zp (383) in=40b,setxattr nmemd\\ipehj\\q^UVY_YtSrhZjcabNXhlai_noQSO (807) in=40b,setxattr Rbc\\cahhlcrckUioieUbQnrseNkZkdPf\\rUmNb]S (384) in=40b,setxattr ZiOkXqg^PobTdZgrtZ]]l^Rap_tfSQoUQqaefj]] (69) in=40b] snapc 8=[8,7,6,5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.763657+0000", 2024-09-17T18:16:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.655569583999998, 2024-09-17T18:16:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033376057000000001, 2024-09-17T18:16:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.423 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 339 2024-09-17T18:16:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.763657+0000", 2024-09-17T18:16:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.763657+0000", 2024-09-17T18:16:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.763660+0000", 2024-09-17T18:16:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2389999999999998e-06 2024-09-17T18:16:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.763972+0000", 2024-09-17T18:16:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031217300000000001 2024-09-17T18:16:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764069+0000", 2024-09-17T18:16:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6099000000000003e-05 2024-09-17T18:16:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764094+0000", 2024-09-17T18:16:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5652000000000001e-05 2024-09-17T18:16:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764253+0000", 2024-09-17T18:16:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000159216 2024-09-17T18:16:31.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764267+0000", 2024-09-17T18:16:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.36e-05 2024-09-17T18:16:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777749+0000", 2024-09-17T18:16:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013481523 2024-09-17T18:16:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.777928+0000", 2024-09-17T18:16:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000179662 2024-09-17T18:16:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.779951+0000", 2024-09-17T18:16:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020230460000000001 2024-09-17T18:16:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.796028+0000", 2024-09-17T18:16:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016076788000000002 2024-09-17T18:16:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.796663+0000", 2024-09-17T18:16:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00063526800000000003 2024-09-17T18:16:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797033+0000", 2024-09-17T18:16:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036979100000000001 2024-09-17T18:16:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:340 3.as0 3:5b87f4c2:::smithi15432074-21:7 [read 535691~54133,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764141+0000", 2024-09-17T18:16:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.655085419999999, 2024-09-17T18:16:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.032865103999999999, 2024-09-17T18:16:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 340 2024-09-17T18:16:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.430 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764141+0000", 2024-09-17T18:16:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764141+0000", 2024-09-17T18:16:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764143+0000", 2024-09-17T18:16:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-17T18:16:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764155+0000", 2024-09-17T18:16:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1345999999999999e-05 2024-09-17T18:16:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764177+0000", 2024-09-17T18:16:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2532e-05 2024-09-17T18:16:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764193+0000", 2024-09-17T18:16:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6093e-05 2024-09-17T18:16:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764315+0000", 2024-09-17T18:16:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121931 2024-09-17T18:16:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764327+0000", 2024-09-17T18:16:31.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1423000000000001e-05 2024-09-17T18:16:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.769504+0000", 2024-09-17T18:16:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005177208 2024-09-17T18:16:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.769742+0000", 2024-09-17T18:16:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023849299999999999 2024-09-17T18:16:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.797006+0000", 2024-09-17T18:16:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027264004000000001 2024-09-17T18:16:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:341 3.as0 3:5b87f4c2:::smithi15432074-21:7 [read 0~589824,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764228+0000", 2024-09-17T18:16:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.654999074000003, 2024-09-17T18:16:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034228878999999997, 2024-09-17T18:16:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.435 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 341 2024-09-17T18:16:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764228+0000", 2024-09-17T18:16:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764228+0000", 2024-09-17T18:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764229+0000", 2024-09-17T18:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3039999999999999e-06 2024-09-17T18:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764235+0000", 2024-09-17T18:16:31.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1800000000000001e-06 2024-09-17T18:16:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764247+0000", 2024-09-17T18:16:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1736000000000001e-05 2024-09-17T18:16:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764255+0000", 2024-09-17T18:16:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2530000000000004e-06 2024-09-17T18:16:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764416+0000", 2024-09-17T18:16:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016111899999999999 2024-09-17T18:16:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764432+0000", 2024-09-17T18:16:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5846e-05 2024-09-17T18:16:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.770739+0000", 2024-09-17T18:16:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063069479999999997 2024-09-17T18:16:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.770999+0000", 2024-09-17T18:16:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025988200000000002 2024-09-17T18:16:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.798456+0000", 2024-09-17T18:16:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027457611 2024-09-17T18:16:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:342 3.as0 3:5b87f4c2:::smithi15432074-21:7 [read 0~589824,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764269+0000", 2024-09-17T18:16:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.654957152000001, 2024-09-17T18:16:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035045893000000002, 2024-09-17T18:16:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 342 2024-09-17T18:16:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.441 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764269+0000", 2024-09-17T18:16:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764269+0000", 2024-09-17T18:16:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764270+0000", 2024-09-17T18:16:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7299999999999995e-07 2024-09-17T18:16:31.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764274+0000", 2024-09-17T18:16:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0570000000000003e-06 2024-09-17T18:16:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764283+0000", 2024-09-17T18:16:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2960000000000004e-06 2024-09-17T18:16:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764291+0000", 2024-09-17T18:16:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4329999999999998e-06 2024-09-17T18:16:31.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764533+0000", 2024-09-17T18:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024180299999999999 2024-09-17T18:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764548+0000", 2024-09-17T18:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5172e-05 2024-09-17T18:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772076+0000", 2024-09-17T18:16:31.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075283499999999996 2024-09-17T18:16:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.772311+0000", 2024-09-17T18:16:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023469699999999999 2024-09-17T18:16:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.799315+0000", 2024-09-17T18:16:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027004411999999998 2024-09-17T18:16:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.445 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:349 3.as0 3:57f0af22:::smithi15432074-39:head [read 0~2572288,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764536+0000", 2024-09-17T18:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.654690907000003, 2024-09-17T18:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037750283000000003, 2024-09-17T18:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.446 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 349 2024-09-17T18:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764536+0000", 2024-09-17T18:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764536+0000", 2024-09-17T18:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764538+0000", 2024-09-17T18:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.649e-06 2024-09-17T18:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764553+0000", 2024-09-17T18:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4426999999999999e-05 2024-09-17T18:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764591+0000", 2024-09-17T18:16:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7975000000000001e-05 2024-09-17T18:16:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764614+0000", 2024-09-17T18:16:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2789000000000002e-05 2024-09-17T18:16:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764724+0000", 2024-09-17T18:16:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110418 2024-09-17T18:16:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764737+0000", 2024-09-17T18:16:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2663000000000001e-05 2024-09-17T18:16:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.773245+0000", 2024-09-17T18:16:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085088690000000005 2024-09-17T18:16:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.773462+0000", 2024-09-17T18:16:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021628399999999999 2024-09-17T18:16:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.802286+0000", 2024-09-17T18:16:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028824209 2024-09-17T18:16:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:350 3.as0 3:57f0af22:::smithi15432074-39:head [read 0~2572288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764660+0000", 2024-09-17T18:16:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.654566516000003, 2024-09-17T18:16:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.040875872000000001, 2024-09-17T18:16:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 350 2024-09-17T18:16:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764660+0000", 2024-09-17T18:16:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764660+0000", 2024-09-17T18:16:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764662+0000", 2024-09-17T18:16:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5999999999999999e-06 2024-09-17T18:16:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764670+0000", 2024-09-17T18:16:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7690000000000002e-06 2024-09-17T18:16:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764692+0000", 2024-09-17T18:16:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1852999999999999e-05 2024-09-17T18:16:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764709+0000", 2024-09-17T18:16:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6702999999999999e-05 2024-09-17T18:16:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764803+0000", 2024-09-17T18:16:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4239000000000004e-05 2024-09-17T18:16:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764816+0000", 2024-09-17T18:16:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3251999999999999e-05 2024-09-17T18:16:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.774347+0000", 2024-09-17T18:16:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095306539999999995 2024-09-17T18:16:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.774622+0000", 2024-09-17T18:16:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000275195 2024-09-17T18:16:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.805536+0000", 2024-09-17T18:16:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030913606999999999 2024-09-17T18:16:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:351 3.as0 3:57f0af22:::smithi15432074-39:head [read 0~2572288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764738+0000", 2024-09-17T18:16:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.654488145999998, 2024-09-17T18:16:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050115125000000003, 2024-09-17T18:16:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 351 2024-09-17T18:16:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764738+0000", 2024-09-17T18:16:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764738+0000", 2024-09-17T18:16:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764740+0000", 2024-09-17T18:16:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3689999999999999e-06 2024-09-17T18:16:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764752+0000", 2024-09-17T18:16:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2607e-05 2024-09-17T18:16:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764771+0000", 2024-09-17T18:16:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8759000000000001e-05 2024-09-17T18:16:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764786+0000", 2024-09-17T18:16:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4922e-05 2024-09-17T18:16:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764896+0000", 2024-09-17T18:16:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010985900000000001 2024-09-17T18:16:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764914+0000", 2024-09-17T18:16:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7963000000000001e-05 2024-09-17T18:16:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.805681+0000", 2024-09-17T18:16:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.040767202000000002 2024-09-17T18:16:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.805820+0000", 2024-09-17T18:16:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013898200000000001 2024-09-17T18:16:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.814854+0000", 2024-09-17T18:16:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090334620000000008 2024-09-17T18:16:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:355 3.as0 3:591714be:::smithi15432074-11:head [read 0~180224,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764838+0000", 2024-09-17T18:16:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.654388511000001, 2024-09-17T18:16:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050658993999999999, 2024-09-17T18:16:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 355 2024-09-17T18:16:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764838+0000", 2024-09-17T18:16:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764838+0000", 2024-09-17T18:16:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764840+0000", 2024-09-17T18:16:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6500000000000001e-06 2024-09-17T18:16:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764848+0000", 2024-09-17T18:16:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2099999999999993e-06 2024-09-17T18:16:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764867+0000", 2024-09-17T18:16:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9446e-05 2024-09-17T18:16:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764883+0000", 2024-09-17T18:16:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5116000000000001e-05 2024-09-17T18:16:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764979+0000", 2024-09-17T18:16:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6329000000000006e-05 2024-09-17T18:16:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764993+0000", 2024-09-17T18:16:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3909e-05 2024-09-17T18:16:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.807139+0000", 2024-09-17T18:16:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.042146001000000002 2024-09-17T18:16:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.807373+0000", 2024-09-17T18:16:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023453100000000001 2024-09-17T18:16:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.815497+0000", 2024-09-17T18:16:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081238019999999994 2024-09-17T18:16:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:356 3.as0 3:591714be:::smithi15432074-11:head [read 137278~42946,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764908+0000", 2024-09-17T18:16:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.654318476999997, 2024-09-17T18:16:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.051245559000000003, 2024-09-17T18:16:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 356 2024-09-17T18:16:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764908+0000", 2024-09-17T18:16:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764908+0000", 2024-09-17T18:16:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764909+0000", 2024-09-17T18:16:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.353e-06 2024-09-17T18:16:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764916+0000", 2024-09-17T18:16:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8360000000000003e-06 2024-09-17T18:16:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764934+0000", 2024-09-17T18:16:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7657000000000001e-05 2024-09-17T18:16:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764956+0000", 2024-09-17T18:16:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2452000000000001e-05 2024-09-17T18:16:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765079+0000", 2024-09-17T18:16:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012227700000000001 2024-09-17T18:16:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765095+0000", 2024-09-17T18:16:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5985999999999999e-05 2024-09-17T18:16:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.808162+0000", 2024-09-17T18:16:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.043067626999999997 2024-09-17T18:16:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.808280+0000", 2024-09-17T18:16:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118016 2024-09-17T18:16:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.816154+0000", 2024-09-17T18:16:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078733550000000003 2024-09-17T18:16:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:357 3.as0 3:591714be:::smithi15432074-11:head [read 0~180224,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-17T18:16:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:37.764981+0000", 2024-09-17T18:16:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.654245410000001, 2024-09-17T18:16:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055363373, 2024-09-17T18:16:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 357 2024-09-17T18:16:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764981+0000", 2024-09-17T18:16:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764981+0000", 2024-09-17T18:16:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764982+0000", 2024-09-17T18:16:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2359999999999999e-06 2024-09-17T18:16:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.764990+0000", 2024-09-17T18:16:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5530000000000004e-06 2024-09-17T18:16:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765008+0000", 2024-09-17T18:16:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7629e-05 2024-09-17T18:16:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765022+0000", 2024-09-17T18:16:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3947e-05 2024-09-17T18:16:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765143+0000", 2024-09-17T18:16:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121384 2024-09-17T18:16:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.765155+0000", 2024-09-17T18:16:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1712999999999999e-05 2024-09-17T18:16:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.809756+0000", 2024-09-17T18:16:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.044601190999999998 2024-09-17T18:16:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.809901+0000", 2024-09-17T18:16:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014498700000000001 2024-09-17T18:16:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:37.820345+0000", 2024-09-17T18:16:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010443733 2024-09-17T18:16:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:365 3.ds0 3:b4393ba6:::smithi15432074-18:head [copy-from ver 38] snapc 8=[8,7,6,5,4] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:16:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.771149+0000", 2024-09-17T18:16:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.648077651000001, 2024-09-17T18:16:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.042586502999999998, 2024-09-17T18:16:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 365 2024-09-17T18:16:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771149+0000", 2024-09-17T18:16:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771149+0000", 2024-09-17T18:16:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771152+0000", 2024-09-17T18:16:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-06 2024-09-17T18:16:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771167+0000", 2024-09-17T18:16:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4919000000000001e-05 2024-09-17T18:16:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771200+0000", 2024-09-17T18:16:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2515000000000003e-05 2024-09-17T18:16:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771221+0000", 2024-09-17T18:16:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1123000000000001e-05 2024-09-17T18:16:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771375+0000", 2024-09-17T18:16:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015396299999999999 2024-09-17T18:16:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771395+0000", 2024-09-17T18:16:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9868999999999999e-05 2024-09-17T18:16:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.774140+0000", 2024-09-17T18:16:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027452230000000002 2024-09-17T18:16:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.774299+0000", 2024-09-17T18:16:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015924600000000001 2024-09-17T18:16:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.796950+0000", 2024-09-17T18:16:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022650358999999998 2024-09-17T18:16:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.812885+0000", 2024-09-17T18:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015935451 2024-09-17T18:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.813546+0000", 2024-09-17T18:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066145500000000003 2024-09-17T18:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.813735+0000", 2024-09-17T18:16:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018900000000000001 2024-09-17T18:16:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:366 3.ds0 3:b4393ba6:::smithi15432074-18:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e43)", 2024-09-17T18:16:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:38.771279+0000", 2024-09-17T18:16:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.647948036999999, 2024-09-17T18:16:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033426215000000002, 2024-09-17T18:16:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 366 2024-09-17T18:16:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771279+0000", 2024-09-17T18:16:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771279+0000", 2024-09-17T18:16:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771280+0000", 2024-09-17T18:16:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6700000000000001e-06 2024-09-17T18:16:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771384+0000", 2024-09-17T18:16:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103866 2024-09-17T18:16:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771408+0000", 2024-09-17T18:16:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3489000000000002e-05 2024-09-17T18:16:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771442+0000", 2024-09-17T18:16:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4085000000000003e-05 2024-09-17T18:16:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771564+0000", 2024-09-17T18:16:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012266499999999999 2024-09-17T18:16:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.771581+0000", 2024-09-17T18:16:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7161999999999999e-05 2024-09-17T18:16:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.774574+0000", 2024-09-17T18:16:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029929290000000001 2024-09-17T18:16:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-09-17T18:16:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.774648+0000", 2024-09-17T18:16:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3326999999999998e-05 2024-09-17T18:16:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.804326+0000", 2024-09-17T18:16:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029678067999999998 2024-09-17T18:16:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.804503+0000", 2024-09-17T18:16:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017732699999999999 2024-09-17T18:16:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:38.804705+0000", 2024-09-17T18:16:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020162700000000001 2024-09-17T18:16:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:416 3.as0 3:57f0af22:::smithi15432074-39:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-17T18:16:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:45.856064+0000", 2024-09-17T18:16:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.563162167000002, 2024-09-17T18:16:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033397346000000001, 2024-09-17T18:16:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 416 2024-09-17T18:16:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856064+0000", 2024-09-17T18:16:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856064+0000", 2024-09-17T18:16:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856066+0000", 2024-09-17T18:16:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.237e-06 2024-09-17T18:16:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856071+0000", 2024-09-17T18:16:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4689999999999996e-06 2024-09-17T18:16:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856089+0000", 2024-09-17T18:16:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7506000000000001e-05 2024-09-17T18:16:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.856102+0000", 2024-09-17T18:16:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3713000000000001e-05 2024-09-17T18:16:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.875096+0000", 2024-09-17T18:16:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018993877999999999 2024-09-17T18:16:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.875228+0000", 2024-09-17T18:16:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000132065 2024-09-17T18:16:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.881248+0000", 2024-09-17T18:16:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060196520000000003 2024-09-17T18:16:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.881567+0000", 2024-09-17T18:16:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031875499999999999 2024-09-17T18:16:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:45.889462+0000", 2024-09-17T18:16:31.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007895071 2024-09-17T18:16:31.499 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.499 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.499 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.499 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:545 3.as0 3:5aa4d9c6:::smithi15432074-15:head [copy-from ver 123] snapc 12=[12,11,10,d,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T18:16:31.499 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:54.356779+0000", 2024-09-17T18:16:31.499 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.062447216999999, 2024-09-17T18:16:31.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033097537000000003, 2024-09-17T18:16:31.499 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.500 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.500 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:31.500 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.500 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.500 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.500 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 545 2024-09-17T18:16:31.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.500 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.356779+0000", 2024-09-17T18:16:31.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.356779+0000", 2024-09-17T18:16:31.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.356783+0000", 2024-09-17T18:16:31.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9330000000000003e-06 2024-09-17T18:16:31.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.356802+0000", 2024-09-17T18:16:31.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9009e-05 2024-09-17T18:16:31.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.356850+0000", 2024-09-17T18:16:31.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7895999999999997e-05 2024-09-17T18:16:31.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.356877+0000", 2024-09-17T18:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6389000000000001e-05 2024-09-17T18:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357067+0000", 2024-09-17T18:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019028799999999999 2024-09-17T18:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357086+0000", 2024-09-17T18:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9069e-05 2024-09-17T18:16:31.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.361047+0000", 2024-09-17T18:16:31.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003960819 2024-09-17T18:16:31.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.361193+0000", 2024-09-17T18:16:31.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145759 2024-09-17T18:16:31.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:31.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.382375+0000", 2024-09-17T18:16:31.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021182764 2024-09-17T18:16:31.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:31.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.388773+0000", 2024-09-17T18:16:31.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063976129999999999 2024-09-17T18:16:31.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:31.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.389751+0000", 2024-09-17T18:16:31.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00097763800000000007 2024-09-17T18:16:31.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.389877+0000", 2024-09-17T18:16:31.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012636 2024-09-17T18:16:31.506 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.506 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.506 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.506 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:547 3.ds0 3:bae030be:::smithi15432074-12:head [copy-from ver 82] snapc 12=[12,11,10,d,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T18:16:31.506 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:54.357048+0000", 2024-09-17T18:16:31.506 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.062178944999999, 2024-09-17T18:16:31.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062720789999999998, 2024-09-17T18:16:31.507 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.507 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.507 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:31.507 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.507 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.507 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.507 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 547 2024-09-17T18:16:31.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.507 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357048+0000", 2024-09-17T18:16:31.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357048+0000", 2024-09-17T18:16:31.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357049+0000", 2024-09-17T18:16:31.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3629999999999999e-06 2024-09-17T18:16:31.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357055+0000", 2024-09-17T18:16:31.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2530000000000001e-06 2024-09-17T18:16:31.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357068+0000", 2024-09-17T18:16:31.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2449999999999999e-05 2024-09-17T18:16:31.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357076+0000", 2024-09-17T18:16:31.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4659999999999999e-06 2024-09-17T18:16:31.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357191+0000", 2024-09-17T18:16:31.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001147 2024-09-17T18:16:31.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:31.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357212+0000", 2024-09-17T18:16:31.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1406000000000001e-05 2024-09-17T18:16:31.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.361032+0000", 2024-09-17T18:16:31.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038197970000000002 2024-09-17T18:16:31.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.361193+0000", 2024-09-17T18:16:31.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016107200000000001 2024-09-17T18:16:31.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:31.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.404397+0000", 2024-09-17T18:16:31.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.043203762 2024-09-17T18:16:31.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:31.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.415965+0000", 2024-09-17T18:16:31.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011568531 2024-09-17T18:16:31.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:31.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.419604+0000", 2024-09-17T18:16:31.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036381289999999999 2024-09-17T18:16:31.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.419768+0000", 2024-09-17T18:16:31.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016486100000000001 2024-09-17T18:16:31.512 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.512 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.513 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.513 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:548 3.ds0 3:bae030be:::smithi15432074-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e59)", 2024-09-17T18:16:31.513 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:54.357102+0000", 2024-09-17T18:16:31.513 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.062124633000003, 2024-09-17T18:16:31.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056672487000000001, 2024-09-17T18:16:31.513 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.513 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.513 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:31.513 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.513 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.513 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.513 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 548 2024-09-17T18:16:31.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.514 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357102+0000", 2024-09-17T18:16:31.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357102+0000", 2024-09-17T18:16:31.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357103+0000", 2024-09-17T18:16:31.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.043e-06 2024-09-17T18:16:31.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357108+0000", 2024-09-17T18:16:31.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4060000000000004e-06 2024-09-17T18:16:31.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357125+0000", 2024-09-17T18:16:31.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6543000000000001e-05 2024-09-17T18:16:31.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357139+0000", 2024-09-17T18:16:31.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3903000000000001e-05 2024-09-17T18:16:31.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357263+0000", 2024-09-17T18:16:31.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124277 2024-09-17T18:16:31.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-17T18:16:31.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.357274+0000", 2024-09-17T18:16:31.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0496000000000001e-05 2024-09-17T18:16:31.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.361448+0000", 2024-09-17T18:16:31.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041742890000000003 2024-09-17T18:16:31.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-09-17T18:16:31.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.361522+0000", 2024-09-17T18:16:31.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4274000000000001e-05 2024-09-17T18:16:31.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.413301+0000", 2024-09-17T18:16:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.051778519000000002 2024-09-17T18:16:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.413533+0000", 2024-09-17T18:16:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023213899999999999 2024-09-17T18:16:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.413774+0000", 2024-09-17T18:16:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024159800000000001 2024-09-17T18:16:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:553 3.as0 3:52022904:::smithi15432074-17:head [setxattr _header (57) in=7b] snapc 12=[12,11,10,d,a,8,7,6,5] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-17T18:16:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:54.374001+0000", 2024-09-17T18:16:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.045226077999999, 2024-09-17T18:16:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035713573999999998, 2024-09-17T18:16:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:31.520 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.520 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.520 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.520 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 553 2024-09-17T18:16:31.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.520 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374001+0000", 2024-09-17T18:16:31.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374001+0000", 2024-09-17T18:16:31.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374002+0000", 2024-09-17T18:16:31.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4330000000000001e-06 2024-09-17T18:16:31.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374012+0000", 2024-09-17T18:16:31.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0103e-05 2024-09-17T18:16:31.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374027+0000", 2024-09-17T18:16:31.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5383000000000002e-05 2024-09-17T18:16:31.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374043+0000", 2024-09-17T18:16:31.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5206e-05 2024-09-17T18:16:31.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.400787+0000", 2024-09-17T18:16:31.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026744378999999999 2024-09-17T18:16:31.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.401071+0000", 2024-09-17T18:16:31.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028405100000000001 2024-09-17T18:16:31.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:31.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.402326+0000", 2024-09-17T18:16:31.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0012549760000000001 2024-09-17T18:16:31.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:31.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.405480+0000", 2024-09-17T18:16:31.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031536860000000002 2024-09-17T18:16:31.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:31.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.409464+0000", 2024-09-17T18:16:31.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039840120000000003 2024-09-17T18:16:31.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.409714+0000", 2024-09-17T18:16:31.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025034500000000002 2024-09-17T18:16:31.525 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.525 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.525 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.525 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:554 3.as0 3:52022904:::smithi15432074-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e59)", 2024-09-17T18:16:31.525 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:15:54.374064+0000", 2024-09-17T18:16:31.525 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.045162763999997, 2024-09-17T18:16:31.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.039468334000000001, 2024-09-17T18:16:31.525 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.525 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.525 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:31.525 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.526 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.526 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.526 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 554 2024-09-17T18:16:31.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.526 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374064+0000", 2024-09-17T18:16:31.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374064+0000", 2024-09-17T18:16:31.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374065+0000", 2024-09-17T18:16:31.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5340000000000001e-06 2024-09-17T18:16:31.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374071+0000", 2024-09-17T18:16:31.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0460000000000002e-06 2024-09-17T18:16:31.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374093+0000", 2024-09-17T18:16:31.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1279000000000001e-05 2024-09-17T18:16:31.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.374108+0000", 2024-09-17T18:16:31.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5460000000000001e-05 2024-09-17T18:16:31.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.403163+0000", 2024-09-17T18:16:31.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029054592000000001 2024-09-17T18:16:31.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-17T18:16:31.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.403431+0000", 2024-09-17T18:16:31.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026833100000000002 2024-09-17T18:16:31.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.411082+0000", 2024-09-17T18:16:31.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076512749999999999 2024-09-17T18:16:31.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.411405+0000", 2024-09-17T18:16:31.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000322553 2024-09-17T18:16:31.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:15:54.413532+0000", 2024-09-17T18:16:31.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021272639999999998 2024-09-17T18:16:31.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.530 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.530 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(osd.4.23:5 3.as0 3:591714be:::smithi15432074-11:head [assert-version v148,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-17T18:16:31.530 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:20.330996+0000", 2024-09-17T18:16:31.530 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.088231059, 2024-09-17T18:16:31.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035380151999999998, 2024-09-17T18:16:31.531 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.531 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.531 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-17T18:16:31.531 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.330996+0000", 2024-09-17T18:16:31.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.330996+0000", 2024-09-17T18:16:31.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.330999+0000", 2024-09-17T18:16:31.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8539999999999999e-06 2024-09-17T18:16:31.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.331023+0000", 2024-09-17T18:16:31.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3368999999999999e-05 2024-09-17T18:16:31.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.331069+0000", 2024-09-17T18:16:31.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6016999999999997e-05 2024-09-17T18:16:31.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.331092+0000", 2024-09-17T18:16:31.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3408999999999999e-05 2024-09-17T18:16:31.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.331435+0000", 2024-09-17T18:16:31.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034274199999999999 2024-09-17T18:16:31.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-17T18:16:31.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.331459+0000", 2024-09-17T18:16:31.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3745000000000001e-05 2024-09-17T18:16:31.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.340797+0000", 2024-09-17T18:16:31.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093387209999999995 2024-09-17T18:16:31.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.341068+0000", 2024-09-17T18:16:31.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027029199999999999 2024-09-17T18:16:31.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.366376+0000", 2024-09-17T18:16:31.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025308002999999999 2024-09-17T18:16:31.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.535 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.535 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4565.0:908 3.as0 3:5aa4d9c6:::smithi15432074-15:head [copy-from ver 27] snapc 1f=[1f,1e,1d,1c,18,16,15,11,8] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-09-17T18:16:31.535 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-17T18:16:20.447655+0000", 2024-09-17T18:16:31.535 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.971571125000001, 2024-09-17T18:16:31.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.040424805000000001, 2024-09-17T18:16:31.536 INFO:teuthology.orchestra.run.smithi134.stdout: "continuous": false, 2024-09-17T18:16:31.536 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-17T18:16:31.536 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T18:16:31.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-17T18:16:31.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4565", 2024-09-17T18:16:31.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.154:0/2669990143", 2024-09-17T18:16:31.536 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 908 2024-09-17T18:16:31.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.536 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-17T18:16:31.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-17T18:16:31.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.447655+0000", 2024-09-17T18:16:31.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-17T18:16:31.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.447655+0000", 2024-09-17T18:16:31.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-17T18:16:31.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-17T18:16:31.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.447658+0000", 2024-09-17T18:16:31.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4360000000000001e-06 2024-09-17T18:16:31.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-17T18:16:31.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.447668+0000", 2024-09-17T18:16:31.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0013000000000001e-05 2024-09-17T18:16:31.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-17T18:16:31.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.447697+0000", 2024-09-17T18:16:31.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8915e-05 2024-09-17T18:16:31.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.447711+0000", 2024-09-17T18:16:31.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4583000000000001e-05 2024-09-17T18:16:31.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-17T18:16:31.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.447842+0000", 2024-09-17T18:16:31.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130846 2024-09-17T18:16:31.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-17T18:16:31.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.448199+0000", 2024-09-17T18:16:31.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00035722400000000001 2024-09-17T18:16:31.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-09-17T18:16:31.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.472329+0000", 2024-09-17T18:16:31.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024129161999999999 2024-09-17T18:16:31.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-09-17T18:16:31.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.482119+0000", 2024-09-17T18:16:31.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.009790366 2024-09-17T18:16:31.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-17T18:16:31.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.487823+0000", 2024-09-17T18:16:31.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057041790000000002 2024-09-17T18:16:31.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-17T18:16:31.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-17T18:16:31.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-17T18:16:31.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-17T18:16:20.488080+0000", 2024-09-17T18:16:31.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025708099999999999 2024-09-17T18:16:31.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.541 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-17T18:16:31.541 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-17T18:16:31.541 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-17T18:16:31.543 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T18:16:31.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:16:31.537+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:16:31.643 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:31.641+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:31.675 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:31.675 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:16:31.675 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:16:31.675 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:31.689 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T18:16:31.744 INFO:tasks.ceph.osd.13.smithi134.stderr:2024-09-17T18:16:31.741+0000 7fc73def2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26378) UID: 0 2024-09-17T18:16:31.813 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:31.813 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:16:31.813 INFO:teuthology.orchestra.run.smithi146.stdout: "complaint_time": 30, 2024-09-17T18:16:31.813 INFO:teuthology.orchestra.run.smithi146.stdout: "num_blocked_ops": 0 2024-09-17T18:16:31.813 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:31.827 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T18:16:31.872 INFO:tasks.ceph.osd.14.smithi146.stderr:2024-09-17T18:16:31.869+0000 7f7c34e94640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26369) UID: 0 2024-09-17T18:16:31.946 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-17T18:16:31.941+0000 7ffa83b2a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26371) UID: 0 2024-09-17T18:16:31.948 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:31.948 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 20, 2024-09-17T18:16:31.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 600, 2024-09-17T18:16:31.948 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [ 2024-09-17T18:16:31.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.948 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 42/31 ECSubWrite(tid=40, reqid=client.4565.0:363, at_version=42'26, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:16:31.948 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.767056+0000", 2024-09-17T18:16:31.948 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 54.176916603999999, 2024-09-17T18:16:31.948 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022714127000000001, 2024-09-17T18:16:31.948 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:31.948 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:31.949 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:31.949 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:31.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.949 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:31.949 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767056+0000", 2024-09-17T18:16:31.949 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:31.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767056+0000", 2024-09-17T18:16:31.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:31.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767057+0000", 2024-09-17T18:16:31.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.4600000000000005e-07 2024-09-17T18:16:31.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.950 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:31.950 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767098+0000", 2024-09-17T18:16:31.950 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1013000000000002e-05 2024-09-17T18:16:31.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:31.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767126+0000", 2024-09-17T18:16:31.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8399e-05 2024-09-17T18:16:31.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.951 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767150+0000", 2024-09-17T18:16:31.951 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.393e-05 2024-09-17T18:16:31.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.951 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:31.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767397+0000", 2024-09-17T18:16:31.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00024644499999999998 2024-09-17T18:16:31.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:31.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.767421+0000", 2024-09-17T18:16:31.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4643000000000001e-05 2024-09-17T18:16:31.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.952 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:31.952 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789658+0000", 2024-09-17T18:16:31.952 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.022236949999999998 2024-09-17T18:16:31.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.953 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:31.953 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789770+0000", 2024-09-17T18:16:31.953 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011220100000000001 2024-09-17T18:16:31.953 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.953 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:31.953 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.953 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 42/31 ECSubWrite(tid=15, reqid=osd.3.0:14, at_version=0'0, trim_to=0'0, roll_forward_to=42'11))", 2024-09-17T18:16:31.953 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.772587+0000", 2024-09-17T18:16:31.953 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 54.171385465, 2024-09-17T18:16:31.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.014350889, 2024-09-17T18:16:31.954 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:31.954 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:31.954 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:31.954 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:31.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:31.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772587+0000", 2024-09-17T18:16:31.954 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.954 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:31.954 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772587+0000", 2024-09-17T18:16:31.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:31.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772590+0000", 2024-09-17T18:16:31.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.137e-06 2024-09-17T18:16:31.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.955 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:31.955 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772619+0000", 2024-09-17T18:16:31.955 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9615999999999999e-05 2024-09-17T18:16:31.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:31.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772662+0000", 2024-09-17T18:16:31.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3179000000000001e-05 2024-09-17T18:16:31.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772689+0000", 2024-09-17T18:16:31.956 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7123000000000001e-05 2024-09-17T18:16:31.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.956 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:31.956 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772889+0000", 2024-09-17T18:16:31.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019974000000000001 2024-09-17T18:16:31.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:31.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772914+0000", 2024-09-17T18:16:31.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4791999999999999e-05 2024-09-17T18:16:31.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.957 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:31.957 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.786833+0000", 2024-09-17T18:16:31.957 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013919030000000001 2024-09-17T18:16:31.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.958 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:31.958 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.786938+0000", 2024-09-17T18:16:31.958 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000105272 2024-09-17T18:16:31.958 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.958 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:31.958 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.958 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 42/31 ECSubWrite(tid=41, reqid=osd.7.0:41, at_version=42'28, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:16:31.958 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.772597+0000", 2024-09-17T18:16:31.958 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 54.171375998000002, 2024-09-17T18:16:31.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.017244046999999998, 2024-09-17T18:16:31.959 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:31.959 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:31.959 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:31.959 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:31.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:31.959 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772597+0000", 2024-09-17T18:16:31.959 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.959 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:31.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772597+0000", 2024-09-17T18:16:31.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:31.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772599+0000", 2024-09-17T18:16:31.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2960000000000001e-06 2024-09-17T18:16:31.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.960 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:31.960 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772652+0000", 2024-09-17T18:16:31.960 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.2685999999999997e-05 2024-09-17T18:16:31.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:31.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772687+0000", 2024-09-17T18:16:31.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5026e-05 2024-09-17T18:16:31.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.961 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772711+0000", 2024-09-17T18:16:31.961 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3903000000000001e-05 2024-09-17T18:16:31.961 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.961 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.961 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:31.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772918+0000", 2024-09-17T18:16:31.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000207116 2024-09-17T18:16:31.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:31.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.772941+0000", 2024-09-17T18:16:31.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2940000000000001e-05 2024-09-17T18:16:31.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.962 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:31.962 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789784+0000", 2024-09-17T18:16:31.962 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.016843563999999998 2024-09-17T18:16:31.962 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.962 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.963 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:31.963 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.789841+0000", 2024-09-17T18:16:31.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6515999999999999e-05 2024-09-17T18:16:31.963 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.963 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:31.963 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.963 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.963 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.963 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 42/31 ECSubWrite(tid=42, reqid=osd.7.0:42, at_version=42'30, trim_to=0'0, roll_forward_to=41'24))", 2024-09-17T18:16:31.963 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:15:37.776416+0000", 2024-09-17T18:16:31.963 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 54.167557105999997, 2024-09-17T18:16:31.963 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.015784901, 2024-09-17T18:16:31.963 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:31.964 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:31.964 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:31.964 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:31.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:31.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776416+0000", 2024-09-17T18:16:31.964 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.964 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.964 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.964 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:31.964 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776416+0000", 2024-09-17T18:16:31.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:31.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776418+0000", 2024-09-17T18:16:31.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9190000000000002e-06 2024-09-17T18:16:31.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.965 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.965 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:31.965 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776502+0000", 2024-09-17T18:16:31.965 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.4308999999999995e-05 2024-09-17T18:16:31.965 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:31.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776548+0000", 2024-09-17T18:16:31.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6192000000000001e-05 2024-09-17T18:16:31.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.776739+0000", 2024-09-17T18:16:31.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00019082999999999999 2024-09-17T18:16:31.966 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.966 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.966 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:31.966 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.780985+0000", 2024-09-17T18:16:31.966 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0042460909999999996 2024-09-17T18:16:31.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:31.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.781000+0000", 2024-09-17T18:16:31.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5213e-05 2024-09-17T18:16:31.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:31.967 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792098+0000", 2024-09-17T18:16:31.967 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011097325 2024-09-17T18:16:31.967 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.967 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.967 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:31.968 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:15:37.792201+0000", 2024-09-17T18:16:31.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103022 2024-09-17T18:16:31.968 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.968 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:31.968 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.968 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.968 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.968 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 75/31 ECSubWrite(tid=49, reqid=osd.3.0:49, at_version=75'41, trim_to=0'0, roll_forward_to=73'37))", 2024-09-17T18:16:31.968 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.323288+0000", 2024-09-17T18:16:31.968 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.620685048999999, 2024-09-17T18:16:31.968 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010937696, 2024-09-17T18:16:31.968 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:31.969 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:31.969 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:31.969 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:31.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:31.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.323288+0000", 2024-09-17T18:16:31.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.969 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.969 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.969 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:31.969 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.323288+0000", 2024-09-17T18:16:31.969 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.323290+0000", 2024-09-17T18:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9659999999999999e-06 2024-09-17T18:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.323340+0000", 2024-09-17T18:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.0382e-05 2024-09-17T18:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.323371+0000", 2024-09-17T18:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0919e-05 2024-09-17T18:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.323394+0000", 2024-09-17T18:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2772000000000002e-05 2024-09-17T18:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.324975+0000", 2024-09-17T18:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.001581369 2024-09-17T18:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:31.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.325004+0000", 2024-09-17T18:16:31.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8319000000000001e-05 2024-09-17T18:16:31.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:31.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.334122+0000", 2024-09-17T18:16:31.972 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0091185329999999998 2024-09-17T18:16:31.972 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.972 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.972 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:31.972 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.334226+0000", 2024-09-17T18:16:31.973 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000103436 2024-09-17T18:16:31.973 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.973 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:31.973 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.973 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.973 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.973 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 75/31 ECSubWrite(tid=153, reqid=osd.7.0:153, at_version=75'141, trim_to=0'0, roll_forward_to=73'137))", 2024-09-17T18:16:31.973 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.327049+0000", 2024-09-17T18:16:31.973 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.616923423999999, 2024-09-17T18:16:31.974 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011607802, 2024-09-17T18:16:31.974 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:31.974 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:31.974 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:31.974 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:31.974 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.974 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:31.974 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327049+0000", 2024-09-17T18:16:31.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:31.975 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327049+0000", 2024-09-17T18:16:31.975 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.975 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.975 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.975 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:31.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327051+0000", 2024-09-17T18:16:31.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.7740000000000001e-06 2024-09-17T18:16:31.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.976 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.976 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:31.976 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327108+0000", 2024-09-17T18:16:31.976 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.6548000000000001e-05 2024-09-17T18:16:31.976 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:31.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327137+0000", 2024-09-17T18:16:31.977 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.8931000000000001e-05 2024-09-17T18:16:31.977 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.977 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.977 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.977 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327159+0000", 2024-09-17T18:16:31.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1968999999999999e-05 2024-09-17T18:16:31.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.978 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:31.978 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327342+0000", 2024-09-17T18:16:31.978 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00018296999999999999 2024-09-17T18:16:31.978 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.978 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:31.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.327367+0000", 2024-09-17T18:16:31.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.5802000000000001e-05 2024-09-17T18:16:31.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.979 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.979 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:31.979 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338557+0000", 2024-09-17T18:16:31.979 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011189952 2024-09-17T18:16:31.979 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.980 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.980 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:31.980 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.338657+0000", 2024-09-17T18:16:31.980 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.9856000000000001e-05 2024-09-17T18:16:31.980 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.980 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:31.980 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.980 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.981 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.981 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s3 75/31 ECSubWrite(tid=82, reqid=osd.0.0:82, at_version=75'70, trim_to=0'0, roll_forward_to=73'66))", 2024-09-17T18:16:31.981 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:10.329057+0000", 2024-09-17T18:16:31.981 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 21.614915838999998, 2024-09-17T18:16:31.981 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013499446999999999, 2024-09-17T18:16:31.981 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:31.981 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:31.981 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:31.982 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:31.982 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.982 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:31.982 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.329057+0000", 2024-09-17T18:16:31.982 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:31.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.329057+0000", 2024-09-17T18:16:31.983 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.983 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.983 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.983 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:31.983 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.329059+0000", 2024-09-17T18:16:31.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4030000000000001e-06 2024-09-17T18:16:31.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.984 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:31.984 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.329113+0000", 2024-09-17T18:16:31.984 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3498000000000002e-05 2024-09-17T18:16:31.984 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.984 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:31.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.329156+0000", 2024-09-17T18:16:31.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.3021e-05 2024-09-17T18:16:31.985 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.985 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.985 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.985 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.329179+0000", 2024-09-17T18:16:31.985 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2765999999999999e-05 2024-09-17T18:16:31.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:31.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.331556+0000", 2024-09-17T18:16:31.986 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0023774719999999998 2024-09-17T18:16:31.986 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.986 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.986 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:31.986 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.331581+0000", 2024-09-17T18:16:31.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4949000000000001e-05 2024-09-17T18:16:31.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:31.987 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.342455+0000", 2024-09-17T18:16:31.987 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010874007999999999 2024-09-17T18:16:31.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.987 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.987 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:31.988 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:10.342556+0000", 2024-09-17T18:16:31.988 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010132999999999999 2024-09-17T18:16:31.988 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.988 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:31.988 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.988 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.988 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s3 76/31 ECSubWrite(tid=85, reqid=osd.0.0:85, at_version=76'74, trim_to=0'0, roll_forward_to=75'70))", 2024-09-17T18:16:31.988 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:11.336358+0000", 2024-09-17T18:16:31.988 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 20.607615142, 2024-09-17T18:16:31.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0087486950000000008, 2024-09-17T18:16:31.989 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:31.989 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:31.989 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:31.989 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:31.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.989 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:31.989 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336358+0000", 2024-09-17T18:16:31.989 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.989 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:31.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336358+0000", 2024-09-17T18:16:31.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.990 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:31.990 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336360+0000", 2024-09-17T18:16:31.990 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.9369999999999998e-06 2024-09-17T18:16:31.990 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.990 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:31.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336415+0000", 2024-09-17T18:16:31.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5306999999999997e-05 2024-09-17T18:16:31.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:31.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336451+0000", 2024-09-17T18:16:31.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.5581999999999999e-05 2024-09-17T18:16:31.991 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.991 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.991 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.991 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336477+0000", 2024-09-17T18:16:31.991 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6735999999999999e-05 2024-09-17T18:16:31.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:31.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336815+0000", 2024-09-17T18:16:31.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00033782899999999999 2024-09-17T18:16:31.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.992 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:31.992 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.336837+0000", 2024-09-17T18:16:31.992 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2155999999999999e-05 2024-09-17T18:16:31.992 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.992 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:31.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.345000+0000", 2024-09-17T18:16:31.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0081631829999999992 2024-09-17T18:16:31.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.993 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:31.993 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:11.345106+0000", 2024-09-17T18:16:31.993 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010596500000000001 2024-09-17T18:16:31.993 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.993 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:31.993 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.993 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.993 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.994 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 85/31 ECSubWrite(tid=86, reqid=osd.3.0:86, at_version=85'69, trim_to=0'0, roll_forward_to=84'67))", 2024-09-17T18:16:31.994 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:20.343013+0000", 2024-09-17T18:16:31.994 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.600959431, 2024-09-17T18:16:31.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0097283509999999997, 2024-09-17T18:16:31.994 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:31.994 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:31.994 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:31.994 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:31.994 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.994 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:31.994 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.343013+0000", 2024-09-17T18:16:31.994 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:31.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.343013+0000", 2024-09-17T18:16:31.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:31.995 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.343014+0000", 2024-09-17T18:16:31.995 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.9999999999999997e-07 2024-09-17T18:16:31.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.995 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.995 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:31.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.343082+0000", 2024-09-17T18:16:31.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.8380999999999995e-05 2024-09-17T18:16:31.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:31.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.343107+0000", 2024-09-17T18:16:31.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4513000000000001e-05 2024-09-17T18:16:31.996 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.996 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.996 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:31.996 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.343127+0000", 2024-09-17T18:16:31.996 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0522000000000001e-05 2024-09-17T18:16:31.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:31.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.343305+0000", 2024-09-17T18:16:31.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00017706800000000001 2024-09-17T18:16:31.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:31.997 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.343332+0000", 2024-09-17T18:16:31.997 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.7679e-05 2024-09-17T18:16:31.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.997 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.997 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:31.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.352668+0000", 2024-09-17T18:16:31.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0093359949999999997 2024-09-17T18:16:31.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.998 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:31.998 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.352742+0000", 2024-09-17T18:16:31.998 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.3592999999999998e-05 2024-09-17T18:16:31.998 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.998 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:31.998 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:31.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:31.998 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.999 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.6s3 85/31 ECSubWrite(tid=120, reqid=osd.0.0:120, at_version=85'110, trim_to=0'0, roll_forward_to=84'106))", 2024-09-17T18:16:31.999 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:20.343673+0000", 2024-09-17T18:16:31.999 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.600299826000001, 2024-09-17T18:16:31.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0094491509999999994, 2024-09-17T18:16:31.999 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:31.999 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:31.999 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:31.999 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:31.999 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:31.999 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:31.999 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.343673+0000", 2024-09-17T18:16:31.999 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:31.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:32.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.343673+0000", 2024-09-17T18:16:32.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:32.000 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.343675+0000", 2024-09-17T18:16:32.000 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.4670000000000001e-06 2024-09-17T18:16:32.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.000 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.000 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:32.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.343721+0000", 2024-09-17T18:16:32.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.6022000000000001e-05 2024-09-17T18:16:32.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:32.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.343750+0000", 2024-09-17T18:16:32.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9115000000000002e-05 2024-09-17T18:16:32.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.001 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.001 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:32.001 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.343771+0000", 2024-09-17T18:16:32.001 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1046000000000001e-05 2024-09-17T18:16:32.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:32.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.344696+0000", 2024-09-17T18:16:32.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00092579299999999995 2024-09-17T18:16:32.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:32.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.344723+0000", 2024-09-17T18:16:32.002 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6033e-05 2024-09-17T18:16:32.002 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.002 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:32.002 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.353022+0000", 2024-09-17T18:16:32.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0082996179999999999 2024-09-17T18:16:32.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.003 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:32.003 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.353122+0000", 2024-09-17T18:16:32.003 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010005699999999999 2024-09-17T18:16:32.003 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.003 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:32.003 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.003 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.003 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.003 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.fs4 85/31 ECSubWrite(tid=637, reqid=osd.13.0:637, at_version=85'42, trim_to=0'0, roll_forward_to=84'40))", 2024-09-17T18:16:32.003 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:20.345130+0000", 2024-09-17T18:16:32.003 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 11.598842947, 2024-09-17T18:16:32.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0099167060000000008, 2024-09-17T18:16:32.004 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:32.004 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:32.004 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:32.004 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:32.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:32.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.345130+0000", 2024-09-17T18:16:32.004 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.004 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.004 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.004 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:32.004 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.345130+0000", 2024-09-17T18:16:32.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:32.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.345131+0000", 2024-09-17T18:16:32.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6300000000000005e-07 2024-09-17T18:16:32.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.005 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:32.005 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.345189+0000", 2024-09-17T18:16:32.005 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8825e-05 2024-09-17T18:16:32.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.005 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:32.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.345220+0000", 2024-09-17T18:16:32.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0088999999999999e-05 2024-09-17T18:16:32.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:32.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.345242+0000", 2024-09-17T18:16:32.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2028999999999999e-05 2024-09-17T18:16:32.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.006 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.006 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:32.006 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.345477+0000", 2024-09-17T18:16:32.006 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00023520299999999999 2024-09-17T18:16:32.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:32.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.345506+0000", 2024-09-17T18:16:32.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9238999999999999e-05 2024-09-17T18:16:32.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:32.007 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.354937+0000", 2024-09-17T18:16:32.007 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0094305569999999991 2024-09-17T18:16:32.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.007 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.007 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:32.008 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:20.355047+0000", 2024-09-17T18:16:32.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00011010099999999999 2024-09-17T18:16:32.008 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.008 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:32.008 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.008 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.008 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.008 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.3s5 86/31 ECSubWrite(tid=130, reqid=osd.10.0:130, at_version=86'69, trim_to=0'0, roll_forward_to=85'67))", 2024-09-17T18:16:32.008 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:21.341553+0000", 2024-09-17T18:16:32.008 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.602420372999999, 2024-09-17T18:16:32.008 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011068484, 2024-09-17T18:16:32.008 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:32.008 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:32.008 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:32.009 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:32.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:32.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.341553+0000", 2024-09-17T18:16:32.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:32.009 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.341553+0000", 2024-09-17T18:16:32.009 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.009 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.009 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:32.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.341553+0000", 2024-09-17T18:16:32.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.5700000000000002e-07 2024-09-17T18:16:32.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:32.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.341647+0000", 2024-09-17T18:16:32.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.3389999999999999e-05 2024-09-17T18:16:32.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.010 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.010 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:32.010 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.341683+0000", 2024-09-17T18:16:32.010 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6149000000000002e-05 2024-09-17T18:16:32.010 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:32.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.341708+0000", 2024-09-17T18:16:32.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4762000000000001e-05 2024-09-17T18:16:32.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:32.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.341928+0000", 2024-09-17T18:16:32.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00022022 2024-09-17T18:16:32.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.011 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.011 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:32.011 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.341957+0000", 2024-09-17T18:16:32.011 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.9122e-05 2024-09-17T18:16:32.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:32.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.352534+0000", 2024-09-17T18:16:32.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010577414 2024-09-17T18:16:32.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.012 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.012 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:32.012 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.352621+0000", 2024-09-17T18:16:32.012 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6669999999999995e-05 2024-09-17T18:16:32.012 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.012 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:32.012 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.013 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.fs4 86/31 ECSubWrite(tid=650, reqid=osd.13.0:650, at_version=86'44, trim_to=0'0, roll_forward_to=85'42))", 2024-09-17T18:16:32.013 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:21.345019+0000", 2024-09-17T18:16:32.013 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.598953514, 2024-09-17T18:16:32.013 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012607202, 2024-09-17T18:16:32.013 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:32.013 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:32.013 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:32.013 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:32.013 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:32.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.345019+0000", 2024-09-17T18:16:32.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:32.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.345019+0000", 2024-09-17T18:16:32.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.014 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.014 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.014 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:32.014 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.345020+0000", 2024-09-17T18:16:32.014 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.47e-07 2024-09-17T18:16:32.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:32.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.345079+0000", 2024-09-17T18:16:32.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.8488e-05 2024-09-17T18:16:32.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:32.015 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.345120+0000", 2024-09-17T18:16:32.015 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.1078999999999998e-05 2024-09-17T18:16:32.015 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.015 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.015 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:32.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.345146+0000", 2024-09-17T18:16:32.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6109e-05 2024-09-17T18:16:32.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:32.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.345350+0000", 2024-09-17T18:16:32.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00020436299999999999 2024-09-17T18:16:32.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.016 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.016 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:32.016 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.345381+0000", 2024-09-17T18:16:32.016 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0485999999999999e-05 2024-09-17T18:16:32.016 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:32.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.357560+0000", 2024-09-17T18:16:32.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.012179526 2024-09-17T18:16:32.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.017 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.017 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:32.017 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.357627+0000", 2024-09-17T18:16:32.017 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.6303999999999994e-05 2024-09-17T18:16:32.017 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.017 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:32.017 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.018 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 86/31 ECSubWrite(tid=89, reqid=client.4565.0:930, at_version=86'73, trim_to=0'0, roll_forward_to=85'71))", 2024-09-17T18:16:32.018 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:21.353281+0000", 2024-09-17T18:16:32.018 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.590692006999999, 2024-09-17T18:16:32.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013566326, 2024-09-17T18:16:32.018 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:32.018 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:32.018 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:32.018 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:32.018 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.018 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:32.018 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353281+0000", 2024-09-17T18:16:32.018 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:32.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353281+0000", 2024-09-17T18:16:32.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:32.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353282+0000", 2024-09-17T18:16:32.019 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1400000000000001e-06 2024-09-17T18:16:32.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.019 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.019 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:32.019 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353368+0000", 2024-09-17T18:16:32.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.6316999999999994e-05 2024-09-17T18:16:32.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:32.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353393+0000", 2024-09-17T18:16:32.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.4502e-05 2024-09-17T18:16:32.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.020 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:32.020 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353414+0000", 2024-09-17T18:16:32.020 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.1092999999999999e-05 2024-09-17T18:16:32.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.020 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:32.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353680+0000", 2024-09-17T18:16:32.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.000266202 2024-09-17T18:16:32.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:32.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353707+0000", 2024-09-17T18:16:32.021 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6995000000000002e-05 2024-09-17T18:16:32.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.021 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.021 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:32.021 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.366764+0000", 2024-09-17T18:16:32.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013056626999999999 2024-09-17T18:16:32.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.022 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:32.022 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.366847+0000", 2024-09-17T18:16:32.022 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.3449999999999996e-05 2024-09-17T18:16:32.022 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.022 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:32.022 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.022 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 86/31 ECSubWrite(tid=90, reqid=client.4565.0:931, at_version=86'74, trim_to=0'0, roll_forward_to=85'71))", 2024-09-17T18:16:32.022 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:21.353468+0000", 2024-09-17T18:16:32.023 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.590504776, 2024-09-17T18:16:32.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013428750999999999, 2024-09-17T18:16:32.023 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:32.023 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:32.023 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:32.023 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:32.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:32.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353468+0000", 2024-09-17T18:16:32.023 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.023 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:32.023 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353468+0000", 2024-09-17T18:16:32.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:32.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353469+0000", 2024-09-17T18:16:32.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.046e-06 2024-09-17T18:16:32.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.024 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:32.024 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353506+0000", 2024-09-17T18:16:32.024 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6959000000000003e-05 2024-09-17T18:16:32.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:32.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353528+0000", 2024-09-17T18:16:32.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2308999999999999e-05 2024-09-17T18:16:32.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:32.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353546+0000", 2024-09-17T18:16:32.025 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.8003e-05 2024-09-17T18:16:32.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.025 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:32.025 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.360117+0000", 2024-09-17T18:16:32.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0065709940000000001 2024-09-17T18:16:32.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:32.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.360127+0000", 2024-09-17T18:16:32.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.7100000000000002e-06 2024-09-17T18:16:32.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.026 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:32.026 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.366861+0000", 2024-09-17T18:16:32.026 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.006733607 2024-09-17T18:16:32.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.027 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:32.027 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.366897+0000", 2024-09-17T18:16:32.027 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.6123e-05 2024-09-17T18:16:32.027 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.027 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:32.027 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.027 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 86/31 ECSubWrite(tid=91, reqid=client.4565.0:932, at_version=86'75, trim_to=0'0, roll_forward_to=85'71))", 2024-09-17T18:16:32.027 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:21.353574+0000", 2024-09-17T18:16:32.027 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.590398877, 2024-09-17T18:16:32.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.013664246999999999, 2024-09-17T18:16:32.028 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:32.028 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:32.028 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:32.028 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:32.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:32.028 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353574+0000", 2024-09-17T18:16:32.028 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.028 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:32.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353574+0000", 2024-09-17T18:16:32.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:32.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353575+0000", 2024-09-17T18:16:32.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2999999999999999e-07 2024-09-17T18:16:32.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.029 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:32.029 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353628+0000", 2024-09-17T18:16:32.029 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.3072000000000003e-05 2024-09-17T18:16:32.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:32.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353649+0000", 2024-09-17T18:16:32.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.0956000000000001e-05 2024-09-17T18:16:32.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:32.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.353665+0000", 2024-09-17T18:16:32.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.5879000000000002e-05 2024-09-17T18:16:32.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.030 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:32.030 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.362878+0000", 2024-09-17T18:16:32.030 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0092128750000000006 2024-09-17T18:16:32.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:32.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.362887+0000", 2024-09-17T18:16:32.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.9250000000000001e-06 2024-09-17T18:16:32.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:32.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.367156+0000", 2024-09-17T18:16:32.031 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0042697890000000004 2024-09-17T18:16:32.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.031 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:32.031 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.367238+0000", 2024-09-17T18:16:32.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.1921000000000004e-05 2024-09-17T18:16:32.032 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.032 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:32.032 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.032 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 86/31 ECSubWrite(tid=92, reqid=osd.3.0:92, at_version=86'77, trim_to=0'0, roll_forward_to=85'71))", 2024-09-17T18:16:32.032 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:21.358021+0000", 2024-09-17T18:16:32.032 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.585951785000001, 2024-09-17T18:16:32.032 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0092885320000000004, 2024-09-17T18:16:32.032 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:32.032 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:32.032 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:32.032 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:32.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:32.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.358021+0000", 2024-09-17T18:16:32.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:32.033 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.358021+0000", 2024-09-17T18:16:32.033 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.033 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:32.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.358022+0000", 2024-09-17T18:16:32.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.181e-06 2024-09-17T18:16:32.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:32.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.358046+0000", 2024-09-17T18:16:32.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.3853e-05 2024-09-17T18:16:32.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.034 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:32.034 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.358417+0000", 2024-09-17T18:16:32.034 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00037084299999999999 2024-09-17T18:16:32.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:32.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.358433+0000", 2024-09-17T18:16:32.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.615e-05 2024-09-17T18:16:32.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:32.035 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.363185+0000", 2024-09-17T18:16:32.035 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0047522859999999997 2024-09-17T18:16:32.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.035 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:32.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.363195+0000", 2024-09-17T18:16:32.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.1430000000000004e-06 2024-09-17T18:16:32.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:32.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.367244+0000", 2024-09-17T18:16:32.036 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0040497989999999998 2024-09-17T18:16:32.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.036 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.036 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:32.036 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.367310+0000", 2024-09-17T18:16:32.037 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.5277000000000005e-05 2024-09-17T18:16:32.037 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.037 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:32.037 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.037 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.037 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.9s1 86/31 ECSubWrite(tid=194, reqid=osd.7.0:194, at_version=86'190, trim_to=0'0, roll_forward_to=85'186))", 2024-09-17T18:16:32.037 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:21.362074+0000", 2024-09-17T18:16:32.038 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.581899199, 2024-09-17T18:16:32.038 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010871422, 2024-09-17T18:16:32.038 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:32.038 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:32.038 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:32.038 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:32.038 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:32.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.362074+0000", 2024-09-17T18:16:32.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.039 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.039 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:32.039 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.362074+0000", 2024-09-17T18:16:32.039 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:32.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.362075+0000", 2024-09-17T18:16:32.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.1370000000000001e-06 2024-09-17T18:16:32.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:32.040 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.362105+0000", 2024-09-17T18:16:32.040 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.0144000000000001e-05 2024-09-17T18:16:32.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.040 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.040 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:32.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.362612+0000", 2024-09-17T18:16:32.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00050711400000000002 2024-09-17T18:16:32.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:32.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.362622+0000", 2024-09-17T18:16:32.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.01e-05 2024-09-17T18:16:32.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.041 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.041 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:32.041 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.362751+0000", 2024-09-17T18:16:32.041 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00012865399999999999 2024-09-17T18:16:32.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:32.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.362757+0000", 2024-09-17T18:16:32.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.4289999999999998e-06 2024-09-17T18:16:32.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:32.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.372850+0000", 2024-09-17T18:16:32.042 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.010092336 2024-09-17T18:16:32.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.042 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:32.042 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.372945+0000", 2024-09-17T18:16:32.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 9.5507999999999994e-05 2024-09-17T18:16:32.043 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.043 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:32.043 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.043 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 86/31 ECSubWrite(tid=93, reqid=osd.3.0:93, at_version=86'79, trim_to=0'0, roll_forward_to=85'71))", 2024-09-17T18:16:32.043 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:21.364435+0000", 2024-09-17T18:16:32.043 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 10.579538315000001, 2024-09-17T18:16:32.043 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0091243479999999991, 2024-09-17T18:16:32.043 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:32.043 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:32.043 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:32.043 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:32.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:32.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.364435+0000", 2024-09-17T18:16:32.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.044 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:32.044 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.364435+0000", 2024-09-17T18:16:32.044 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:32.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.364437+0000", 2024-09-17T18:16:32.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.813e-06 2024-09-17T18:16:32.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:32.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.364492+0000", 2024-09-17T18:16:32.045 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 5.5047999999999999e-05 2024-09-17T18:16:32.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.045 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:32.045 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.364526+0000", 2024-09-17T18:16:32.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3602000000000001e-05 2024-09-17T18:16:32.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:32.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.364549+0000", 2024-09-17T18:16:32.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.2762999999999999e-05 2024-09-17T18:16:32.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:32.046 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.365152+0000", 2024-09-17T18:16:32.046 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00060289499999999999 2024-09-17T18:16:32.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.046 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:32.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.365163+0000", 2024-09-17T18:16:32.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 1.0821e-05 2024-09-17T18:16:32.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:32.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.373482+0000", 2024-09-17T18:16:32.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0083197549999999999 2024-09-17T18:16:32.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.047 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:32.047 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:21.373559+0000", 2024-09-17T18:16:32.047 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 7.6650999999999995e-05 2024-09-17T18:16:32.047 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.048 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:32.048 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.048 INFO:teuthology.orchestra.run.smithi146.stdout: "description": "MOSDECSubOpWrite(3.0s3 91/31 ECSubWrite(tid=97, reqid=osd.3.0:97, at_version=91'83, trim_to=0'0, roll_forward_to=88'81))", 2024-09-17T18:16:32.048 INFO:teuthology.orchestra.run.smithi146.stdout: "initiated_at": "2024-09-17T18:16:26.380453+0000", 2024-09-17T18:16:32.048 INFO:teuthology.orchestra.run.smithi146.stdout: "age": 5.563519737, 2024-09-17T18:16:32.048 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.011675118, 2024-09-17T18:16:32.048 INFO:teuthology.orchestra.run.smithi146.stdout: "continuous": false, 2024-09-17T18:16:32.048 INFO:teuthology.orchestra.run.smithi146.stdout: "type_data": { 2024-09-17T18:16:32.048 INFO:teuthology.orchestra.run.smithi146.stdout: "flag_point": "reached pg", 2024-09-17T18:16:32.049 INFO:teuthology.orchestra.run.smithi146.stdout: "events": [ 2024-09-17T18:16:32.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.049 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "initiated", 2024-09-17T18:16:32.049 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:26.380453+0000", 2024-09-17T18:16:32.049 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "header_read", 2024-09-17T18:16:32.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:26.380453+0000", 2024-09-17T18:16:32.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0 2024-09-17T18:16:32.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "throttled", 2024-09-17T18:16:32.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:26.380454+0000", 2024-09-17T18:16:32.050 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 8.2600000000000001e-07 2024-09-17T18:16:32.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.050 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "all_read", 2024-09-17T18:16:32.050 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:26.380514+0000", 2024-09-17T18:16:32.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 6.0142000000000001e-05 2024-09-17T18:16:32.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "dispatched", 2024-09-17T18:16:32.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:26.380547+0000", 2024-09-17T18:16:32.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 3.3009000000000002e-05 2024-09-17T18:16:32.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "queued_for_pg", 2024-09-17T18:16:32.051 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:26.380597+0000", 2024-09-17T18:16:32.051 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 4.9539000000000001e-05 2024-09-17T18:16:32.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.051 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "reached_pg", 2024-09-17T18:16:32.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:26.383323+0000", 2024-09-17T18:16:32.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0027264009999999998 2024-09-17T18:16:32.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_started", 2024-09-17T18:16:32.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:26.383349+0000", 2024-09-17T18:16:32.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 2.6239999999999999e-05 2024-09-17T18:16:32.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.052 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "sub_op_committed", 2024-09-17T18:16:32.052 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:26.392028+0000", 2024-09-17T18:16:32.052 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.0086782609999999996 2024-09-17T18:16:32.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T18:16:32.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T18:16:32.053 INFO:teuthology.orchestra.run.smithi146.stdout: "event": "done", 2024-09-17T18:16:32.053 INFO:teuthology.orchestra.run.smithi146.stdout: "time": "2024-09-17T18:16:26.392128+0000", 2024-09-17T18:16:32.053 INFO:teuthology.orchestra.run.smithi146.stdout: "duration": 0.00010069999999999999 2024-09-17T18:16:32.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.053 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:32.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T18:16:32.053 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T18:16:32.053 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:32.054 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T18:16:32.056 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T18:16:32.056 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-09-17T18:16:32.053+0000 7f58de8b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26600) UID: 0 2024-09-17T18:16:32.156 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-17T18:16:32.153+0000 7f94e837d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26373) UID: 0 2024-09-17T18:16:32.212 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0: {} 2024-09-17T18:16:32.213 INFO:teuthology.orchestra.run.smithi087.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T18:16:32.227 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T18:16:32.227 INFO:teuthology.orchestra.run.smithi146.stdout: "ops": [], 2024-09-17T18:16:32.228 INFO:teuthology.orchestra.run.smithi146.stdout: "num_ops": 0 2024-09-17T18:16:32.228 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T18:16:32.233 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1: {} 2024-09-17T18:16:32.233 INFO:teuthology.orchestra.run.smithi087.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T18:16:32.242 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T18:16:32.253 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2: {} 2024-09-17T18:16:32.253 INFO:teuthology.orchestra.run.smithi087.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T18:16:32.257 INFO:tasks.ceph.osd.12.smithi087.stderr:2024-09-17T18:16:32.252+0000 7fa0d4a11640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26453) UID: 0 2024-09-17T18:16:32.274 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3: {} 2024-09-17T18:16:32.274 INFO:teuthology.orchestra.run.smithi087.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T18:16:32.291 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4: {} 2024-09-17T18:16:32.292 INFO:teuthology.orchestra.run.smithi087.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T18:16:32.312 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5: {} 2024-09-17T18:16:32.312 INFO:teuthology.orchestra.run.smithi087.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T18:16:32.332 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6: {} 2024-09-17T18:16:32.332 INFO:teuthology.orchestra.run.smithi087.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T18:16:32.353 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7: {} 2024-09-17T18:16:32.353 INFO:teuthology.orchestra.run.smithi087.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T18:16:32.357 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-17T18:16:32.352+0000 7f161c6b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26446) UID: 0 2024-09-17T18:16:32.359 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:32.359 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:32.372 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8: {} 2024-09-17T18:16:32.372 INFO:teuthology.orchestra.run.smithi087.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T18:16:32.373 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T18:16:32.389 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T18:16:32.395 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9: {} 2024-09-17T18:16:32.395 INFO:teuthology.orchestra.run.smithi087.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T18:16:32.409 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'unique_pool_0' removed 2024-09-17T18:16:32.416 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10: {} 2024-09-17T18:16:32.417 INFO:teuthology.orchestra.run.smithi087.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T18:16:32.433 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-17T18:16:32.443 INFO:tasks.thrashosds:joining thrashosds 2024-09-17T18:16:32.454 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11: {} 2024-09-17T18:16:32.454 INFO:teuthology.orchestra.run.smithi087.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T18:16:32.470 INFO:teuthology.orchestra.run.smithi087.stdout:osd.12: {} 2024-09-17T18:16:32.471 INFO:teuthology.orchestra.run.smithi087.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T18:16:32.491 INFO:teuthology.orchestra.run.smithi087.stdout:osd.13: {} 2024-09-17T18:16:32.491 INFO:teuthology.orchestra.run.smithi087.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T18:16:32.504 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:32.504 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:32.509 INFO:teuthology.orchestra.run.smithi087.stdout:osd.14: {} 2024-09-17T18:16:32.509 INFO:teuthology.orchestra.run.smithi087.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T18:16:32.519 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T18:16:32.536 INFO:teuthology.orchestra.run.smithi087.stdout:osd.15: {} 2024-09-17T18:16:32.536 INFO:teuthology.orchestra.run.smithi087.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T18:16:32.638 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:32.638 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:32.652 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T18:16:32.776 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:32.776 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:32.790 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T18:16:32.913 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:32.913 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:32.927 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T18:16:33.050 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:33.051 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:33.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T18:16:33.187 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:33.187 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:33.201 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T18:16:33.319 INFO:teuthology.orchestra.run.smithi146.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:33.319 INFO:teuthology.orchestra.run.smithi146.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:33.334 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T18:16:33.418 INFO:teuthology.orchestra.run.smithi087.stderr:nodeep-scrub is unset 2024-09-17T18:16:33.466 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:33.467 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:33.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T18:16:33.604 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:33.604 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:33.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T18:16:33.735 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:33.735 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:33.750 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T18:16:33.866 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:33.866 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:33.881 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T18:16:34.004 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:34.004 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:34.018 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T18:16:34.136 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:34.137 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:34.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T18:16:34.269 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:34.269 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:34.283 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T18:16:34.398 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:34.398 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:34.411 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T18:16:34.522 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:34.522 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:34.535 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T18:16:34.654 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:34.654 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:34.668 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T18:16:34.785 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:34.785 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:34.799 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T18:16:34.916 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T18:16:34.916 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T18:16:35.445 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T18:16:36.437 INFO:teuthology.orchestra.run.smithi087.stderr:noscrub is unset 2024-09-17T18:16:36.463 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T18:16:37.434 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-17T18:16:37.447 INFO:teuthology.orchestra.run.smithi087.stderr:nodeep-scrub is unset 2024-09-17T18:16:37.576 INFO:teuthology.orchestra.run.smithi087.stdout:mon.a: {} 2024-09-17T18:16:37.577 INFO:teuthology.orchestra.run.smithi087.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T18:16:37.589 INFO:teuthology.orchestra.run.smithi087.stdout:mon.b: {} 2024-09-17T18:16:37.590 INFO:teuthology.orchestra.run.smithi087.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T18:16:37.604 INFO:teuthology.orchestra.run.smithi087.stdout:mon.c: {} 2024-09-17T18:16:37.604 INFO:teuthology.orchestra.run.smithi087.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T18:16:37.621 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-17T18:16:38.455 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.0 to 1 (10000) 2024-09-17T18:16:38.482 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-17T18:16:39.458 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-17T18:16:39.486 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-17T18:16:40.476 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.4 to 1 (10000) 2024-09-17T18:16:40.502 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-17T18:16:41.478 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-17T18:16:41.505 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 8 1 2024-09-17T18:16:42.496 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.8 to 1 (10000) 2024-09-17T18:16:42.520 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 8 1 2024-09-17T18:16:43.497 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.8 primary-affinity to 1 (8655362) 2024-09-17T18:16:43.524 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 12 1 2024-09-17T18:16:44.506 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.12 to 1 (10000) 2024-09-17T18:16:44.531 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 12 1 2024-09-17T18:16:45.516 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.12 primary-affinity to 1 (8655362) 2024-09-17T18:16:45.540 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-17T18:16:46.531 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.1 to 1 (10000) 2024-09-17T18:16:46.554 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-17T18:16:47.540 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-17T18:16:47.567 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-17T18:16:48.552 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.5 to 1 (10000) 2024-09-17T18:16:48.581 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-17T18:16:49.555 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-17T18:16:49.581 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 9 1 2024-09-17T18:16:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.9 to 1 (10000) 2024-09-17T18:16:50.589 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 9 1 2024-09-17T18:16:51.576 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.9 primary-affinity to 1 (8655362) 2024-09-17T18:16:51.602 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 13 1 2024-09-17T18:16:52.587 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.13 to 1 (10000) 2024-09-17T18:16:52.614 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 13 1 2024-09-17T18:16:53.599 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.13 primary-affinity to 1 (8655362) 2024-09-17T18:16:53.623 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-17T18:16:54.610 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.2 to 1 (10000) 2024-09-17T18:16:54.634 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-17T18:16:55.621 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-17T18:16:55.645 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-17T18:16:56.631 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.6 to 1 (10000) 2024-09-17T18:16:56.655 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-17T18:16:57.641 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-17T18:16:57.667 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 10 1 2024-09-17T18:16:58.661 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.10 to 1 (10000) 2024-09-17T18:16:58.684 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 10 1 2024-09-17T18:16:59.671 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.10 primary-affinity to 1 (8655362) 2024-09-17T18:16:59.695 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 14 1 2024-09-17T18:17:00.673 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.14 to 1 (10000) 2024-09-17T18:17:00.699 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 14 1 2024-09-17T18:17:01.685 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.14 primary-affinity to 1 (8655362) 2024-09-17T18:17:01.715 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-17T18:17:02.700 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.3 to 1 (10000) 2024-09-17T18:17:02.723 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-17T18:17:03.710 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-17T18:17:03.736 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-17T18:17:04.713 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.7 to 1 (10000) 2024-09-17T18:17:04.738 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-17T18:17:05.724 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-17T18:17:05.757 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 11 1 2024-09-17T18:17:06.734 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.11 to 1 (10000) 2024-09-17T18:17:06.760 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 11 1 2024-09-17T18:17:07.758 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.11 primary-affinity to 1 (8655362) 2024-09-17T18:17:07.784 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 15 1 2024-09-17T18:17:08.761 INFO:teuthology.orchestra.run.smithi087.stderr:reweighted osd.15 to 1 (10000) 2024-09-17T18:17:08.785 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 15 1 2024-09-17T18:17:09.772 INFO:teuthology.orchestra.run.smithi087.stderr:set osd.15 primary-affinity to 1 (8655362) 2024-09-17T18:17:09.798 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-17T18:17:09.798 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-17T18:17:09.798 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-17T18:17:09.798 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-17T18:17:09.798 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T18:17:09.799 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T18:17:10.104 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:17:10.104 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":133,"fsid":"61bbf164-0ac7-4613-95ea-b1c3bf551ccb","created":"2024-09-17T18:14:58.620399+0000","modified":"2024-09-17T18:17:09.768918+0000","last_up_change":"2024-09-17T18:15:12.533086+0000","last_in_change":"2024-09-17T18:15:03.053866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T18:15:11.543279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T18:15:13.520321+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15f80e97-3ed0-4557-b1f4-7ffa88c188dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6803","nonce":2391985960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6805","nonce":2391985960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6809","nonce":2391985960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6807","nonce":2391985960}]},"public_addr":"172.21.15.87:6803/2391985960","cluster_addr":"172.21.15.87:6805/2391985960","heartbeat_back_addr":"172.21.15.87:6809/2391985960","heartbeat_front_addr":"172.21.15.87:6807/2391985960","state":["exists","up"]},{"osd":1,"uuid":"a9b255d0-e8d9-4d9a-9118-742dc2ac013f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6817","nonce":692679878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6819","nonce":692679878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6823","nonce":692679878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6821","nonce":692679878}]},"public_addr":"172.21.15.134:6817/692679878","cluster_addr":"172.21.15.134:6819/692679878","heartbeat_back_addr":"172.21.15.134:6823/692679878","heartbeat_front_addr":"172.21.15.134:6821/692679878","state":["exists","up"]},{"osd":2,"uuid":"76ad6be0-c351-4265-893f-cec4a82ecd76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6825","nonce":197002546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6827","nonce":197002546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6831","nonce":197002546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6829","nonce":197002546}]},"public_addr":"172.21.15.146:6825/197002546","cluster_addr":"172.21.15.146:6827/197002546","heartbeat_back_addr":"172.21.15.146:6831/197002546","heartbeat_front_addr":"172.21.15.146:6829/197002546","state":["exists","up"]},{"osd":3,"uuid":"325d4c94-b21d-48cd-8f47-446e6a8bcbcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6817","nonce":450535216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6819","nonce":450535216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6823","nonce":450535216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6821","nonce":450535216}]},"public_addr":"172.21.15.154:6817/450535216","cluster_addr":"172.21.15.154:6819/450535216","heartbeat_back_addr":"172.21.15.154:6823/450535216","heartbeat_front_addr":"172.21.15.154:6821/450535216","state":["exists","up"]},{"osd":4,"uuid":"58b12ec9-29f5-4fea-a835-594fe03cd376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6827","nonce":1911207814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6829","nonce":1911207814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6833","nonce":1911207814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6831","nonce":1911207814}]},"public_addr":"172.21.15.87:6827/1911207814","cluster_addr":"172.21.15.87:6829/1911207814","heartbeat_back_addr":"172.21.15.87:6833/1911207814","heartbeat_front_addr":"172.21.15.87:6831/1911207814","state":["exists","up"]},{"osd":5,"uuid":"27d3075f-32f4-4032-b0d4-fb7604c8bfda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6825","nonce":391215769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6827","nonce":391215769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6831","nonce":391215769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6829","nonce":391215769}]},"public_addr":"172.21.15.134:6825/391215769","cluster_addr":"172.21.15.134:6827/391215769","heartbeat_back_addr":"172.21.15.134:6831/391215769","heartbeat_front_addr":"172.21.15.134:6829/391215769","state":["exists","up"]},{"osd":6,"uuid":"4326073e-338d-47f1-9860-5e44455f49ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6801","nonce":1495925642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6803","nonce":1495925642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6807","nonce":1495925642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6805","nonce":1495925642}]},"public_addr":"172.21.15.146:6801/1495925642","cluster_addr":"172.21.15.146:6803/1495925642","heartbeat_back_addr":"172.21.15.146:6807/1495925642","heartbeat_front_addr":"172.21.15.146:6805/1495925642","state":["exists","up"]},{"osd":7,"uuid":"455a2636-b754-4e1f-8933-16cd3fc126fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6809","nonce":3979156181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6811","nonce":3979156181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6815","nonce":3979156181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6813","nonce":3979156181}]},"public_addr":"172.21.15.154:6809/3979156181","cluster_addr":"172.21.15.154:6811/3979156181","heartbeat_back_addr":"172.21.15.154:6815/3979156181","heartbeat_front_addr":"172.21.15.154:6813/3979156181","state":["exists","up"]},{"osd":8,"uuid":"e64c05c6-2dce-4abc-8693-3e06b69723b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6819","nonce":740946583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6821","nonce":740946583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6825","nonce":740946583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6823","nonce":740946583}]},"public_addr":"172.21.15.87:6819/740946583","cluster_addr":"172.21.15.87:6821/740946583","heartbeat_back_addr":"172.21.15.87:6825/740946583","heartbeat_front_addr":"172.21.15.87:6823/740946583","state":["exists","up"]},{"osd":9,"uuid":"10bcf7b0-b22d-4a33-b090-b3c8083b6445","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6809","nonce":2811218890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6811","nonce":2811218890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6815","nonce":2811218890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6813","nonce":2811218890}]},"public_addr":"172.21.15.134:6809/2811218890","cluster_addr":"172.21.15.134:6811/2811218890","heartbeat_back_addr":"172.21.15.134:6815/2811218890","heartbeat_front_addr":"172.21.15.134:6813/2811218890","state":["exists","up"]},{"osd":10,"uuid":"a69d3d5e-353a-41aa-8b1c-fe7b0a68865f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6817","nonce":1660646458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6819","nonce":1660646458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6823","nonce":1660646458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6821","nonce":1660646458}]},"public_addr":"172.21.15.146:6817/1660646458","cluster_addr":"172.21.15.146:6819/1660646458","heartbeat_back_addr":"172.21.15.146:6823/1660646458","heartbeat_front_addr":"172.21.15.146:6821/1660646458","state":["exists","up"]},{"osd":11,"uuid":"0a0e715b-1804-4e14-87e1-8c5de231b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6801","nonce":2080834051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6803","nonce":2080834051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6807","nonce":2080834051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6805","nonce":2080834051}]},"public_addr":"172.21.15.154:6801/2080834051","cluster_addr":"172.21.15.154:6803/2080834051","heartbeat_back_addr":"172.21.15.154:6807/2080834051","heartbeat_front_addr":"172.21.15.154:6805/2080834051","state":["exists","up"]},{"osd":12,"uuid":"bdb1a692-4d6e-4a0c-a21f-db10b3af5025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6811","nonce":249183944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6813","nonce":249183944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6817","nonce":249183944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6815","nonce":249183944}]},"public_addr":"172.21.15.87:6811/249183944","cluster_addr":"172.21.15.87:6813/249183944","heartbeat_back_addr":"172.21.15.87:6817/249183944","heartbeat_front_addr":"172.21.15.87:6815/249183944","state":["exists","up"]},{"osd":13,"uuid":"225fb253-25c2-4a10-a169-97971cb06e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6801","nonce":3397465529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6803","nonce":3397465529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6807","nonce":3397465529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6805","nonce":3397465529}]},"public_addr":"172.21.15.134:6801/3397465529","cluster_addr":"172.21.15.134:6803/3397465529","heartbeat_back_addr":"172.21.15.134:6807/3397465529","heartbeat_front_addr":"172.21.15.134:6805/3397465529","state":["exists","up"]},{"osd":14,"uuid":"43d0e878-9725-4208-ab75-04407b592477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6809","nonce":950976813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6811","nonce":950976813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6815","nonce":950976813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6813","nonce":950976813}]},"public_addr":"172.21.15.146:6809/950976813","cluster_addr":"172.21.15.146:6811/950976813","heartbeat_back_addr":"172.21.15.146:6815/950976813","heartbeat_front_addr":"172.21.15.146:6813/950976813","state":["exists","up"]},{"osd":15,"uuid":"1c97e00d-ee0d-4bed-953c-c99a67afe33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6825","nonce":3670919160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6827","nonce":3670919160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6831","nonce":3670919160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6829","nonce":3670919160}]},"public_addr":"172.21.15.154:6825/3670919160","cluster_addr":"172.21.15.154:6827/3670919160","heartbeat_back_addr":"172.21.15.154:6831/3670919160","heartbeat_front_addr":"172.21.15.154:6829/3670919160","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:37.639231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:11.844633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:15.197431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:29.139808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:17.886509+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:17.377166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:33.726885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:24.507253+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:23.502749+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:35.577875+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:11.740729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:34.372988+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:34.628477+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:36.581464+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:15.089100+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:28.822698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":29,"length":2},{"begin":32,"length":1},{"begin":36,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T18:17:10.122 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T18:17:10.122 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T18:17:10.429 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:17:10.429 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":133,"fsid":"61bbf164-0ac7-4613-95ea-b1c3bf551ccb","created":"2024-09-17T18:14:58.620399+0000","modified":"2024-09-17T18:17:09.768918+0000","last_up_change":"2024-09-17T18:15:12.533086+0000","last_in_change":"2024-09-17T18:15:03.053866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T18:15:11.543279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T18:15:13.520321+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15f80e97-3ed0-4557-b1f4-7ffa88c188dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6803","nonce":2391985960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6805","nonce":2391985960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6809","nonce":2391985960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6807","nonce":2391985960}]},"public_addr":"172.21.15.87:6803/2391985960","cluster_addr":"172.21.15.87:6805/2391985960","heartbeat_back_addr":"172.21.15.87:6809/2391985960","heartbeat_front_addr":"172.21.15.87:6807/2391985960","state":["exists","up"]},{"osd":1,"uuid":"a9b255d0-e8d9-4d9a-9118-742dc2ac013f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6817","nonce":692679878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6819","nonce":692679878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6823","nonce":692679878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6821","nonce":692679878}]},"public_addr":"172.21.15.134:6817/692679878","cluster_addr":"172.21.15.134:6819/692679878","heartbeat_back_addr":"172.21.15.134:6823/692679878","heartbeat_front_addr":"172.21.15.134:6821/692679878","state":["exists","up"]},{"osd":2,"uuid":"76ad6be0-c351-4265-893f-cec4a82ecd76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6825","nonce":197002546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6827","nonce":197002546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6831","nonce":197002546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6829","nonce":197002546}]},"public_addr":"172.21.15.146:6825/197002546","cluster_addr":"172.21.15.146:6827/197002546","heartbeat_back_addr":"172.21.15.146:6831/197002546","heartbeat_front_addr":"172.21.15.146:6829/197002546","state":["exists","up"]},{"osd":3,"uuid":"325d4c94-b21d-48cd-8f47-446e6a8bcbcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6817","nonce":450535216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6819","nonce":450535216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6823","nonce":450535216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6821","nonce":450535216}]},"public_addr":"172.21.15.154:6817/450535216","cluster_addr":"172.21.15.154:6819/450535216","heartbeat_back_addr":"172.21.15.154:6823/450535216","heartbeat_front_addr":"172.21.15.154:6821/450535216","state":["exists","up"]},{"osd":4,"uuid":"58b12ec9-29f5-4fea-a835-594fe03cd376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6827","nonce":1911207814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6829","nonce":1911207814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6833","nonce":1911207814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6831","nonce":1911207814}]},"public_addr":"172.21.15.87:6827/1911207814","cluster_addr":"172.21.15.87:6829/1911207814","heartbeat_back_addr":"172.21.15.87:6833/1911207814","heartbeat_front_addr":"172.21.15.87:6831/1911207814","state":["exists","up"]},{"osd":5,"uuid":"27d3075f-32f4-4032-b0d4-fb7604c8bfda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6825","nonce":391215769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6827","nonce":391215769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6831","nonce":391215769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6829","nonce":391215769}]},"public_addr":"172.21.15.134:6825/391215769","cluster_addr":"172.21.15.134:6827/391215769","heartbeat_back_addr":"172.21.15.134:6831/391215769","heartbeat_front_addr":"172.21.15.134:6829/391215769","state":["exists","up"]},{"osd":6,"uuid":"4326073e-338d-47f1-9860-5e44455f49ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6801","nonce":1495925642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6803","nonce":1495925642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6807","nonce":1495925642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6805","nonce":1495925642}]},"public_addr":"172.21.15.146:6801/1495925642","cluster_addr":"172.21.15.146:6803/1495925642","heartbeat_back_addr":"172.21.15.146:6807/1495925642","heartbeat_front_addr":"172.21.15.146:6805/1495925642","state":["exists","up"]},{"osd":7,"uuid":"455a2636-b754-4e1f-8933-16cd3fc126fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6809","nonce":3979156181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6811","nonce":3979156181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6815","nonce":3979156181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6813","nonce":3979156181}]},"public_addr":"172.21.15.154:6809/3979156181","cluster_addr":"172.21.15.154:6811/3979156181","heartbeat_back_addr":"172.21.15.154:6815/3979156181","heartbeat_front_addr":"172.21.15.154:6813/3979156181","state":["exists","up"]},{"osd":8,"uuid":"e64c05c6-2dce-4abc-8693-3e06b69723b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6819","nonce":740946583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6821","nonce":740946583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6825","nonce":740946583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6823","nonce":740946583}]},"public_addr":"172.21.15.87:6819/740946583","cluster_addr":"172.21.15.87:6821/740946583","heartbeat_back_addr":"172.21.15.87:6825/740946583","heartbeat_front_addr":"172.21.15.87:6823/740946583","state":["exists","up"]},{"osd":9,"uuid":"10bcf7b0-b22d-4a33-b090-b3c8083b6445","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6809","nonce":2811218890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6811","nonce":2811218890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6815","nonce":2811218890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6813","nonce":2811218890}]},"public_addr":"172.21.15.134:6809/2811218890","cluster_addr":"172.21.15.134:6811/2811218890","heartbeat_back_addr":"172.21.15.134:6815/2811218890","heartbeat_front_addr":"172.21.15.134:6813/2811218890","state":["exists","up"]},{"osd":10,"uuid":"a69d3d5e-353a-41aa-8b1c-fe7b0a68865f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6817","nonce":1660646458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6819","nonce":1660646458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6823","nonce":1660646458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6821","nonce":1660646458}]},"public_addr":"172.21.15.146:6817/1660646458","cluster_addr":"172.21.15.146:6819/1660646458","heartbeat_back_addr":"172.21.15.146:6823/1660646458","heartbeat_front_addr":"172.21.15.146:6821/1660646458","state":["exists","up"]},{"osd":11,"uuid":"0a0e715b-1804-4e14-87e1-8c5de231b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6801","nonce":2080834051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6803","nonce":2080834051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6807","nonce":2080834051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6805","nonce":2080834051}]},"public_addr":"172.21.15.154:6801/2080834051","cluster_addr":"172.21.15.154:6803/2080834051","heartbeat_back_addr":"172.21.15.154:6807/2080834051","heartbeat_front_addr":"172.21.15.154:6805/2080834051","state":["exists","up"]},{"osd":12,"uuid":"bdb1a692-4d6e-4a0c-a21f-db10b3af5025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6811","nonce":249183944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6813","nonce":249183944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6817","nonce":249183944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6815","nonce":249183944}]},"public_addr":"172.21.15.87:6811/249183944","cluster_addr":"172.21.15.87:6813/249183944","heartbeat_back_addr":"172.21.15.87:6817/249183944","heartbeat_front_addr":"172.21.15.87:6815/249183944","state":["exists","up"]},{"osd":13,"uuid":"225fb253-25c2-4a10-a169-97971cb06e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6801","nonce":3397465529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6803","nonce":3397465529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6807","nonce":3397465529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6805","nonce":3397465529}]},"public_addr":"172.21.15.134:6801/3397465529","cluster_addr":"172.21.15.134:6803/3397465529","heartbeat_back_addr":"172.21.15.134:6807/3397465529","heartbeat_front_addr":"172.21.15.134:6805/3397465529","state":["exists","up"]},{"osd":14,"uuid":"43d0e878-9725-4208-ab75-04407b592477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6809","nonce":950976813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6811","nonce":950976813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6815","nonce":950976813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6813","nonce":950976813}]},"public_addr":"172.21.15.146:6809/950976813","cluster_addr":"172.21.15.146:6811/950976813","heartbeat_back_addr":"172.21.15.146:6815/950976813","heartbeat_front_addr":"172.21.15.146:6813/950976813","state":["exists","up"]},{"osd":15,"uuid":"1c97e00d-ee0d-4bed-953c-c99a67afe33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6825","nonce":3670919160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6827","nonce":3670919160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6831","nonce":3670919160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6829","nonce":3670919160}]},"public_addr":"172.21.15.154:6825/3670919160","cluster_addr":"172.21.15.154:6827/3670919160","heartbeat_back_addr":"172.21.15.154:6831/3670919160","heartbeat_front_addr":"172.21.15.154:6829/3670919160","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:37.639231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:11.844633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:15.197431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:29.139808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:17.886509+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:17.377166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:33.726885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:24.507253+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:23.502749+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:35.577875+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:11.740729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:34.372988+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:34.628477+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:36.581464+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:15.089100+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:28.822698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":29,"length":2},{"begin":32,"length":1},{"begin":36,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T18:17:10.449 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T18:17:10.449 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T18:17:10.450 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T18:17:10.450 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T18:17:10.450 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T18:17:10.451 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T18:17:10.451 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T18:17:10.452 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T18:17:10.452 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-09-17T18:17:10.453 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-09-17T18:17:10.453 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2024-09-17T18:17:10.454 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2024-09-17T18:17:10.454 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2024-09-17T18:17:10.454 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2024-09-17T18:17:10.455 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2024-09-17T18:17:10.455 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2024-09-17T18:17:10.822 INFO:teuthology.orchestra.run.smithi087.stdout:94489280539 2024-09-17T18:17:10.823 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T18:17:10.900 INFO:teuthology.orchestra.run.smithi087.stdout:94489280538 2024-09-17T18:17:10.901 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T18:17:10.926 INFO:teuthology.orchestra.run.smithi087.stdout:90194313244 2024-09-17T18:17:10.926 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T18:17:10.937 INFO:teuthology.orchestra.run.smithi087.stdout:94489280539 2024-09-17T18:17:10.938 INFO:teuthology.orchestra.run.smithi087.stdout:98784247836 2024-09-17T18:17:10.939 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-09-17T18:17:10.939 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-09-17T18:17:10.957 INFO:teuthology.orchestra.run.smithi087.stdout:94489280540 2024-09-17T18:17:10.957 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-09-17T18:17:10.964 INFO:teuthology.orchestra.run.smithi087.stdout:98784247836 2024-09-17T18:17:10.965 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-09-17T18:17:10.966 INFO:teuthology.orchestra.run.smithi087.stdout:90194313244 2024-09-17T18:17:10.966 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-09-17T18:17:10.984 INFO:teuthology.orchestra.run.smithi087.stdout:94489280538 2024-09-17T18:17:10.985 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-09-17T18:17:10.998 INFO:teuthology.orchestra.run.smithi087.stdout:98784247836 2024-09-17T18:17:10.998 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T18:17:11.011 INFO:teuthology.orchestra.run.smithi087.stdout:98784247835 2024-09-17T18:17:11.012 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T18:17:11.015 INFO:teuthology.orchestra.run.smithi087.stdout:94489280540 2024-09-17T18:17:11.016 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-09-17T18:17:11.017 INFO:teuthology.orchestra.run.smithi087.stdout:98784247834 2024-09-17T18:17:11.018 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T18:17:11.036 INFO:teuthology.orchestra.run.smithi087.stdout:94489280539 2024-09-17T18:17:11.037 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T18:17:11.081 INFO:teuthology.orchestra.run.smithi087.stdout:90194313243 2024-09-17T18:17:11.082 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-09-17T18:17:11.083 INFO:teuthology.orchestra.run.smithi087.stdout:98784247836 2024-09-17T18:17:11.083 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T18:17:11.859 INFO:teuthology.orchestra.run.smithi087.stdout:94489280539 2024-09-17T18:17:11.860 INFO:teuthology.orchestra.run.smithi087.stdout:90194313244 2024-09-17T18:17:11.879 INFO:teuthology.orchestra.run.smithi087.stdout:94489280540 2024-09-17T18:17:11.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313244 got 90194313244 for osd.0 2024-09-17T18:17:11.901 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:11.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280539 got 94489280539 for osd.2 2024-09-17T18:17:11.910 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:11.919 INFO:teuthology.orchestra.run.smithi087.stdout:98784247836 2024-09-17T18:17:11.922 INFO:teuthology.orchestra.run.smithi087.stdout:90194313244 2024-09-17T18:17:11.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280540 got 94489280540 for osd.12 2024-09-17T18:17:11.923 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:11.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313244 got 90194313244 for osd.9 2024-09-17T18:17:11.970 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:11.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247836 got 98784247836 for osd.6 2024-09-17T18:17:11.971 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:11.999 INFO:teuthology.orchestra.run.smithi087.stdout:94489280538 2024-09-17T18:17:12.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280538 got 94489280538 for osd.8 2024-09-17T18:17:12.052 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:12.075 INFO:teuthology.orchestra.run.smithi087.stdout:98784247836 2024-09-17T18:17:12.091 INFO:teuthology.orchestra.run.smithi087.stdout:98784247834 2024-09-17T18:17:12.095 INFO:teuthology.orchestra.run.smithi087.stdout:94489280539 2024-09-17T18:17:12.099 INFO:teuthology.orchestra.run.smithi087.stdout:94489280539 2024-09-17T18:17:12.100 INFO:teuthology.orchestra.run.smithi087.stdout:94489280538 2024-09-17T18:17:12.100 INFO:teuthology.orchestra.run.smithi087.stdout:98784247836 2024-09-17T18:17:12.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247836 got 98784247836 for osd.15 2024-09-17T18:17:12.101 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:12.120 INFO:teuthology.orchestra.run.smithi087.stdout:98784247835 2024-09-17T18:17:12.121 INFO:teuthology.orchestra.run.smithi087.stdout:90194313243 2024-09-17T18:17:12.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280539 got 94489280539 for osd.10 2024-09-17T18:17:12.129 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:12.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247834 got 98784247834 for osd.3 2024-09-17T18:17:12.130 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:12.131 INFO:teuthology.orchestra.run.smithi087.stdout:98784247836 2024-09-17T18:17:12.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280538 got 94489280538 for osd.5 2024-09-17T18:17:12.133 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:12.135 INFO:teuthology.orchestra.run.smithi087.stdout:94489280540 2024-09-17T18:17:12.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247836 got 98784247836 for osd.14 2024-09-17T18:17:12.148 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:12.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280539 got 94489280539 for osd.1 2024-09-17T18:17:12.153 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:12.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313243 got 90194313243 for osd.11 2024-09-17T18:17:12.154 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:12.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247835 got 98784247835 for osd.7 2024-09-17T18:17:12.157 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:12.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280540 got 94489280540 for osd.13 2024-09-17T18:17:12.164 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:12.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247836 got 98784247836 for osd.4 2024-09-17T18:17:12.164 DEBUG:teuthology.parallel:result is None 2024-09-17T18:17:12.165 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-17T18:17:12.165 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:17:12.482 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:17:12.482 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:17:12.499 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-17T18:17:11.527368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":621868,"kb_used_data":32584,"kb_used_omap":24,"kb_used_meta":588903,"kb_avail":1509327572,"statfs":{"total":1546188226560,"available":1545551433728,"internally_reserved":0,"allocated":33366016,"data_stored":19968020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":603036753},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.790545"},"pg_stats":[{"pgid":"1.0","version":"25'112","reported_seq":366,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.878886+0000","last_change":"2024-09-17T18:16:47.415033+0000","last_active":"2024-09-17T18:17:09.878886+0000","last_peered":"2024-09-17T18:17:09.878886+0000","last_clean":"2024-09-17T18:17:09.878886+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:17:09.878886+0000","last_undegraded":"2024-09-17T18:17:09.878886+0000","last_fullsized":"2024-09-17T18:17:09.878886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'112","last_scrub_stamp":"2024-09-17T18:16:47.414871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:16:47.414871+0000","objects_scrubbed":2,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:14.796594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:10.795844+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:17:10.795844+0000","last_peered":"2024-09-17T18:17:10.795844+0000","last_clean":"2024-09-17T18:17:10.795844+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:17:10.795844+0000","last_undegraded":"2024-09-17T18:17:10.795844+0000","last_fullsized":"2024-09-17T18:17:10.795844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:25.064319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":236,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.777826+0000","last_change":"2024-09-17T18:16:40.822818+0000","last_active":"2024-09-17T18:17:09.777826+0000","last_peered":"2024-09-17T18:17:09.777826+0000","last_clean":"2024-09-17T18:17:09.777826+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:17:09.777826+0000","last_undegraded":"2024-09-17T18:17:09.777826+0000","last_fullsized":"2024-09-17T18:17:09.777826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:40.822657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:40.822657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:46.743267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":233,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:10.795836+0000","last_change":"2024-09-17T18:16:37.106180+0000","last_active":"2024-09-17T18:17:10.795836+0000","last_peered":"2024-09-17T18:17:10.795836+0000","last_clean":"2024-09-17T18:17:10.795836+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:17:10.795836+0000","last_undegraded":"2024-09-17T18:17:10.795836+0000","last_fullsized":"2024-09-17T18:17:10.795836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:37.105982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:37.105982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:06.543641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"27'2","reported_seq":229,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.933918+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:17:09.933918+0000","last_peered":"2024-09-17T18:17:09.933918+0000","last_clean":"2024-09-17T18:17:09.933918+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:17:09.933918+0000","last_undegraded":"2024-09-17T18:17:09.933918+0000","last_fullsized":"2024-09-17T18:17:09.933918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:27.722802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.877085+0000","last_change":"2024-09-17T18:16:23.688825+0000","last_active":"2024-09-17T18:17:09.877085+0000","last_peered":"2024-09-17T18:17:09.877085+0000","last_clean":"2024-09-17T18:17:09.877085+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:17:09.877085+0000","last_undegraded":"2024-09-17T18:17:09.877085+0000","last_fullsized":"2024-09-17T18:17:09.877085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:23.688677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:23.688677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:33.289925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":224,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.879081+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:17:09.879081+0000","last_peered":"2024-09-17T18:17:09.879081+0000","last_clean":"2024-09-17T18:17:09.879081+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:17:09.879081+0000","last_undegraded":"2024-09-17T18:17:09.879081+0000","last_fullsized":"2024-09-17T18:17:09.879081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:15.290413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.774367+0000","last_change":"2024-09-17T18:16:37.656909+0000","last_active":"2024-09-17T18:17:09.774367+0000","last_peered":"2024-09-17T18:17:09.774367+0000","last_clean":"2024-09-17T18:17:09.774367+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:17:09.774367+0000","last_undegraded":"2024-09-17T18:17:09.774367+0000","last_fullsized":"2024-09-17T18:17:09.774367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:37.656837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:37.656837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:57.569950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.933911+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:17:09.933911+0000","last_peered":"2024-09-17T18:17:09.933911+0000","last_clean":"2024-09-17T18:17:09.933911+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:17:09.933911+0000","last_undegraded":"2024-09-17T18:17:09.933911+0000","last_fullsized":"2024-09-17T18:17:09.933911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:26.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51728,"kb_used_data":2492,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320112,"statfs":{"total":96636764160,"available":96583794688,"internally_reserved":0,"allocated":2551808,"data_stored":1711412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33144,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338696,"statfs":{"total":96636764160,"available":96602824704,"internally_reserved":0,"allocated":2002944,"data_stored":1172866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2023424,"data_stored":1182503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313244,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280540,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51216,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320624,"statfs":{"total":96636764160,"available":96584318976,"internally_reserved":0,"allocated":2023424,"data_stored":1182503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[3,4,5,6,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313244,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[1,3,4,5,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313243,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51216,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320624,"statfs":{"total":96636764160,"available":96584318976,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51212,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320628,"statfs":{"total":96636764160,"available":96584323072,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,4,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29000,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342840,"statfs":{"total":96636764160,"available":96607068160,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247834,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55372,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316468,"statfs":{"total":96636764160,"available":96580063232,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33688,"kb_used_data":2492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338152,"statfs":{"total":96636764160,"available":96602267648,"internally_reserved":0,"allocated":2551808,"data_stored":1711412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,3,5,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247835,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:17:12.501 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:17:12.781 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:17:12.781 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:17:12.798 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-17T18:17:11.527368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":621868,"kb_used_data":32584,"kb_used_omap":24,"kb_used_meta":588903,"kb_avail":1509327572,"statfs":{"total":1546188226560,"available":1545551433728,"internally_reserved":0,"allocated":33366016,"data_stored":19968020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":603036753},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.790545"},"pg_stats":[{"pgid":"1.0","version":"25'112","reported_seq":366,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.878886+0000","last_change":"2024-09-17T18:16:47.415033+0000","last_active":"2024-09-17T18:17:09.878886+0000","last_peered":"2024-09-17T18:17:09.878886+0000","last_clean":"2024-09-17T18:17:09.878886+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:17:09.878886+0000","last_undegraded":"2024-09-17T18:17:09.878886+0000","last_fullsized":"2024-09-17T18:17:09.878886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'112","last_scrub_stamp":"2024-09-17T18:16:47.414871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:16:47.414871+0000","objects_scrubbed":2,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:14.796594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:10.795844+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:17:10.795844+0000","last_peered":"2024-09-17T18:17:10.795844+0000","last_clean":"2024-09-17T18:17:10.795844+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:17:10.795844+0000","last_undegraded":"2024-09-17T18:17:10.795844+0000","last_fullsized":"2024-09-17T18:17:10.795844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:25.064319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":236,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.777826+0000","last_change":"2024-09-17T18:16:40.822818+0000","last_active":"2024-09-17T18:17:09.777826+0000","last_peered":"2024-09-17T18:17:09.777826+0000","last_clean":"2024-09-17T18:17:09.777826+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:17:09.777826+0000","last_undegraded":"2024-09-17T18:17:09.777826+0000","last_fullsized":"2024-09-17T18:17:09.777826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:40.822657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:40.822657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:46.743267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":233,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:10.795836+0000","last_change":"2024-09-17T18:16:37.106180+0000","last_active":"2024-09-17T18:17:10.795836+0000","last_peered":"2024-09-17T18:17:10.795836+0000","last_clean":"2024-09-17T18:17:10.795836+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:17:10.795836+0000","last_undegraded":"2024-09-17T18:17:10.795836+0000","last_fullsized":"2024-09-17T18:17:10.795836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:37.105982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:37.105982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:06.543641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"27'2","reported_seq":229,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.933918+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:17:09.933918+0000","last_peered":"2024-09-17T18:17:09.933918+0000","last_clean":"2024-09-17T18:17:09.933918+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:17:09.933918+0000","last_undegraded":"2024-09-17T18:17:09.933918+0000","last_fullsized":"2024-09-17T18:17:09.933918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:27.722802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.877085+0000","last_change":"2024-09-17T18:16:23.688825+0000","last_active":"2024-09-17T18:17:09.877085+0000","last_peered":"2024-09-17T18:17:09.877085+0000","last_clean":"2024-09-17T18:17:09.877085+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:17:09.877085+0000","last_undegraded":"2024-09-17T18:17:09.877085+0000","last_fullsized":"2024-09-17T18:17:09.877085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:23.688677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:23.688677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:33.289925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":224,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.879081+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:17:09.879081+0000","last_peered":"2024-09-17T18:17:09.879081+0000","last_clean":"2024-09-17T18:17:09.879081+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:17:09.879081+0000","last_undegraded":"2024-09-17T18:17:09.879081+0000","last_fullsized":"2024-09-17T18:17:09.879081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:15.290413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.774367+0000","last_change":"2024-09-17T18:16:37.656909+0000","last_active":"2024-09-17T18:17:09.774367+0000","last_peered":"2024-09-17T18:17:09.774367+0000","last_clean":"2024-09-17T18:17:09.774367+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:17:09.774367+0000","last_undegraded":"2024-09-17T18:17:09.774367+0000","last_fullsized":"2024-09-17T18:17:09.774367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:37.656837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:37.656837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:57.569950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.933911+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:17:09.933911+0000","last_peered":"2024-09-17T18:17:09.933911+0000","last_clean":"2024-09-17T18:17:09.933911+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:17:09.933911+0000","last_undegraded":"2024-09-17T18:17:09.933911+0000","last_fullsized":"2024-09-17T18:17:09.933911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:26.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51728,"kb_used_data":2492,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320112,"statfs":{"total":96636764160,"available":96583794688,"internally_reserved":0,"allocated":2551808,"data_stored":1711412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33144,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338696,"statfs":{"total":96636764160,"available":96602824704,"internally_reserved":0,"allocated":2002944,"data_stored":1172866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2023424,"data_stored":1182503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313244,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280540,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51216,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320624,"statfs":{"total":96636764160,"available":96584318976,"internally_reserved":0,"allocated":2023424,"data_stored":1182503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[3,4,5,6,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313244,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[1,3,4,5,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313243,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51216,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320624,"statfs":{"total":96636764160,"available":96584318976,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51212,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320628,"statfs":{"total":96636764160,"available":96584323072,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,4,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29000,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342840,"statfs":{"total":96636764160,"available":96607068160,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247834,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55372,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316468,"statfs":{"total":96636764160,"available":96580063232,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33688,"kb_used_data":2492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338152,"statfs":{"total":96636764160,"available":96602267648,"internally_reserved":0,"allocated":2551808,"data_stored":1711412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,3,5,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247835,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:17:12.799 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-17T18:17:12.799 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T18:17:12.808 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T18:17:12.808 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:17:13.085 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:17:13.086 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:17:13.102 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-17T18:17:11.527368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":621868,"kb_used_data":32584,"kb_used_omap":24,"kb_used_meta":588903,"kb_avail":1509327572,"statfs":{"total":1546188226560,"available":1545551433728,"internally_reserved":0,"allocated":33366016,"data_stored":19968020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":603036753},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.790545"},"pg_stats":[{"pgid":"1.0","version":"25'112","reported_seq":366,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.878886+0000","last_change":"2024-09-17T18:16:47.415033+0000","last_active":"2024-09-17T18:17:09.878886+0000","last_peered":"2024-09-17T18:17:09.878886+0000","last_clean":"2024-09-17T18:17:09.878886+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:17:09.878886+0000","last_undegraded":"2024-09-17T18:17:09.878886+0000","last_fullsized":"2024-09-17T18:17:09.878886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'112","last_scrub_stamp":"2024-09-17T18:16:47.414871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:16:47.414871+0000","objects_scrubbed":2,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:14.796594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:10.795844+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:17:10.795844+0000","last_peered":"2024-09-17T18:17:10.795844+0000","last_clean":"2024-09-17T18:17:10.795844+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:17:10.795844+0000","last_undegraded":"2024-09-17T18:17:10.795844+0000","last_fullsized":"2024-09-17T18:17:10.795844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:25.064319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":236,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.777826+0000","last_change":"2024-09-17T18:16:40.822818+0000","last_active":"2024-09-17T18:17:09.777826+0000","last_peered":"2024-09-17T18:17:09.777826+0000","last_clean":"2024-09-17T18:17:09.777826+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:17:09.777826+0000","last_undegraded":"2024-09-17T18:17:09.777826+0000","last_fullsized":"2024-09-17T18:17:09.777826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:40.822657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:40.822657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:46.743267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":233,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:10.795836+0000","last_change":"2024-09-17T18:16:37.106180+0000","last_active":"2024-09-17T18:17:10.795836+0000","last_peered":"2024-09-17T18:17:10.795836+0000","last_clean":"2024-09-17T18:17:10.795836+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:17:10.795836+0000","last_undegraded":"2024-09-17T18:17:10.795836+0000","last_fullsized":"2024-09-17T18:17:10.795836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:37.105982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:37.105982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:06.543641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"27'2","reported_seq":229,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.933918+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:17:09.933918+0000","last_peered":"2024-09-17T18:17:09.933918+0000","last_clean":"2024-09-17T18:17:09.933918+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:17:09.933918+0000","last_undegraded":"2024-09-17T18:17:09.933918+0000","last_fullsized":"2024-09-17T18:17:09.933918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:27.722802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.877085+0000","last_change":"2024-09-17T18:16:23.688825+0000","last_active":"2024-09-17T18:17:09.877085+0000","last_peered":"2024-09-17T18:17:09.877085+0000","last_clean":"2024-09-17T18:17:09.877085+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:17:09.877085+0000","last_undegraded":"2024-09-17T18:17:09.877085+0000","last_fullsized":"2024-09-17T18:17:09.877085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:23.688677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:23.688677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:33.289925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":224,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.879081+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:17:09.879081+0000","last_peered":"2024-09-17T18:17:09.879081+0000","last_clean":"2024-09-17T18:17:09.879081+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:17:09.879081+0000","last_undegraded":"2024-09-17T18:17:09.879081+0000","last_fullsized":"2024-09-17T18:17:09.879081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:15.290413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.774367+0000","last_change":"2024-09-17T18:16:37.656909+0000","last_active":"2024-09-17T18:17:09.774367+0000","last_peered":"2024-09-17T18:17:09.774367+0000","last_clean":"2024-09-17T18:17:09.774367+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:17:09.774367+0000","last_undegraded":"2024-09-17T18:17:09.774367+0000","last_fullsized":"2024-09-17T18:17:09.774367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:37.656837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:37.656837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:57.569950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.933911+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:17:09.933911+0000","last_peered":"2024-09-17T18:17:09.933911+0000","last_clean":"2024-09-17T18:17:09.933911+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:17:09.933911+0000","last_undegraded":"2024-09-17T18:17:09.933911+0000","last_fullsized":"2024-09-17T18:17:09.933911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:26.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51728,"kb_used_data":2492,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320112,"statfs":{"total":96636764160,"available":96583794688,"internally_reserved":0,"allocated":2551808,"data_stored":1711412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33144,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338696,"statfs":{"total":96636764160,"available":96602824704,"internally_reserved":0,"allocated":2002944,"data_stored":1172866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2023424,"data_stored":1182503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313244,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280540,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51216,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320624,"statfs":{"total":96636764160,"available":96584318976,"internally_reserved":0,"allocated":2023424,"data_stored":1182503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[3,4,5,6,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313244,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[1,3,4,5,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313243,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51216,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320624,"statfs":{"total":96636764160,"available":96584318976,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51212,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320628,"statfs":{"total":96636764160,"available":96584323072,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,4,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29000,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342840,"statfs":{"total":96636764160,"available":96607068160,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247834,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55372,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316468,"statfs":{"total":96636764160,"available":96580063232,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33688,"kb_used_data":2492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338152,"statfs":{"total":96636764160,"available":96602267648,"internally_reserved":0,"allocated":2551808,"data_stored":1711412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,3,5,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247835,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:17:13.103 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:17:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:17:13.383 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:17:13.400 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-17T18:17:11.527368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":621868,"kb_used_data":32584,"kb_used_omap":24,"kb_used_meta":588903,"kb_avail":1509327572,"statfs":{"total":1546188226560,"available":1545551433728,"internally_reserved":0,"allocated":33366016,"data_stored":19968020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":603036753},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.790545"},"pg_stats":[{"pgid":"1.0","version":"25'112","reported_seq":366,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.878886+0000","last_change":"2024-09-17T18:16:47.415033+0000","last_active":"2024-09-17T18:17:09.878886+0000","last_peered":"2024-09-17T18:17:09.878886+0000","last_clean":"2024-09-17T18:17:09.878886+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:17:09.878886+0000","last_undegraded":"2024-09-17T18:17:09.878886+0000","last_fullsized":"2024-09-17T18:17:09.878886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'112","last_scrub_stamp":"2024-09-17T18:16:47.414871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:16:47.414871+0000","objects_scrubbed":2,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:14.796594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:10.795844+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:17:10.795844+0000","last_peered":"2024-09-17T18:17:10.795844+0000","last_clean":"2024-09-17T18:17:10.795844+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:17:10.795844+0000","last_undegraded":"2024-09-17T18:17:10.795844+0000","last_fullsized":"2024-09-17T18:17:10.795844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:25.064319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":236,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.777826+0000","last_change":"2024-09-17T18:16:40.822818+0000","last_active":"2024-09-17T18:17:09.777826+0000","last_peered":"2024-09-17T18:17:09.777826+0000","last_clean":"2024-09-17T18:17:09.777826+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:17:09.777826+0000","last_undegraded":"2024-09-17T18:17:09.777826+0000","last_fullsized":"2024-09-17T18:17:09.777826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:40.822657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:40.822657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:46.743267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":233,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:10.795836+0000","last_change":"2024-09-17T18:16:37.106180+0000","last_active":"2024-09-17T18:17:10.795836+0000","last_peered":"2024-09-17T18:17:10.795836+0000","last_clean":"2024-09-17T18:17:10.795836+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:17:10.795836+0000","last_undegraded":"2024-09-17T18:17:10.795836+0000","last_fullsized":"2024-09-17T18:17:10.795836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:37.105982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:37.105982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:06.543641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"27'2","reported_seq":229,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.933918+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:17:09.933918+0000","last_peered":"2024-09-17T18:17:09.933918+0000","last_clean":"2024-09-17T18:17:09.933918+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:17:09.933918+0000","last_undegraded":"2024-09-17T18:17:09.933918+0000","last_fullsized":"2024-09-17T18:17:09.933918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:27.722802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.877085+0000","last_change":"2024-09-17T18:16:23.688825+0000","last_active":"2024-09-17T18:17:09.877085+0000","last_peered":"2024-09-17T18:17:09.877085+0000","last_clean":"2024-09-17T18:17:09.877085+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:17:09.877085+0000","last_undegraded":"2024-09-17T18:17:09.877085+0000","last_fullsized":"2024-09-17T18:17:09.877085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:23.688677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:23.688677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:33.289925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":224,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.879081+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:17:09.879081+0000","last_peered":"2024-09-17T18:17:09.879081+0000","last_clean":"2024-09-17T18:17:09.879081+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:17:09.879081+0000","last_undegraded":"2024-09-17T18:17:09.879081+0000","last_fullsized":"2024-09-17T18:17:09.879081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:15.290413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.774367+0000","last_change":"2024-09-17T18:16:37.656909+0000","last_active":"2024-09-17T18:17:09.774367+0000","last_peered":"2024-09-17T18:17:09.774367+0000","last_clean":"2024-09-17T18:17:09.774367+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:17:09.774367+0000","last_undegraded":"2024-09-17T18:17:09.774367+0000","last_fullsized":"2024-09-17T18:17:09.774367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:37.656837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:37.656837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:57.569950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.933911+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:17:09.933911+0000","last_peered":"2024-09-17T18:17:09.933911+0000","last_clean":"2024-09-17T18:17:09.933911+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:17:09.933911+0000","last_undegraded":"2024-09-17T18:17:09.933911+0000","last_fullsized":"2024-09-17T18:17:09.933911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:26.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51728,"kb_used_data":2492,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320112,"statfs":{"total":96636764160,"available":96583794688,"internally_reserved":0,"allocated":2551808,"data_stored":1711412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33144,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338696,"statfs":{"total":96636764160,"available":96602824704,"internally_reserved":0,"allocated":2002944,"data_stored":1172866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2023424,"data_stored":1182503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313244,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280540,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51216,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320624,"statfs":{"total":96636764160,"available":96584318976,"internally_reserved":0,"allocated":2023424,"data_stored":1182503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[3,4,5,6,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313244,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[1,3,4,5,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313243,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51216,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320624,"statfs":{"total":96636764160,"available":96584318976,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51212,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320628,"statfs":{"total":96636764160,"available":96584323072,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,4,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29000,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342840,"statfs":{"total":96636764160,"available":96607068160,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247834,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55372,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316468,"statfs":{"total":96636764160,"available":96580063232,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33688,"kb_used_data":2492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338152,"statfs":{"total":96636764160,"available":96602267648,"internally_reserved":0,"allocated":2551808,"data_stored":1711412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,3,5,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247835,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:17:13.401 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T18:17:13.401 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:17:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:17:13.679 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:17:13.697 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-09-17T18:17:13.527783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":621868,"kb_used_data":32584,"kb_used_omap":24,"kb_used_meta":588903,"kb_avail":1509327572,"statfs":{"total":1546188226560,"available":1545551433728,"internally_reserved":0,"allocated":33366016,"data_stored":19968020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":603036753},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001663"},"pg_stats":[{"pgid":"1.0","version":"25'112","reported_seq":366,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.878886+0000","last_change":"2024-09-17T18:16:47.415033+0000","last_active":"2024-09-17T18:17:09.878886+0000","last_peered":"2024-09-17T18:17:09.878886+0000","last_clean":"2024-09-17T18:17:09.878886+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:17:09.878886+0000","last_undegraded":"2024-09-17T18:17:09.878886+0000","last_fullsized":"2024-09-17T18:17:09.878886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'112","last_scrub_stamp":"2024-09-17T18:16:47.414871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:16:47.414871+0000","objects_scrubbed":2,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:14.796594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:10.795844+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:17:10.795844+0000","last_peered":"2024-09-17T18:17:10.795844+0000","last_clean":"2024-09-17T18:17:10.795844+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:17:10.795844+0000","last_undegraded":"2024-09-17T18:17:10.795844+0000","last_fullsized":"2024-09-17T18:17:10.795844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:25.064319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":236,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.777826+0000","last_change":"2024-09-17T18:16:40.822818+0000","last_active":"2024-09-17T18:17:09.777826+0000","last_peered":"2024-09-17T18:17:09.777826+0000","last_clean":"2024-09-17T18:17:09.777826+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:17:09.777826+0000","last_undegraded":"2024-09-17T18:17:09.777826+0000","last_fullsized":"2024-09-17T18:17:09.777826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:40.822657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:40.822657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:46.743267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":233,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:10.795836+0000","last_change":"2024-09-17T18:16:37.106180+0000","last_active":"2024-09-17T18:17:10.795836+0000","last_peered":"2024-09-17T18:17:10.795836+0000","last_clean":"2024-09-17T18:17:10.795836+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:17:10.795836+0000","last_undegraded":"2024-09-17T18:17:10.795836+0000","last_fullsized":"2024-09-17T18:17:10.795836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:37.105982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:37.105982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:06.543641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"27'2","reported_seq":229,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.933918+0000","last_change":"2024-09-17T18:15:16.619924+0000","last_active":"2024-09-17T18:17:09.933918+0000","last_peered":"2024-09-17T18:17:09.933918+0000","last_clean":"2024-09-17T18:17:09.933918+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:17:09.933918+0000","last_undegraded":"2024-09-17T18:17:09.933918+0000","last_fullsized":"2024-09-17T18:17:09.933918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:27.722802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.877085+0000","last_change":"2024-09-17T18:16:23.688825+0000","last_active":"2024-09-17T18:17:09.877085+0000","last_peered":"2024-09-17T18:17:09.877085+0000","last_clean":"2024-09-17T18:17:09.877085+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:17:09.877085+0000","last_undegraded":"2024-09-17T18:17:09.877085+0000","last_fullsized":"2024-09-17T18:17:09.877085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:23.688677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:23.688677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:33.289925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":224,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.879081+0000","last_change":"2024-09-17T18:15:17.504087+0000","last_active":"2024-09-17T18:17:09.879081+0000","last_peered":"2024-09-17T18:17:09.879081+0000","last_clean":"2024-09-17T18:17:09.879081+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:17:09.879081+0000","last_undegraded":"2024-09-17T18:17:09.879081+0000","last_fullsized":"2024-09-17T18:17:09.879081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:15.290413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.774367+0000","last_change":"2024-09-17T18:16:37.656909+0000","last_active":"2024-09-17T18:17:09.774367+0000","last_peered":"2024-09-17T18:17:09.774367+0000","last_clean":"2024-09-17T18:17:09.774367+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:17:09.774367+0000","last_undegraded":"2024-09-17T18:17:09.774367+0000","last_fullsized":"2024-09-17T18:17:09.774367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:37.656837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:37.656837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:57.569950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T18:17:09.933911+0000","last_change":"2024-09-17T18:15:16.619115+0000","last_active":"2024-09-17T18:17:09.933911+0000","last_peered":"2024-09-17T18:17:09.933911+0000","last_clean":"2024-09-17T18:17:09.933911+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:17:09.933911+0000","last_undegraded":"2024-09-17T18:17:09.933911+0000","last_fullsized":"2024-09-17T18:17:09.933911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:26.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51728,"kb_used_data":2492,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320112,"statfs":{"total":96636764160,"available":96583794688,"internally_reserved":0,"allocated":2551808,"data_stored":1711412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33144,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338696,"statfs":{"total":96636764160,"available":96602824704,"internally_reserved":0,"allocated":2002944,"data_stored":1172866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2023424,"data_stored":1182503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313245,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280541,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51216,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320624,"statfs":{"total":96636764160,"available":96584318976,"internally_reserved":0,"allocated":2023424,"data_stored":1182503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[3,4,5,6,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313245,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[1,3,4,5,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313244,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51216,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320624,"statfs":{"total":96636764160,"available":96584318976,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51212,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320628,"statfs":{"total":96636764160,"available":96584323072,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,4,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29000,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342840,"statfs":{"total":96636764160,"available":96607068160,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247834,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55372,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316468,"statfs":{"total":96636764160,"available":96580063232,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33688,"kb_used_data":2492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338152,"statfs":{"total":96636764160,"available":96602267648,"internally_reserved":0,"allocated":2551808,"data_stored":1711412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,3,5,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247835,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1182484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:17:13.698 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T18:17:13.977 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:17:13.977 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":134,"fsid":"61bbf164-0ac7-4613-95ea-b1c3bf551ccb","created":"2024-09-17T18:14:58.620399+0000","modified":"2024-09-17T18:17:13.791912+0000","last_up_change":"2024-09-17T18:15:12.533086+0000","last_in_change":"2024-09-17T18:15:03.053866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T18:15:11.543279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T18:15:13.520321+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15f80e97-3ed0-4557-b1f4-7ffa88c188dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6803","nonce":2391985960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6805","nonce":2391985960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6809","nonce":2391985960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2391985960},{"type":"v1","addr":"172.21.15.87:6807","nonce":2391985960}]},"public_addr":"172.21.15.87:6803/2391985960","cluster_addr":"172.21.15.87:6805/2391985960","heartbeat_back_addr":"172.21.15.87:6809/2391985960","heartbeat_front_addr":"172.21.15.87:6807/2391985960","state":["exists","up"]},{"osd":1,"uuid":"a9b255d0-e8d9-4d9a-9118-742dc2ac013f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6817","nonce":692679878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6819","nonce":692679878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6823","nonce":692679878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":692679878},{"type":"v1","addr":"172.21.15.134:6821","nonce":692679878}]},"public_addr":"172.21.15.134:6817/692679878","cluster_addr":"172.21.15.134:6819/692679878","heartbeat_back_addr":"172.21.15.134:6823/692679878","heartbeat_front_addr":"172.21.15.134:6821/692679878","state":["exists","up"]},{"osd":2,"uuid":"76ad6be0-c351-4265-893f-cec4a82ecd76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6825","nonce":197002546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6827","nonce":197002546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6831","nonce":197002546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":197002546},{"type":"v1","addr":"172.21.15.146:6829","nonce":197002546}]},"public_addr":"172.21.15.146:6825/197002546","cluster_addr":"172.21.15.146:6827/197002546","heartbeat_back_addr":"172.21.15.146:6831/197002546","heartbeat_front_addr":"172.21.15.146:6829/197002546","state":["exists","up"]},{"osd":3,"uuid":"325d4c94-b21d-48cd-8f47-446e6a8bcbcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6817","nonce":450535216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6819","nonce":450535216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6823","nonce":450535216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":450535216},{"type":"v1","addr":"172.21.15.154:6821","nonce":450535216}]},"public_addr":"172.21.15.154:6817/450535216","cluster_addr":"172.21.15.154:6819/450535216","heartbeat_back_addr":"172.21.15.154:6823/450535216","heartbeat_front_addr":"172.21.15.154:6821/450535216","state":["exists","up"]},{"osd":4,"uuid":"58b12ec9-29f5-4fea-a835-594fe03cd376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6827","nonce":1911207814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6829","nonce":1911207814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6833","nonce":1911207814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1911207814},{"type":"v1","addr":"172.21.15.87:6831","nonce":1911207814}]},"public_addr":"172.21.15.87:6827/1911207814","cluster_addr":"172.21.15.87:6829/1911207814","heartbeat_back_addr":"172.21.15.87:6833/1911207814","heartbeat_front_addr":"172.21.15.87:6831/1911207814","state":["exists","up"]},{"osd":5,"uuid":"27d3075f-32f4-4032-b0d4-fb7604c8bfda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6825","nonce":391215769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6827","nonce":391215769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6831","nonce":391215769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":391215769},{"type":"v1","addr":"172.21.15.134:6829","nonce":391215769}]},"public_addr":"172.21.15.134:6825/391215769","cluster_addr":"172.21.15.134:6827/391215769","heartbeat_back_addr":"172.21.15.134:6831/391215769","heartbeat_front_addr":"172.21.15.134:6829/391215769","state":["exists","up"]},{"osd":6,"uuid":"4326073e-338d-47f1-9860-5e44455f49ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6801","nonce":1495925642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6803","nonce":1495925642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6807","nonce":1495925642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1495925642},{"type":"v1","addr":"172.21.15.146:6805","nonce":1495925642}]},"public_addr":"172.21.15.146:6801/1495925642","cluster_addr":"172.21.15.146:6803/1495925642","heartbeat_back_addr":"172.21.15.146:6807/1495925642","heartbeat_front_addr":"172.21.15.146:6805/1495925642","state":["exists","up"]},{"osd":7,"uuid":"455a2636-b754-4e1f-8933-16cd3fc126fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6809","nonce":3979156181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6811","nonce":3979156181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6815","nonce":3979156181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3979156181},{"type":"v1","addr":"172.21.15.154:6813","nonce":3979156181}]},"public_addr":"172.21.15.154:6809/3979156181","cluster_addr":"172.21.15.154:6811/3979156181","heartbeat_back_addr":"172.21.15.154:6815/3979156181","heartbeat_front_addr":"172.21.15.154:6813/3979156181","state":["exists","up"]},{"osd":8,"uuid":"e64c05c6-2dce-4abc-8693-3e06b69723b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6819","nonce":740946583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6821","nonce":740946583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6825","nonce":740946583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":740946583},{"type":"v1","addr":"172.21.15.87:6823","nonce":740946583}]},"public_addr":"172.21.15.87:6819/740946583","cluster_addr":"172.21.15.87:6821/740946583","heartbeat_back_addr":"172.21.15.87:6825/740946583","heartbeat_front_addr":"172.21.15.87:6823/740946583","state":["exists","up"]},{"osd":9,"uuid":"10bcf7b0-b22d-4a33-b090-b3c8083b6445","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6809","nonce":2811218890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6811","nonce":2811218890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6815","nonce":2811218890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2811218890},{"type":"v1","addr":"172.21.15.134:6813","nonce":2811218890}]},"public_addr":"172.21.15.134:6809/2811218890","cluster_addr":"172.21.15.134:6811/2811218890","heartbeat_back_addr":"172.21.15.134:6815/2811218890","heartbeat_front_addr":"172.21.15.134:6813/2811218890","state":["exists","up"]},{"osd":10,"uuid":"a69d3d5e-353a-41aa-8b1c-fe7b0a68865f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6817","nonce":1660646458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6819","nonce":1660646458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6823","nonce":1660646458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1660646458},{"type":"v1","addr":"172.21.15.146:6821","nonce":1660646458}]},"public_addr":"172.21.15.146:6817/1660646458","cluster_addr":"172.21.15.146:6819/1660646458","heartbeat_back_addr":"172.21.15.146:6823/1660646458","heartbeat_front_addr":"172.21.15.146:6821/1660646458","state":["exists","up"]},{"osd":11,"uuid":"0a0e715b-1804-4e14-87e1-8c5de231b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6801","nonce":2080834051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6803","nonce":2080834051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6807","nonce":2080834051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2080834051},{"type":"v1","addr":"172.21.15.154:6805","nonce":2080834051}]},"public_addr":"172.21.15.154:6801/2080834051","cluster_addr":"172.21.15.154:6803/2080834051","heartbeat_back_addr":"172.21.15.154:6807/2080834051","heartbeat_front_addr":"172.21.15.154:6805/2080834051","state":["exists","up"]},{"osd":12,"uuid":"bdb1a692-4d6e-4a0c-a21f-db10b3af5025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6811","nonce":249183944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6813","nonce":249183944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6817","nonce":249183944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":249183944},{"type":"v1","addr":"172.21.15.87:6815","nonce":249183944}]},"public_addr":"172.21.15.87:6811/249183944","cluster_addr":"172.21.15.87:6813/249183944","heartbeat_back_addr":"172.21.15.87:6817/249183944","heartbeat_front_addr":"172.21.15.87:6815/249183944","state":["exists","up"]},{"osd":13,"uuid":"225fb253-25c2-4a10-a169-97971cb06e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6801","nonce":3397465529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6803","nonce":3397465529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6807","nonce":3397465529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3397465529},{"type":"v1","addr":"172.21.15.134:6805","nonce":3397465529}]},"public_addr":"172.21.15.134:6801/3397465529","cluster_addr":"172.21.15.134:6803/3397465529","heartbeat_back_addr":"172.21.15.134:6807/3397465529","heartbeat_front_addr":"172.21.15.134:6805/3397465529","state":["exists","up"]},{"osd":14,"uuid":"43d0e878-9725-4208-ab75-04407b592477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6809","nonce":950976813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6811","nonce":950976813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6815","nonce":950976813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":950976813},{"type":"v1","addr":"172.21.15.146:6813","nonce":950976813}]},"public_addr":"172.21.15.146:6809/950976813","cluster_addr":"172.21.15.146:6811/950976813","heartbeat_back_addr":"172.21.15.146:6815/950976813","heartbeat_front_addr":"172.21.15.146:6813/950976813","state":["exists","up"]},{"osd":15,"uuid":"1c97e00d-ee0d-4bed-953c-c99a67afe33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6825","nonce":3670919160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6827","nonce":3670919160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6831","nonce":3670919160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3670919160},{"type":"v1","addr":"172.21.15.154:6829","nonce":3670919160}]},"public_addr":"172.21.15.154:6825/3670919160","cluster_addr":"172.21.15.154:6827/3670919160","heartbeat_back_addr":"172.21.15.154:6831/3670919160","heartbeat_front_addr":"172.21.15.154:6829/3670919160","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:37.639231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:17:13.595944+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:15.197431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:29.139808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:17.886509+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:17.377166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:33.726885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:24.507253+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:23.502749+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:35.577875+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:11.740729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:34.372988+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:34.628477+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:36.581464+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:15.089100+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T18:16:28.822698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":29,"length":2},{"begin":32,"length":1},{"begin":36,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T18:17:14.996 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T18:17:14.996 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:15.159 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:15.159 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:15.159 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:15.176 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T18:17:15.456 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T18:17:15.474 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T18:17:15.474 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:15.621 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:15.621 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:15.621 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:15.636 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T18:17:15.936 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T18:17:15.955 INFO:tasks.ceph:Scrubbing osd.8 2024-09-17T18:17:15.955 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:16.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T18:17:16.275+0000 7f38eed9d640 0 --2- 172.21.15.87:0/3672773678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38dc0052f0 0x7f38dc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-17T18:17:16.306 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:16.306 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:16.306 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:16.323 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2024-09-17T18:17:16.630 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 8 to deep-scrub 2024-09-17T18:17:16.650 INFO:tasks.ceph:Scrubbing osd.12 2024-09-17T18:17:16.650 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:16.799 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:16.799 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:16.799 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:16.816 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2024-09-17T18:17:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 12 to deep-scrub 2024-09-17T18:17:17.133 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T18:17:17.133 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:17.282 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:17.283 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:17.283 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:17.297 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T18:17:17.591 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T18:17:17.610 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T18:17:17.611 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:17.757 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:17.758 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:17.758 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:17.774 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T18:17:18.064 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T18:17:18.082 INFO:tasks.ceph:Scrubbing osd.9 2024-09-17T18:17:18.082 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:18.230 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:18.230 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:18.230 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:18.246 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2024-09-17T18:17:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 9 to deep-scrub 2024-09-17T18:17:18.553 INFO:tasks.ceph:Scrubbing osd.13 2024-09-17T18:17:18.553 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:18.691 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:18.706 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2024-09-17T18:17:18.980 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 13 to deep-scrub 2024-09-17T18:17:18.998 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T18:17:18.998 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:19.138 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:19.138 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:19.138 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:19.153 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T18:17:19.425 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T18:17:19.443 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T18:17:19.443 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:19.592 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:19.592 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:19.592 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:19.607 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T18:17:19.908 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T18:17:19.928 INFO:tasks.ceph:Scrubbing osd.10 2024-09-17T18:17:19.928 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:20.081 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:20.081 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:20.082 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:20.097 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2024-09-17T18:17:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 10 to deep-scrub 2024-09-17T18:17:20.410 INFO:tasks.ceph:Scrubbing osd.14 2024-09-17T18:17:20.410 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:20.552 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:20.552 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:20.552 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:20.566 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2024-09-17T18:17:20.860 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 14 to deep-scrub 2024-09-17T18:17:20.878 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T18:17:20.878 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:21.019 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:21.019 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:21.019 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:21.035 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T18:17:21.307 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T18:17:21.324 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T18:17:21.325 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:21.468 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:21.468 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:21.468 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:21.483 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T18:17:21.775 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T18:17:21.793 INFO:tasks.ceph:Scrubbing osd.11 2024-09-17T18:17:21.793 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:21.934 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:21.934 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:21.934 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:21.949 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2024-09-17T18:17:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 11 to deep-scrub 2024-09-17T18:17:22.254 INFO:tasks.ceph:Scrubbing osd.15 2024-09-17T18:17:22.254 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2024-09-17T18:17:22.400 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T18:17:22.400 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T18:17:22.400 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T18:17:22.415 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2024-09-17T18:17:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 15 to deep-scrub 2024-09-17T18:17:22.712 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:17:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:17:22.992 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:17:23.008 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-09-17T18:17:22.867445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":622500,"kb_used_data":33256,"kb_used_omap":24,"kb_used_meta":588903,"kb_avail":1509326940,"statfs":{"total":1546188226560,"available":1545550786560,"internally_reserved":0,"allocated":34054144,"data_stored":20373698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":603036753},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.339314"},"pg_stats":[{"pgid":"1.0","version":"25'112","reported_seq":371,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T18:17:16.920469+0000","last_change":"2024-09-17T18:16:47.415033+0000","last_active":"2024-09-17T18:17:16.920469+0000","last_peered":"2024-09-17T18:17:16.920469+0000","last_clean":"2024-09-17T18:17:16.920469+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:17:16.920469+0000","last_undegraded":"2024-09-17T18:17:16.920469+0000","last_fullsized":"2024-09-17T18:17:16.920469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'112","last_scrub_stamp":"2024-09-17T18:16:47.414871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:12.533086+0000","last_clean_scrub_stamp":"2024-09-17T18:16:47.414871+0000","objects_scrubbed":2,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:14.796594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":230,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T18:17:16.920611+0000","last_change":"2024-09-17T18:15:17.500047+0000","last_active":"2024-09-17T18:17:16.920611+0000","last_peered":"2024-09-17T18:17:16.920611+0000","last_clean":"2024-09-17T18:17:16.920611+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:17:16.920611+0000","last_undegraded":"2024-09-17T18:17:16.920611+0000","last_fullsized":"2024-09-17T18:17:16.920611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:15:13.551049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:25.064319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":251,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T18:17:20.348879+0000","last_change":"2024-09-17T18:17:18.620901+0000","last_active":"2024-09-17T18:17:20.348879+0000","last_peered":"2024-09-17T18:17:20.348879+0000","last_clean":"2024-09-17T18:17:20.348879+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:17:20.348879+0000","last_undegraded":"2024-09-17T18:17:20.348879+0000","last_fullsized":"2024-09-17T18:17:20.348879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:17:18.620733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:17:18.620733+0000","last_clean_scrub_stamp":"2024-09-17T18:17:18.620733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:42.033270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":237,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T18:17:16.920578+0000","last_change":"2024-09-17T18:16:37.106180+0000","last_active":"2024-09-17T18:17:16.920578+0000","last_peered":"2024-09-17T18:17:16.920578+0000","last_clean":"2024-09-17T18:17:16.920578+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:17:16.920578+0000","last_undegraded":"2024-09-17T18:17:16.920578+0000","last_fullsized":"2024-09-17T18:17:16.920578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:16:37.105982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:16:37.105982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:06.543641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"136'3","reported_seq":245,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T18:17:21.616939+0000","last_change":"2024-09-17T18:17:21.616783+0000","last_active":"2024-09-17T18:17:21.616939+0000","last_peered":"2024-09-17T18:17:21.616939+0000","last_clean":"2024-09-17T18:17:21.616939+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:17:21.616939+0000","last_undegraded":"2024-09-17T18:17:21.616939+0000","last_fullsized":"2024-09-17T18:17:21.616939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"136'3","last_scrub_stamp":"2024-09-17T18:17:21.616621+0000","last_deep_scrub":"136'3","last_deep_scrub_stamp":"2024-09-17T18:17:21.616621+0000","last_clean_scrub_stamp":"2024-09-17T18:17:21.616621+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:25.715901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":243,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T18:17:16.834585+0000","last_change":"2024-09-17T18:17:16.834585+0000","last_active":"2024-09-17T18:17:16.834585+0000","last_peered":"2024-09-17T18:17:16.834585+0000","last_clean":"2024-09-17T18:17:16.834585+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:17:16.834585+0000","last_undegraded":"2024-09-17T18:17:16.834585+0000","last_fullsized":"2024-09-17T18:17:16.834585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:17:16.834479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:17:16.834479+0000","last_clean_scrub_stamp":"2024-09-17T18:17:16.834479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:18.543950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":236,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T18:17:16.825438+0000","last_change":"2024-09-17T18:17:16.374905+0000","last_active":"2024-09-17T18:17:16.825438+0000","last_peered":"2024-09-17T18:17:16.825438+0000","last_clean":"2024-09-17T18:17:16.825438+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:17:16.825438+0000","last_undegraded":"2024-09-17T18:17:16.825438+0000","last_fullsized":"2024-09-17T18:17:16.825438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:17:16.374723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:15:13.551049+0000","last_clean_scrub_stamp":"2024-09-17T18:17:16.374723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:40.781009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":248,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T18:17:20.249697+0000","last_change":"2024-09-17T18:17:16.644808+0000","last_active":"2024-09-17T18:17:20.249697+0000","last_peered":"2024-09-17T18:17:20.249697+0000","last_clean":"2024-09-17T18:17:20.249697+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:17:20.249697+0000","last_undegraded":"2024-09-17T18:17:20.249697+0000","last_fullsized":"2024-09-17T18:17:20.249697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:17:16.644724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:17:16.644724+0000","last_clean_scrub_stamp":"2024-09-17T18:17:16.644724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:19.872433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":241,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T18:17:20.580928+0000","last_change":"2024-09-17T18:17:20.580928+0000","last_active":"2024-09-17T18:17:20.580928+0000","last_peered":"2024-09-17T18:17:20.580928+0000","last_clean":"2024-09-17T18:17:20.580928+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:17:20.580928+0000","last_undegraded":"2024-09-17T18:17:20.580928+0000","last_fullsized":"2024-09-17T18:17:20.580928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:17:20.580752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:17:20.580752+0000","last_clean_scrub_stamp":"2024-09-17T18:17:20.580752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:47.597648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247838,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51760,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320080,"statfs":{"total":96636764160,"available":96583761920,"internally_reserved":0,"allocated":2584576,"data_stored":1730732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247838,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2052096,"data_stored":1201804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33208,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338632,"statfs":{"total":96636764160,"available":96602759168,"internally_reserved":0,"allocated":2072576,"data_stored":1211483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313247,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33208,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338632,"statfs":{"total":96636764160,"available":96602759168,"internally_reserved":0,"allocated":2068480,"data_stored":1211464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280543,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51260,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320580,"statfs":{"total":96636764160,"available":96584273920,"internally_reserved":0,"allocated":2072576,"data_stored":1211483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[3,4,5,6,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313247,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33208,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338632,"statfs":{"total":96636764160,"available":96602759168,"internally_reserved":0,"allocated":2068480,"data_stored":1211464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33208,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338632,"statfs":{"total":96636764160,"available":96602759168,"internally_reserved":0,"allocated":2068480,"data_stored":1211464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280542,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33208,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338632,"statfs":{"total":96636764160,"available":96602759168,"internally_reserved":0,"allocated":2068480,"data_stored":1211464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[1,3,4,5,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313246,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51256,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320584,"statfs":{"total":96636764160,"available":96584278016,"internally_reserved":0,"allocated":2068480,"data_stored":1211464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51240,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320600,"statfs":{"total":96636764160,"available":96584294400,"internally_reserved":0,"allocated":2052096,"data_stored":1201804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,4,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29048,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342792,"statfs":{"total":96636764160,"available":96607019008,"internally_reserved":0,"allocated":2068480,"data_stored":1211464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2052096,"data_stored":1201804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247838,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55400,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316440,"statfs":{"total":96636764160,"available":96580034560,"internally_reserved":0,"allocated":2052096,"data_stored":1201804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247838,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":2584576,"data_stored":1730732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,3,5,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247837,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2052096,"data_stored":1201804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33208,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338632,"statfs":{"total":96636764160,"available":96602759168,"internally_reserved":0,"allocated":2068480,"data_stored":1211464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:17:23.013 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T18:16:47.414871+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=18, tm_min=16, tm_sec=47, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=18, tm_min=17, tm_sec=13, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T18:17:23.013 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T18:15:13.551049+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=18, tm_min=15, tm_sec=13, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=18, tm_min=17, tm_sec=13, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T18:17:23.013 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-17T18:16:37.105982+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=18, tm_min=16, tm_sec=37, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=18, tm_min=17, tm_sec=13, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T18:17:23.013 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T18:17:43.014 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T18:17:43.330 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T18:17:43.330 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T18:17:43.346 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-17T18:17:42.653609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":623944,"kb_used_data":34664,"kb_used_omap":24,"kb_used_meta":588903,"kb_avail":1509325496,"statfs":{"total":1546188226560,"available":1545549307904,"internally_reserved":0,"allocated":35495936,"data_stored":21224578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25519,"internal_metadata":603036753},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.120226"},"pg_stats":[{"pgid":"1.0","version":"136'114","reported_seq":393,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T18:17:36.973983+0000","last_change":"2024-09-17T18:17:20.532618+0000","last_active":"2024-09-17T18:17:36.973983+0000","last_peered":"2024-09-17T18:17:36.973983+0000","last_clean":"2024-09-17T18:17:36.973983+0000","last_became_active":"2024-09-17T18:15:13.922474+0000","last_became_peered":"2024-09-17T18:15:13.922474+0000","last_unstale":"2024-09-17T18:17:36.973983+0000","last_undegraded":"2024-09-17T18:17:36.973983+0000","last_fullsized":"2024-09-17T18:17:36.973983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"136'114","last_scrub_stamp":"2024-09-17T18:17:20.532429+0000","last_deep_scrub":"136'114","last_deep_scrub_stamp":"2024-09-17T18:17:20.532429+0000","last_clean_scrub_stamp":"2024-09-17T18:17:20.532429+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:31.400168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"136'2","reported_seq":252,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T18:17:36.973989+0000","last_change":"2024-09-17T18:17:22.677231+0000","last_active":"2024-09-17T18:17:36.973989+0000","last_peered":"2024-09-17T18:17:36.973989+0000","last_clean":"2024-09-17T18:17:36.973989+0000","last_became_active":"2024-09-17T18:15:14.576195+0000","last_became_peered":"2024-09-17T18:15:14.576195+0000","last_unstale":"2024-09-17T18:17:36.973989+0000","last_undegraded":"2024-09-17T18:17:36.973989+0000","last_fullsized":"2024-09-17T18:17:36.973989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"136'2","last_scrub_stamp":"2024-09-17T18:17:22.677068+0000","last_deep_scrub":"136'2","last_deep_scrub_stamp":"2024-09-17T18:17:22.677068+0000","last_clean_scrub_stamp":"2024-09-17T18:17:22.677068+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:24.032465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013223480000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":261,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T18:17:37.185209+0000","last_change":"2024-09-17T18:17:18.620901+0000","last_active":"2024-09-17T18:17:37.185209+0000","last_peered":"2024-09-17T18:17:37.185209+0000","last_clean":"2024-09-17T18:17:37.185209+0000","last_became_active":"2024-09-17T18:15:14.791291+0000","last_became_peered":"2024-09-17T18:15:14.791291+0000","last_unstale":"2024-09-17T18:17:37.185209+0000","last_undegraded":"2024-09-17T18:17:37.185209+0000","last_fullsized":"2024-09-17T18:17:37.185209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:17:18.620733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:17:18.620733+0000","last_clean_scrub_stamp":"2024-09-17T18:17:18.620733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:42.033270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089968199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":258,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T18:17:36.973983+0000","last_change":"2024-09-17T18:17:21.698079+0000","last_active":"2024-09-17T18:17:36.973983+0000","last_peered":"2024-09-17T18:17:36.973983+0000","last_clean":"2024-09-17T18:17:36.973983+0000","last_became_active":"2024-09-17T18:15:14.790541+0000","last_became_peered":"2024-09-17T18:15:14.790541+0000","last_unstale":"2024-09-17T18:17:36.973983+0000","last_undegraded":"2024-09-17T18:17:36.973983+0000","last_fullsized":"2024-09-17T18:17:36.973983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:17:21.697920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:17:21.697920+0000","last_clean_scrub_stamp":"2024-09-17T18:17:21.697920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:51.121955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"136'3","reported_seq":257,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T18:17:42.328253+0000","last_change":"2024-09-17T18:17:21.616783+0000","last_active":"2024-09-17T18:17:42.328253+0000","last_peered":"2024-09-17T18:17:42.328253+0000","last_clean":"2024-09-17T18:17:42.328253+0000","last_became_active":"2024-09-17T18:15:14.593346+0000","last_became_peered":"2024-09-17T18:15:14.593346+0000","last_unstale":"2024-09-17T18:17:42.328253+0000","last_undegraded":"2024-09-17T18:17:42.328253+0000","last_fullsized":"2024-09-17T18:17:42.328253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"136'3","last_scrub_stamp":"2024-09-17T18:17:21.616621+0000","last_deep_scrub":"136'3","last_deep_scrub_stamp":"2024-09-17T18:17:21.616621+0000","last_clean_scrub_stamp":"2024-09-17T18:17:21.616621+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:25.715901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0020275900000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":255,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T18:17:36.973448+0000","last_change":"2024-09-17T18:17:16.834585+0000","last_active":"2024-09-17T18:17:36.973448+0000","last_peered":"2024-09-17T18:17:36.973448+0000","last_clean":"2024-09-17T18:17:36.973448+0000","last_became_active":"2024-09-17T18:15:14.793952+0000","last_became_peered":"2024-09-17T18:15:14.793952+0000","last_unstale":"2024-09-17T18:17:36.973448+0000","last_undegraded":"2024-09-17T18:17:36.973448+0000","last_fullsized":"2024-09-17T18:17:36.973448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:17:16.834479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:17:16.834479+0000","last_clean_scrub_stamp":"2024-09-17T18:17:16.834479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:18.543950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00147657,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":257,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T18:17:36.631840+0000","last_change":"2024-09-17T18:17:22.268874+0000","last_active":"2024-09-17T18:17:36.631840+0000","last_peered":"2024-09-17T18:17:36.631840+0000","last_clean":"2024-09-17T18:17:36.631840+0000","last_became_active":"2024-09-17T18:15:14.586718+0000","last_became_peered":"2024-09-17T18:15:14.586718+0000","last_unstale":"2024-09-17T18:17:36.631840+0000","last_undegraded":"2024-09-17T18:17:36.631840+0000","last_fullsized":"2024-09-17T18:17:36.631840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:17:22.268704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:17:22.268704+0000","last_clean_scrub_stamp":"2024-09-17T18:17:22.268704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:39.597079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00084221199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":261,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T18:17:41.653701+0000","last_change":"2024-09-17T18:17:16.644808+0000","last_active":"2024-09-17T18:17:41.653701+0000","last_peered":"2024-09-17T18:17:41.653701+0000","last_clean":"2024-09-17T18:17:41.653701+0000","last_became_active":"2024-09-17T18:15:14.595776+0000","last_became_peered":"2024-09-17T18:15:14.595776+0000","last_unstale":"2024-09-17T18:17:41.653701+0000","last_undegraded":"2024-09-17T18:17:41.653701+0000","last_fullsized":"2024-09-17T18:17:41.653701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:17:16.644724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:17:16.644724+0000","last_clean_scrub_stamp":"2024-09-17T18:17:16.644724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:19.872433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00038864599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":254,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T18:17:42.328255+0000","last_change":"2024-09-17T18:17:20.580928+0000","last_active":"2024-09-17T18:17:42.328255+0000","last_peered":"2024-09-17T18:17:42.328255+0000","last_clean":"2024-09-17T18:17:42.328255+0000","last_became_active":"2024-09-17T18:15:14.604251+0000","last_became_peered":"2024-09-17T18:15:14.604251+0000","last_unstale":"2024-09-17T18:17:42.328255+0000","last_undegraded":"2024-09-17T18:17:42.328255+0000","last_fullsized":"2024-09-17T18:17:42.328255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T18:17:20.580752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T18:17:20.580752+0000","last_clean_scrub_stamp":"2024-09-17T18:17:20.580752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:47.597648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010769079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247842,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51856,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319984,"statfs":{"total":96636764160,"available":96583663616,"internally_reserved":0,"allocated":2682880,"data_stored":1788742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247842,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33292,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338548,"statfs":{"total":96636764160,"available":96602673152,"internally_reserved":0,"allocated":2150400,"data_stored":1259814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,3,5,6,7,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33292,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338548,"statfs":{"total":96636764160,"available":96602673152,"internally_reserved":0,"allocated":2154496,"data_stored":1259833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313251,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33292,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338548,"statfs":{"total":96636764160,"available":96602673152,"internally_reserved":0,"allocated":2150400,"data_stored":1259814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280547,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51344,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320496,"statfs":{"total":96636764160,"available":96584187904,"internally_reserved":0,"allocated":2154496,"data_stored":1259833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[3,4,5,6,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313252,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33292,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338548,"statfs":{"total":96636764160,"available":96602673152,"internally_reserved":0,"allocated":2150400,"data_stored":1259814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,3,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280545,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33288,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338552,"statfs":{"total":96636764160,"available":96602677248,"internally_reserved":0,"allocated":2150400,"data_stored":1259814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280546,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33292,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338548,"statfs":{"total":96636764160,"available":96602673152,"internally_reserved":0,"allocated":2150400,"data_stored":1259814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[1,3,4,5,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313250,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51336,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320504,"statfs":{"total":96636764160,"available":96584196096,"internally_reserved":0,"allocated":2150400,"data_stored":1259814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51340,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320500,"statfs":{"total":96636764160,"available":96584192000,"internally_reserved":0,"allocated":2150400,"data_stored":1259814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,4,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29128,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342712,"statfs":{"total":96636764160,"available":96606937088,"internally_reserved":0,"allocated":2150400,"data_stored":1259814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247840,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33288,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338552,"statfs":{"total":96636764160,"available":96602677248,"internally_reserved":0,"allocated":2150400,"data_stored":1259814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247842,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55500,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316340,"statfs":{"total":96636764160,"available":96579932160,"internally_reserved":0,"allocated":2150400,"data_stored":1259814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247842,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":2682880,"data_stored":1788742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,3,5,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247841,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33288,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338552,"statfs":{"total":96636764160,"available":96602677248,"internally_reserved":0,"allocated":2150400,"data_stored":1259814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[2,3,4,5,6,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280545,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":1269474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,4,5,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T18:17:43.348 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T18:17:43.680 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T18:17:43.680 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T18:17:43.680 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T18:17:43.680 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:43.759 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T18:17:43.759 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T18:17:43.759 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:43.838 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T18:17:43.838 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2024-09-17T18:17:43.839 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:43.925 INFO:tasks.ceph.osd.8:Stopped 2024-09-17T18:17:43.926 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2024-09-17T18:17:43.926 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:44.011 INFO:tasks.ceph.osd.12:Stopped 2024-09-17T18:17:44.011 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T18:17:44.011 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:44.084 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T18:17:44.084 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T18:17:44.084 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:44.177 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T18:17:44.177 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2024-09-17T18:17:44.177 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:44.260 INFO:tasks.ceph.osd.9:Stopped 2024-09-17T18:17:44.260 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2024-09-17T18:17:44.260 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:44.343 INFO:tasks.ceph.osd.13:Stopped 2024-09-17T18:17:44.343 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T18:17:44.343 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:44.434 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T18:17:44.435 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T18:17:44.435 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:48.795 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-17T18:17:50.537 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T18:17:50.538 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2024-09-17T18:17:50.538 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:50.601 INFO:tasks.ceph.osd.10:Stopped 2024-09-17T18:17:50.602 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2024-09-17T18:17:50.602 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:50.683 INFO:tasks.ceph.osd.14:Stopped 2024-09-17T18:17:50.683 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T18:17:50.683 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:50.754 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T18:17:50.754 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T18:17:50.755 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:50.843 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T18:17:50.844 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2024-09-17T18:17:50.844 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:50.941 INFO:tasks.ceph.osd.11:Stopped 2024-09-17T18:17:50.942 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2024-09-17T18:17:50.942 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:51.029 INFO:tasks.ceph.osd.15:Stopped 2024-09-17T18:17:51.029 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T18:17:51.029 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T18:17:51.029 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:51.060 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T18:17:51.060 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T18:17:51.060 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:51.090 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T18:17:51.091 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T18:17:51.091 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T18:17:51.091 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:51.116 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T18:17:51.116 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T18:17:51.116 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:51.138 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T18:17:51.138 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T18:17:51.138 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T18:17:51.163 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T18:17:51.163 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T18:17:51.163 DEBUG:teuthology.orchestra.run.smithi087:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'slow request' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-17T18:17:51.184 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T18:17:51.184 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T18:17:51.455 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T18:17:51.455 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T18:17:51.635 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T18:17:51.635 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2024-09-17T18:17:51.776 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T18:17:51.776 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2024-09-17T18:17:51.917 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-17T18:17:51.918 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T18:17:52.308 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-17T18:17:52.308 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T18:17:52.494 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-17T18:17:52.494 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2024-09-17T18:17:52.621 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-17T18:17:52.621 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2024-09-17T18:17:52.770 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T18:17:52.770 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T18:17:53.073 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T18:17:53.073 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T18:17:53.303 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T18:17:53.303 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2024-09-17T18:17:53.519 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T18:17:53.519 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2024-09-17T18:17:53.734 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T18:17:53.734 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T18:17:53.796 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-17T18:17:53.914 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T18:17:53.914 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T18:17:54.112 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T18:17:54.112 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2024-09-17T18:17:54.305 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T18:17:54.306 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2024-09-17T18:17:54.488 INFO:tasks.ceph:Archiving mon data... 2024-09-17T18:17:54.489 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228/data/mon.a.tgz 2024-09-17T18:17:54.489 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-09-17T18:17:54.495 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.uX82dGNNSu 2024-09-17T18:17:54.495 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.uX82dGNNSu 2024-09-17T18:17:54.647 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.uX82dGNNSu 2024-09-17T18:17:54.716 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.uX82dGNNSu is 426KB 2024-09-17T18:17:54.777 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.uX82dGNNSu 2024-09-17T18:17:54.783 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228/data/mon.b.tgz 2024-09-17T18:17:54.783 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-17T18:17:54.789 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.PuomczzTsn 2024-09-17T18:17:54.789 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.PuomczzTsn 2024-09-17T18:17:54.988 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.PuomczzTsn 2024-09-17T18:17:55.052 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.PuomczzTsn is 608KB 2024-09-17T18:17:55.114 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.PuomczzTsn 2024-09-17T18:17:55.119 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228/data/mon.c.tgz 2024-09-17T18:17:55.119 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2024-09-17T18:17:55.125 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.m1rtelS3DA 2024-09-17T18:17:55.125 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.m1rtelS3DA 2024-09-17T18:17:55.308 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.m1rtelS3DA 2024-09-17T18:17:55.368 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.m1rtelS3DA is 608KB 2024-09-17T18:17:55.434 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.m1rtelS3DA 2024-09-17T18:17:55.440 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T18:17:55.440 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T18:17:55.442 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T18:17:55.444 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T18:17:55.486 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T18:17:55.506 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T18:17:55.511 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T18:17:55.544 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T18:17:55.549 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T18:17:55.550 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T18:17:55.551 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228/remote/smithi087/crash 2024-09-17T18:17:55.552 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T18:17:55.565 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228/remote/smithi134/crash 2024-09-17T18:17:55.566 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T18:17:55.581 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228/remote/smithi146/crash 2024-09-17T18:17:55.582 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T18:17:55.601 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228/remote/smithi154/crash 2024-09-17T18:17:55.602 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T18:17:55.615 INFO:tasks.ceph:Compressing logs... 2024-09-17T18:17:55.615 DEBUG:teuthology.orchestra.run.smithi087:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T18:17:55.618 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T18:17:55.629 DEBUG:teuthology.orchestra.run.smithi146:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T18:17:55.646 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35018.log 2024-09-17T18:17:55.646 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32037.log 2024-09-17T18:17:55.646 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35018.log.gz 2024-09-17T18:17:55.647 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30920.log 2024-09-17T18:17:55.647 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32037.log.gz 2024-09-17T18:17:55.647 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37724.log 2024-09-17T18:17:55.649 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32227.log 2024-09-17T18:17:55.649 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.30920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30920.log.gz 2024-09-17T18:17:55.649 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37724.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-mgr.y.log 2024-09-17T18:17:55.649 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37724.log.gz 2024-09-17T18:17:55.649 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32227.log.gz 2024-09-17T18:17:55.649 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35100.log 2024-09-17T18:17:55.649 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39055.log 2024-09-17T18:17:55.650 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T18:17:55.660 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T18:17:55.660 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T18:17:55.660 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T18:17:55.660 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T18:17:55.660 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2024-09-17T18:17:55.660 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2024-09-17T18:17:55.660 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T18:17:55.661 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.13.log: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T18:17:55.663 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mon.b.log: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T18:17:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T18:17:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T18:17:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2024-09-17T18:17:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T18:17:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.14.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T18:17:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T18:17:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2024-09-17T18:17:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-osd.10.log: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T18:17:55.674 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T18:17:55.683 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.35100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36712.log 2024-09-17T18:17:55.683 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35100.log.gz 2024-09-17T18:17:55.683 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39055.log.gz 2024-09-17T18:17:55.683 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37681.log 2024-09-17T18:17:55.683 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37305.log 2024-09-17T18:17:55.683 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36712.log.gz 2024-09-17T18:17:55.683 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36051.log 2024-09-17T18:17:55.683 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37681.log.gz 2024-09-17T18:17:55.683 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38431.log 2024-09-17T18:17:55.684 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37305.log.gz 2024-09-17T18:17:55.684 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31975.log 2024-09-17T18:17:55.684 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36051.log.gz 2024-09-17T18:17:55.684 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36738.log 2024-09-17T18:17:55.684 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38431.log.gz 2024-09-17T18:17:55.684 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26651.log 2024-09-17T18:17:55.684 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31975.log.gz 2024-09-17T18:17:55.684 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32688.log 2024-09-17T18:17:55.684 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36738.log.gz 2024-09-17T18:17:55.684 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.26651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35830.log 2024-09-17T18:17:55.684 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26651.log.gz 2024-09-17T18:17:55.684 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31195.log 2024-09-17T18:17:55.684 INFO:teuthology.orchestra.run.smithi087.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.32688.log.gz 2024-09-17T18:17:55.685 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37183.log 2024-09-17T18:17:55.685 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35830.log.gz 2024-09-17T18:17:55.685 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32305.log 2024-09-17T18:17:55.685 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31195.log.gz 2024-09-17T18:17:55.685 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T18:17:55.685 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37183.log.gz 2024-09-17T18:17:55.685 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32577.log 2024-09-17T18:17:55.685 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32305.log.gz 2024-09-17T18:17:55.685 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38665.log 2024-09-17T18:17:55.685 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36634.log 2024-09-17T18:17:55.685 INFO:teuthology.orchestra.run.smithi087.stderr: 25.0% -- replaced with /var/log/ceph/ceph-client.admin.32577.log.gz 2024-09-17T18:17:55.685 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38665.log.gz 2024-09-17T18:17:55.686 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31179.log 2024-09-17T18:17:55.686 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33360.log 2024-09-17T18:17:55.686 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36634.log.gz 2024-09-17T18:17:55.686 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31600.log 2024-09-17T18:17:55.686 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31179.log.gz 2024-09-17T18:17:55.686 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33360.log.gz 2024-09-17T18:17:55.686 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35915.log 2024-09-17T18:17:55.686 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33115.log 2024-09-17T18:17:55.686 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31600.log.gz 2024-09-17T18:17:55.686 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35915.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35915.log.gz 2024-09-17T18:17:55.686 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37303.log 2024-09-17T18:17:55.686 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37661.log 2024-09-17T18:17:55.687 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33115.log.gz 2024-09-17T18:17:55.687 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37303.log.gz 2024-09-17T18:17:55.687 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32630.log 2024-09-17T18:17:55.687 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34625.log 2024-09-17T18:17:55.687 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37661.log.gz 2024-09-17T18:17:55.687 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32630.log.gz 2024-09-17T18:17:55.687 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38171.log 2024-09-17T18:17:55.687 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35349.log 2024-09-17T18:17:55.687 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34625.log.gz 2024-09-17T18:17:55.687 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38171.log.gz 2024-09-17T18:17:55.687 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36894.log 2024-09-17T18:17:55.687 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35297.log 2024-09-17T18:17:55.687 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35349.log.gz 2024-09-17T18:17:55.687 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36894.log.gz 2024-09-17T18:17:55.688 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37302.log 2024-09-17T18:17:55.688 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37693.log 2024-09-17T18:17:55.688 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35297.log.gz 2024-09-17T18:17:55.688 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37302.log.gz 2024-09-17T18:17:55.688 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31581.log 2024-09-17T18:17:55.688 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31557.log 2024-09-17T18:17:55.688 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37693.log.gz 2024-09-17T18:17:55.688 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31581.log.gz 2024-09-17T18:17:55.688 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31057.log 2024-09-17T18:17:55.688 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32335.log 2024-09-17T18:17:55.688 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31557.log.gz 2024-09-17T18:17:55.688 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31057.log.gz 2024-09-17T18:17:55.688 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38197.log 2024-09-17T18:17:55.689 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35458.log 2024-09-17T18:17:55.689 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32335.log.gz 2024-09-17T18:17:55.689 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38197.log.gz 2024-09-17T18:17:55.689 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34561.log 2024-09-17T18:17:55.689 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37291.log 2024-09-17T18:17:55.689 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35458.log.gz 2024-09-17T18:17:55.689 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34561.log.gz 2024-09-17T18:17:55.689 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38821.log 2024-09-17T18:17:55.689 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36764.log 2024-09-17T18:17:55.689 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37291.log.gz 2024-09-17T18:17:55.689 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38821.log.gz 2024-09-17T18:17:55.689 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2024-09-17T18:17:55.689 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31551.log 2024-09-17T18:17:55.690 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36764.log.gz 2024-09-17T18:17:55.690 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32847.log 2024-09-17T18:17:55.690 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31551.log.gz 2024-09-17T18:17:55.690 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34658.log 2024-09-17T18:17:55.690 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30970.log 2024-09-17T18:17:55.690 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32847.log.gz 2024-09-17T18:17:55.690 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36686.log 2024-09-17T18:17:55.690 INFO:teuthology.orchestra.run.smithi087.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.34658.log.gz 2024-09-17T18:17:55.690 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.30970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32851.log 0.0% 2024-09-17T18:17:55.690 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30970.log.gz 2024-09-17T18:17:55.690 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36686.log.gz 2024-09-17T18:17:55.690 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33119.log 2024-09-17T18:17:55.690 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35864.log 2024-09-17T18:17:55.691 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32851.log.gz 2024-09-17T18:17:55.691 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36252.log 2024-09-17T18:17:55.691 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33119.log.gz 2024-09-17T18:17:55.691 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32534.log 2024-09-17T18:17:55.691 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35864.log.gz 2024-09-17T18:17:55.691 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36252.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.36252.log.gz -- 2024-09-17T18:17:55.691 INFO:teuthology.orchestra.run.smithi087.stderr: /var/log/ceph/ceph-client.admin.34556.log 2024-09-17T18:17:55.691 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37321.log 2024-09-17T18:17:55.691 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32534.log.gz 2024-09-17T18:17:55.691 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38561.log 2024-09-17T18:17:55.691 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34556.log.gz 2024-09-17T18:17:55.691 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39131.log 2024-09-17T18:17:55.691 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37321.log.gz 2024-09-17T18:17:55.692 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38561.log.gz 2024-09-17T18:17:55.692 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34448.log 2024-09-17T18:17:55.692 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35374.log 2024-09-17T18:17:55.692 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39131.log.gz 2024-09-17T18:17:55.692 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34448.log.gz 2024-09-17T18:17:55.692 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T18:17:55.692 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38405.log 2024-09-17T18:17:55.692 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35374.log.gz 2024-09-17T18:17:55.692 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36660.log 2024-09-17T18:17:55.692 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38951.log 2024-09-17T18:17:55.692 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38405.log.gz 2024-09-17T18:17:55.692 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33250.log 2024-09-17T18:17:55.693 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36660.log.gz 2024-09-17T18:17:55.693 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38951.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36400.log 2024-09-17T18:17:55.693 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38951.log.gz 2024-09-17T18:17:55.693 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32175.log 2024-09-17T18:17:55.693 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33250.log.gz 2024-09-17T18:17:55.693 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34162.log 2024-09-17T18:17:55.693 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36400.log.gz 2024-09-17T18:17:55.693 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32175.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38145.log 2024-09-17T18:17:55.693 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32175.log.gz 2024-09-17T18:17:55.693 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35580.log 2024-09-17T18:17:55.693 INFO:teuthology.orchestra.run.smithi087.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.34162.log.gz 2024-09-17T18:17:55.693 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34021.log 2024-09-17T18:17:55.693 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38145.log.gz 2024-09-17T18:17:55.694 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35580.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37288.log 2024-09-17T18:17:55.694 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35580.log.gz 2024-09-17T18:17:55.694 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31189.log 2024-09-17T18:17:55.694 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34021.log.gz 2024-09-17T18:17:55.694 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34502.log 2024-09-17T18:17:55.694 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37288.log.gz 2024-09-17T18:17:55.707 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26299.log 2024-09-17T18:17:55.707 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26371.log 2024-09-17T18:17:55.708 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26299.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T18:17:55.708 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26299.log.gz 2024-09-17T18:17:55.708 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26371.log.gz 2024-09-17T18:17:55.708 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26323.log 2024-09-17T18:17:55.708 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26450.log 2024-09-17T18:17:55.708 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26275.log 2024-09-17T18:17:55.708 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26323.log.gz 2024-09-17T18:17:55.708 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26450.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T18:17:55.708 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26450.log.gz 2024-09-17T18:17:55.708 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26275.log.gz 2024-09-17T18:17:55.708 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2024-09-17T18:17:55.708 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2024-09-17T18:17:55.709 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26251.log 2024-09-17T18:17:55.709 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.15.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T18:17:55.709 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26574.log 2024-09-17T18:17:55.709 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26251.log.gz 2024-09-17T18:17:55.709 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5/var/log/ceph/ceph-mgr.x.log: --verbose -- /var/log/ceph/ceph-client.admin.26203.log 2024-09-17T18:17:55.709 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26574.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26550.log 2024-09-17T18:17:55.709 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26574.log.gz 2024-09-17T18:17:55.709 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.26203.log: /var/log/ceph/ceph-client.admin.26477.log 2024-09-17T18:17:55.709 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26203.log.gz 2024-09-17T18:17:55.709 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26501.log 2024-09-17T18:17:55.709 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26550.log.gz 2024-09-17T18:17:55.709 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26477.log.gz 2024-09-17T18:17:55.709 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32074.log 2024-09-17T18:17:55.710 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26347.log 2024-09-17T18:17:55.710 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26501.log.gz 2024-09-17T18:17:55.710 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.32074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26227.log 2024-09-17T18:17:55.710 INFO:teuthology.orchestra.run.smithi154.stderr: 76.8% -- replaced with /var/log/ceph/ceph-client.0.32074.log.gz/var/log/ceph/ceph-client.admin.26347.log: 2024-09-17T18:17:55.710 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26426.log 2024-09-17T18:17:55.710 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26347.log.gz 2024-09-17T18:17:55.710 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26402.log 2024-09-17T18:17:55.710 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26227.log: /var/log/ceph/ceph-client.admin.26426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26227.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26525.log 2024-09-17T18:17:55.710 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% 2024-09-17T18:17:55.710 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26426.log.gz 2024-09-17T18:17:55.710 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26402.log.gz 2024-09-17T18:17:55.710 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T18:17:55.710 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26525.log.gz 2024-09-17T18:17:55.764 INFO:teuthology.orchestra.run.smithi134.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T18:17:55.766 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31189.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37711.log 2024-09-17T18:17:55.766 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31189.log.gz 2024-09-17T18:17:55.767 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38119.log 2024-09-17T18:17:55.767 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34502.log.gz 2024-09-17T18:17:55.767 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36374.log 2024-09-17T18:17:55.767 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37711.log.gz 2024-09-17T18:17:55.767 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38119.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31194.log 2024-09-17T18:17:55.767 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38119.log.gz 2024-09-17T18:17:55.767 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26338.log 2024-09-17T18:17:55.767 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36374.log.gz 2024-09-17T18:17:55.767 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31575.log 2024-09-17T18:17:55.767 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31194.log.gz 2024-09-17T18:17:55.767 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.26338.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.26338.log.gz -- 2024-09-17T18:17:55.767 INFO:teuthology.orchestra.run.smithi087.stderr: /var/log/ceph/ceph-client.admin.31971.log 2024-09-17T18:17:55.767 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34047.log 2024-09-17T18:17:55.768 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31575.log.gz 2024-09-17T18:17:55.768 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31971.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39081.log 2024-09-17T18:17:55.768 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31971.log.gz 2024-09-17T18:17:55.768 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36842.log 2024-09-17T18:17:55.768 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34047.log.gz 2024-09-17T18:17:55.768 INFO:teuthology.orchestra.run.smithi087.stderr:gzip/var/log/ceph/ceph-client.admin.39081.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38353.log 2024-09-17T18:17:55.768 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39081.log.gz 2024-09-17T18:17:55.768 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35062.log 2024-09-17T18:17:55.768 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36842.log.gz 2024-09-17T18:17:55.768 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38613.log 28.8% 2024-09-17T18:17:55.768 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38353.log.gz 2024-09-17T18:17:55.768 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33650.log 2024-09-17T18:17:55.769 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35062.log.gz 2024-09-17T18:17:55.769 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35323.log 2024-09-17T18:17:55.769 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38613.log.gz 2024-09-17T18:17:55.769 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33650.log.gz 2024-09-17T18:17:55.769 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35515.log 2024-09-17T18:17:55.769 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35755.log 2024-09-17T18:17:55.769 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35323.log.gz 2024-09-17T18:17:55.769 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35698.log 2024-09-17T18:17:55.769 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35515.log.gz 2024-09-17T18:17:55.769 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35755.log.gz 2024-09-17T18:17:55.769 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37157.log 2024-09-17T18:17:55.769 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36504.log 2024-09-17T18:17:55.770 INFO:teuthology.orchestra.run.smithi087.stderr: 24.6% -- replaced with /var/log/ceph/ceph-client.admin.35698.log.gz 2024-09-17T18:17:55.770 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37720.log 2024-09-17T18:17:55.770 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37157.log.gz 2024-09-17T18:17:55.770 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34977.log 2024-09-17T18:17:55.770 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36504.log.gz 2024-09-17T18:17:55.770 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38379.log 2024-09-17T18:17:55.770 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37720.log.gz 2024-09-17T18:17:55.770 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38509.log 2024-09-17T18:17:55.770 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34977.log.gz 2024-09-17T18:17:55.770 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32797.log 2024-09-17T18:17:55.770 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38379.log.gz 2024-09-17T18:17:55.770 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38509.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31170.log 2024-09-17T18:17:55.770 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38509.log.gz 2024-09-17T18:17:55.771 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36207.log 2024-09-17T18:17:55.771 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32797.log.gz 2024-09-17T18:17:55.771 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38795.log 2024-09-17T18:17:55.771 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31170.log.gz 2024-09-17T18:17:55.771 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36207.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38327.log 2024-09-17T18:17:55.771 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36207.log.gz 2024-09-17T18:17:55.771 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31597.log 2024-09-17T18:17:55.771 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38795.log.gz 2024-09-17T18:17:55.771 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32743.log 2024-09-17T18:17:55.771 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38327.log.gz 2024-09-17T18:17:55.771 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31597.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37131.log 2024-09-17T18:17:55.771 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31597.log.gz 2024-09-17T18:17:55.771 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34765.log 2024-09-17T18:17:55.771 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32743.log.gz 2024-09-17T18:17:55.772 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26470.log 2024-09-17T18:17:55.772 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37131.log.gz 2024-09-17T18:17:55.772 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34765.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33031.log 2024-09-17T18:17:55.772 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34765.log.gz 2024-09-17T18:17:55.772 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.26470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36156.log 2024-09-17T18:17:55.772 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26470.log.gz 2024-09-17T18:17:55.772 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38457.log 2024-09-17T18:17:55.772 INFO:teuthology.orchestra.run.smithi087.stderr: 24.9% -- replaced with /var/log/ceph/ceph-client.admin.33031.log.gz 2024-09-17T18:17:55.772 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36156.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31598.log 2024-09-17T18:17:55.772 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36156.log.gz 2024-09-17T18:17:55.772 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37758.log 2024-09-17T18:17:55.772 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38457.log.gz 2024-09-17T18:17:55.772 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38249.log 2024-09-17T18:17:55.773 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31598.log.gz 2024-09-17T18:17:55.773 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37758.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.33696.log 2024-09-17T18:17:55.773 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37758.log.gz 2024-09-17T18:17:55.773 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33541.log 2024-09-17T18:17:55.773 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38249.log.gz 2024-09-17T18:17:55.773 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31109.log 2024-09-17T18:17:55.773 INFO:teuthology.orchestra.run.smithi087.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.33696.log.gz 2024-09-17T18:17:55.773 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37701.log 2024-09-17T18:17:55.773 INFO:teuthology.orchestra.run.smithi087.stderr: 25.6% -- replaced with /var/log/ceph/ceph-client.admin.33541.log.gz 2024-09-17T18:17:55.773 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35095.log 2024-09-17T18:17:55.773 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31109.log.gz 2024-09-17T18:17:55.773 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32621.log 2024-09-17T18:17:55.773 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37701.log.gz 2024-09-17T18:17:55.773 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38587.log 2024-09-17T18:17:55.774 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35095.log.gz 2024-09-17T18:17:55.774 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37285.log 2024-09-17T18:17:55.774 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32621.log.gz 2024-09-17T18:17:55.774 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31193.log 2024-09-17T18:17:55.774 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38587.log.gz 2024-09-17T18:17:55.774 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31572.log 2024-09-17T18:17:55.774 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37285.log.gz 2024-09-17T18:17:55.774 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36608.log 2024-09-17T18:17:55.774 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31193.log.gz 2024-09-17T18:17:55.774 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31181.log 2024-09-17T18:17:55.774 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31572.log.gz 2024-09-17T18:17:55.774 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36342.log 2024-09-17T18:17:55.775 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36608.log.gz 2024-09-17T18:17:55.775 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31506.log 2024-09-17T18:17:55.775 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31181.log.gz 2024-09-17T18:17:55.775 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33359.log 2024-09-17T18:17:55.775 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36342.log.gz 2024-09-17T18:17:55.775 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31607.log 2024-09-17T18:17:55.775 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31506.log.gz 2024-09-17T18:17:55.775 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37708.log 2024-09-17T18:17:55.775 INFO:teuthology.orchestra.run.smithi087.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.33359.log.gz 2024-09-17T18:17:55.775 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34313.log 2024-09-17T18:17:55.775 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31607.log.gz 2024-09-17T18:17:55.775 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38925.log 2024-09-17T18:17:55.775 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37708.log.gz 2024-09-17T18:17:55.776 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31164.log 2024-09-17T18:17:55.776 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34313.log.gz 2024-09-17T18:17:55.776 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33192.log 2024-09-17T18:17:55.776 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38925.log.gz 2024-09-17T18:17:55.776 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31571.log 2024-09-17T18:17:55.776 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31164.log.gz 2024-09-17T18:17:55.776 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38639.log 2024-09-17T18:17:55.776 INFO:teuthology.orchestra.run.smithi087.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.33192.log.gz/var/log/ceph/ceph-client.admin.31571.log: 2024-09-17T18:17:55.776 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34927.log 2024-09-17T18:17:55.776 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31571.log.gz 2024-09-17T18:17:55.776 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38639.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.38639.log.gz 2024-09-17T18:17:55.776 INFO:teuthology.orchestra.run.smithi087.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32056.log 2024-09-17T18:17:55.777 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31169.log 2024-09-17T18:17:55.777 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34927.log.gz 2024-09-17T18:17:55.777 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36182.log 2024-09-17T18:17:55.777 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32056.log.gz 2024-09-17T18:17:55.777 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37209.log 2024-09-17T18:17:55.777 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31169.log.gz 2024-09-17T18:17:55.777 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33839.log 2024-09-17T18:17:55.777 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36182.log.gz 2024-09-17T18:17:55.777 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37209.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T18:17:55.777 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37209.log.gz 2024-09-17T18:17:55.777 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34732.log 2024-09-17T18:17:55.777 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33839.log.gz 2024-09-17T18:17:55.777 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36291.log 2024-09-17T18:17:55.778 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32201.log 2024-09-17T18:17:55.778 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34732.log.gz 2024-09-17T18:17:55.778 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39107.log 2024-09-17T18:17:55.778 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36291.log.gz 2024-09-17T18:17:55.778 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34771.log 2024-09-17T18:17:55.778 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32201.log.gz 2024-09-17T18:17:55.778 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39107.log: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T18:17:55.778 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33006.log 2024-09-17T18:17:55.778 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39107.log.gz 2024-09-17T18:17:55.778 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32375.log 2024-09-17T18:17:55.778 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34771.log.gz 2024-09-17T18:17:55.778 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38301.log 2024-09-17T18:17:55.779 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33006.log: 92.1% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33006.log.gz 2024-09-17T18:17:55.779 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T18:17:55.779 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37316.log 2024-09-17T18:17:55.779 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32375.log.gz 2024-09-17T18:17:55.779 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35378.log 2024-09-17T18:17:55.779 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38301.log.gz 2024-09-17T18:17:55.779 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32373.log 2024-09-17T18:17:55.779 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37316.log.gz 2024-09-17T18:17:55.779 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37079.log 2024-09-17T18:17:55.779 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35378.log.gz 2024-09-17T18:17:55.779 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37319.log 2024-09-17T18:17:55.779 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32373.log: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.32373.log.gz 2024-09-17T18:17:55.779 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34071.log 2024-09-17T18:17:55.780 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37079.log.gz 2024-09-17T18:17:55.780 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37319.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.37320.log 2024-09-17T18:17:55.780 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37319.log.gz 2024-09-17T18:17:55.780 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36790.log 2024-09-17T18:17:55.780 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34071.log.gz 2024-09-17T18:17:55.780 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33781.log 2024-09-17T18:17:55.780 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37320.log.gz 2024-09-17T18:17:55.780 INFO:teuthology.orchestra.run.smithi087.stderr:gzip/var/log/ceph/ceph-client.admin.36790.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36556.log 2024-09-17T18:17:55.780 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36790.log.gz 2024-09-17T18:17:55.780 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34221.log 2024-09-17T18:17:55.780 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33781.log.gz 2024-09-17T18:17:55.780 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36556.log.gzgzip 2024-09-17T18:17:55.780 INFO:teuthology.orchestra.run.smithi087.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31999.log 2024-09-17T18:17:55.781 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31967.log 2024-09-17T18:17:55.781 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34221.log.gz 2024-09-17T18:17:55.781 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31999.log.gz 2024-09-17T18:17:55.781 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31192.log 2024-09-17T18:17:55.781 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36920.log 2024-09-17T18:17:55.781 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31967.log.gz 2024-09-17T18:17:55.781 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32253.log 2024-09-17T18:17:55.781 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31192.log.gz 2024-09-17T18:17:55.781 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36920.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.31184.log -- replaced with /var/log/ceph/ceph-client.admin.36920.log.gz 2024-09-17T18:17:55.781 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-09-17T18:17:55.781 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35890.log 2024-09-17T18:17:55.781 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32253.log.gz 2024-09-17T18:17:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31184.log.gz 2024-09-17T18:17:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37281.log 2024-09-17T18:17:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31590.log 2024-09-17T18:17:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35890.log.gz 2024-09-17T18:17:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37281.log.gz 2024-09-17T18:17:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37235.log 2024-09-17T18:17:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37314.log 2024-09-17T18:17:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31590.log.gz 2024-09-17T18:17:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33489.log 2024-09-17T18:17:55.782 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37235.log.gz 2024-09-17T18:17:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37304.log 2024-09-17T18:17:55.782 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37314.log.gz 2024-09-17T18:17:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33489.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.33489.log.gz 2024-09-17T18:17:55.782 INFO:teuthology.orchestra.run.smithi087.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31160.log 2024-09-17T18:17:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37746.log 2024-09-17T18:17:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37304.log.gz 2024-09-17T18:17:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34473.log 2024-09-17T18:17:55.783 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31160.log.gz 2024-09-17T18:17:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36972.log 2024-09-17T18:17:55.783 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37746.log.gz 2024-09-17T18:17:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35153.log 2024-09-17T18:17:55.783 INFO:teuthology.orchestra.run.smithi087.stderr: 25.0% -- replaced with /var/log/ceph/ceph-client.admin.34473.log.gz 2024-09-17T18:17:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36972.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.33747.log -- replaced with /var/log/ceph/ceph-client.admin.36972.log.gz 2024-09-17T18:17:55.783 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-09-17T18:17:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36998.log 2024-09-17T18:17:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35153.log.gz 2024-09-17T18:17:55.784 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33747.log.gz 2024-09-17T18:17:55.784 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36130.log 2024-09-17T18:17:55.784 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33167.log 2024-09-17T18:17:55.784 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36998.log.gz 2024-09-17T18:17:55.784 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35225.log 2024-09-17T18:17:55.784 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36130.log.gz 2024-09-17T18:17:55.784 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37713.log 2024-09-17T18:17:55.784 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33167.log.gz 2024-09-17T18:17:55.784 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31594.log 2024-09-17T18:17:55.784 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35225.log.gz 2024-09-17T18:17:55.784 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37713.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.37713.log.gz -5 2024-09-17T18:17:55.784 INFO:teuthology.orchestra.run.smithi087.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31031.log 2024-09-17T18:17:55.784 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T18:17:55.785 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31594.log.gz 2024-09-17T18:17:55.785 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31562.log 2024-09-17T18:17:55.785 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31031.log.gz 2024-09-17T18:17:55.785 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38717.log 2024-09-17T18:17:55.785 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35941.log 2024-09-17T18:17:55.785 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31562.log.gz 2024-09-17T18:17:55.785 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38535.log 2024-09-17T18:17:55.785 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38717.log.gz 2024-09-17T18:17:55.785 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38275.log 2024-09-17T18:17:55.785 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35941.log.gz 2024-09-17T18:17:55.785 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35261.log 2024-09-17T18:17:55.785 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38535.log.gz 2024-09-17T18:17:55.786 INFO:teuthology.orchestra.run.smithi087.stderr: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T18:17:55.786 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39003.log 2024-09-17T18:17:55.786 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38275.log.gz 2024-09-17T18:17:55.786 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37105.log 2024-09-17T18:17:55.786 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35261.log.gz 2024-09-17T18:17:55.786 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31658.log 2024-09-17T18:17:55.786 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39003.log.gz 2024-09-17T18:17:55.786 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31083.log 2024-09-17T18:17:55.786 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37105.log.gz 2024-09-17T18:17:55.786 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31174.log 2024-09-17T18:17:55.786 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31658.log.gz 2024-09-17T18:17:55.786 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31083.log.gz 2024-09-17T18:17:55.786 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32035.log 2024-09-17T18:17:55.787 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37718.log 2024-09-17T18:17:55.787 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31174.log.gz 2024-09-17T18:17:55.787 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34816.log 2024-09-17T18:17:55.787 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32035.log.gz 2024-09-17T18:17:55.787 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38769.log 2024-09-17T18:17:55.787 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37718.log.gz 2024-09-17T18:17:55.787 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36317.log 2024-09-17T18:17:55.787 INFO:teuthology.orchestra.run.smithi087.stderr: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.34816.log.gz 2024-09-17T18:17:55.787 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37053.log 2024-09-17T18:17:55.787 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38769.log.gz 2024-09-17T18:17:55.787 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36317.log.gz 2024-09-17T18:17:55.787 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2024-09-17T18:17:55.787 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32057.log 2024-09-17T18:17:55.788 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37053.log.gz 2024-09-17T18:17:55.788 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.12.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31618.log 2024-09-17T18:17:55.788 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37643.log 2024-09-17T18:17:55.788 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32057.log.gz 2024-09-17T18:17:55.788 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38977.log 2024-09-17T18:17:55.788 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31618.log.gz 2024-09-17T18:17:55.788 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33284.log 2024-09-17T18:17:55.788 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37643.log.gz 2024-09-17T18:17:55.788 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32749.log 2024-09-17T18:17:55.788 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38977.log.gz 2024-09-17T18:17:55.788 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38743.log 2024-09-17T18:17:55.788 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33284.log.gz 2024-09-17T18:17:55.788 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34400.log 2024-09-17T18:17:55.789 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32749.log.gz 2024-09-17T18:17:55.789 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33455.log 2024-09-17T18:17:55.789 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38743.log.gz 2024-09-17T18:17:55.789 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36946.log 2024-09-17T18:17:55.789 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34400.log.gz 2024-09-17T18:17:55.789 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31188.log 2024-09-17T18:17:55.789 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33455.log.gz 2024-09-17T18:17:55.789 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35652.log 2024-09-17T18:17:55.789 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36946.log.gz 2024-09-17T18:17:55.789 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32382.log 2024-09-17T18:17:55.789 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31188.log.gz 2024-09-17T18:17:55.789 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37306.log 2024-09-17T18:17:55.789 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35652.log.gz 2024-09-17T18:17:55.790 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38483.log 2024-09-17T18:17:55.790 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32382.log.gz 2024-09-17T18:17:55.790 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36478.log 2024-09-17T18:17:55.790 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37306.log.gz 2024-09-17T18:17:55.790 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33871.log 2024-09-17T18:17:55.790 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38483.log.gz 2024-09-17T18:17:55.790 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34901.log 2024-09-17T18:17:55.790 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36478.log.gz 2024-09-17T18:17:55.790 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35781.log 2024-09-17T18:17:55.790 INFO:teuthology.orchestra.run.smithi087.stderr: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.33871.log.gz 2024-09-17T18:17:55.790 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36816.log 2024-09-17T18:17:55.790 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34901.log.gz 2024-09-17T18:17:55.790 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34287.log 2024-09-17T18:17:55.790 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35781.log.gz 2024-09-17T18:17:55.791 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33646.log 2024-09-17T18:17:55.791 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36816.log.gz 2024-09-17T18:17:55.791 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37749.log 2024-09-17T18:17:55.791 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34287.log.gz 2024-09-17T18:17:55.791 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37027.log 2024-09-17T18:17:55.791 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33646.log.gz 2024-09-17T18:17:55.791 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34338.log 2024-09-17T18:17:55.791 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37749.log.gz 2024-09-17T18:17:55.791 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38847.log 2024-09-17T18:17:55.791 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37027.log.gz 2024-09-17T18:17:55.791 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36868.log 2024-09-17T18:17:55.791 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34338.log.gz 2024-09-17T18:17:55.791 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33291.log 2024-09-17T18:17:55.792 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38847.log.gz 2024-09-17T18:17:55.792 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32383.log 2024-09-17T18:17:55.792 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36868.log.gz 2024-09-17T18:17:55.792 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33620.log 2024-09-17T18:17:55.792 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33291.log.gz 2024-09-17T18:17:55.792 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33073.log 2024-09-17T18:17:55.792 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32383.log.gz 2024-09-17T18:17:55.792 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38873.log 2024-09-17T18:17:55.792 INFO:teuthology.orchestra.run.smithi087.stderr: 27.1% -- replaced with /var/log/ceph/ceph-client.admin.33620.log.gz 2024-09-17T18:17:55.792 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36047.log 2024-09-17T18:17:55.792 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33073.log.gz 2024-09-17T18:17:55.792 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38873.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T18:17:55.792 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38873.log.gz 2024-09-17T18:17:55.793 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39029.log 2024-09-17T18:17:55.793 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36047.log.gz 2024-09-17T18:17:55.793 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36530.log 2024-09-17T18:17:55.793 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37689.log 2024-09-17T18:17:55.793 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39029.log.gz 2024-09-17T18:17:55.793 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32279.log 2024-09-17T18:17:55.793 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36530.log.gz 2024-09-17T18:17:55.793 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31165.log 2024-09-17T18:17:55.793 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37689.log.gz 2024-09-17T18:17:55.793 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32279.log.gz 2024-09-17T18:17:55.793 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32954.log 2024-09-17T18:17:55.793 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36426.log 2024-09-17T18:17:55.793 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31165.log.gz 2024-09-17T18:17:55.794 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.32954.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.32954.log.gz -5 2024-09-17T18:17:55.794 INFO:teuthology.orchestra.run.smithi087.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37301.log 2024-09-17T18:17:55.794 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37733.log 2024-09-17T18:17:55.794 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36426.log: /var/log/ceph/ceph-client.admin.37301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38223.log 2024-09-17T18:17:55.794 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36426.log.gz 2024-09-17T18:17:55.794 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37301.log.gz 2024-09-17T18:17:55.794 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37733.log.gz 2024-09-17T18:17:55.794 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32958.log 2024-09-17T18:17:55.794 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38093.log 2024-09-17T18:17:55.794 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38223.log: /var/log/ceph/ceph-client.admin.32958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38899.log 2024-09-17T18:17:55.794 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38223.log.gz 2024-09-17T18:17:55.794 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32958.log.gz 2024-09-17T18:17:55.794 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38093.log.gz 2024-09-17T18:17:55.795 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33537.log 2024-09-17T18:17:55.795 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34951.log 2024-09-17T18:17:55.795 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38899.log: /var/log/ceph/ceph-client.admin.33537.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21551.log 2024-09-17T18:17:55.795 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38899.log.gz 2024-09-17T18:17:55.795 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33537.log.gz 2024-09-17T18:17:55.795 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34951.log.gz 2024-09-17T18:17:55.795 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38691.log 2024-09-17T18:17:55.795 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36582.log 2024-09-17T18:17:55.795 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.tmp-client.admin.21551.log: /var/log/ceph/ceph-client.admin.38691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34260.log 2024-09-17T18:17:55.795 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21551.log.gz 2024-09-17T18:17:55.795 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38691.log.gz 2024-09-17T18:17:55.795 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36582.log.gz 2024-09-17T18:17:55.795 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35549.log 2024-09-17T18:17:55.796 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31158.log 2024-09-17T18:17:55.796 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34260.log: /var/log/ceph/ceph-client.admin.35549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33938.log 2024-09-17T18:17:55.796 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34260.log.gz 2024-09-17T18:17:55.796 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35549.log.gz 2024-09-17T18:17:55.796 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.31158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31158.log.gz 2024-09-17T18:17:55.796 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33963.log 2024-09-17T18:17:55.796 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36452.log 2024-09-17T18:17:55.796 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33938.log: /var/log/ceph/ceph-client.admin.33963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30945.log 2024-09-17T18:17:55.796 INFO:teuthology.orchestra.run.smithi087.stderr: 24.9% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33938.log.gz 2024-09-17T18:17:55.796 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33963.log.gz 2024-09-17T18:17:55.796 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36452.log.gz 2024-09-17T18:17:55.796 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33485.log 2024-09-17T18:17:55.796 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37312.log 2024-09-17T18:17:55.797 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.30945.log: /var/log/ceph/ceph-client.admin.33485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34396.log 2024-09-17T18:17:55.797 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30945.log.gz 2024-09-17T18:17:55.797 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33485.log.gz 2024-09-17T18:17:55.797 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37312.log.gz 2024-09-17T18:17:55.797 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34849.log 2024-09-17T18:17:55.797 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34396.log.gz 2024-09-17T18:17:55.797 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34849.log.gz 2024-09-17T18:17:55.797 INFO:teuthology.orchestra.run.smithi146.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T18:17:55.948 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T18:17:55.991 INFO:teuthology.orchestra.run.smithi146.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T18:17:56.048 INFO:teuthology.orchestra.run.smithi134.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2024-09-17T18:17:56.063 INFO:teuthology.orchestra.run.smithi087.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2024-09-17T18:17:56.136 INFO:teuthology.orchestra.run.smithi087.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2024-09-17T18:17:56.202 INFO:teuthology.orchestra.run.smithi134.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T18:17:56.202 INFO:teuthology.orchestra.run.smithi146.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2024-09-17T18:17:56.415 INFO:teuthology.orchestra.run.smithi134.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2024-09-17T18:17:56.546 INFO:teuthology.orchestra.run.smithi087.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T18:17:56.549 INFO:teuthology.orchestra.run.smithi146.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2024-09-17T18:17:56.582 INFO:teuthology.orchestra.run.smithi134.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T18:17:56.584 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-17T18:17:56.584 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m0.953s 2024-09-17T18:17:56.584 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m2.630s 2024-09-17T18:17:56.584 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m0.118s 2024-09-17T18:17:56.586 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T18:17:56.600 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2024-09-17T18:17:56.661 INFO:teuthology.orchestra.run.smithi154.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T18:17:56.669 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2024-09-17T18:17:56.670 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-09-17T18:17:56.670 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m1.005s 2024-09-17T18:17:56.670 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m3.655s 2024-09-17T18:17:56.671 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m0.133s 2024-09-17T18:17:56.712 INFO:teuthology.orchestra.run.smithi146.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T18:17:56.713 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T18:17:56.713 INFO:teuthology.orchestra.run.smithi146.stderr:real 0m1.062s 2024-09-17T18:17:56.713 INFO:teuthology.orchestra.run.smithi146.stderr:user 0m2.827s 2024-09-17T18:17:56.714 INFO:teuthology.orchestra.run.smithi146.stderr:sys 0m0.104s 2024-09-17T18:17:56.917 INFO:teuthology.orchestra.run.smithi087.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T18:17:56.919 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-09-17T18:17:56.919 INFO:teuthology.orchestra.run.smithi087.stderr:real 0m1.299s 2024-09-17T18:17:56.919 INFO:teuthology.orchestra.run.smithi087.stderr:user 0m3.318s 2024-09-17T18:17:56.919 INFO:teuthology.orchestra.run.smithi087.stderr:sys 0m0.177s 2024-09-17T18:17:56.920 INFO:tasks.ceph:Archiving logs... 2024-09-17T18:17:56.920 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228/remote/smithi087/log 2024-09-17T18:17:56.921 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T18:17:57.591 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228/remote/smithi134/log 2024-09-17T18:17:57.591 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T18:17:57.981 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228/remote/smithi146/log 2024-09-17T18:17:57.982 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T18:17:58.375 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228/remote/smithi154/log 2024-09-17T18:17:58.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T18:17:58.898 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T18:17:58.907 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T18:17:58.908 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T18:17:58.910 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T18:17:58.913 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T18:17:58.915 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T18:17:59.037 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T18:17:59.046 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T18:17:59.047 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T18:17:59.049 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T18:17:59.052 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T18:17:59.054 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T18:17:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T18:17:59.061 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================== 2024-09-17T18:17:59.061 INFO:teuthology.orchestra.run.smithi087.stdout:*hv01.front.sepi 67.205.162.81 3 u 50 64 77 0.161 -0.666 1.119 2024-09-17T18:17:59.061 INFO:teuthology.orchestra.run.smithi087.stdout:+hv02.front.sepi 63.231.80.2 3 u 50 64 77 0.114 -0.896 1.098 2024-09-17T18:17:59.061 INFO:teuthology.orchestra.run.smithi087.stdout:+hv03.front.sepi 74.6.168.72 3 u 46 64 77 0.135 +0.068 1.035 2024-09-17T18:17:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:17:59.062 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T18:17:59.063 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-09-17T18:17:59.063 INFO:teuthology.orchestra.run.smithi134.stdout:*hv01.front.sepi 67.205.162.81 3 u 50 64 77 0.080 -0.140 2.119 2024-09-17T18:17:59.063 INFO:teuthology.orchestra.run.smithi134.stdout:+hv02.front.sepi 63.231.80.2 3 u 49 64 77 0.083 -1.459 1.391 2024-09-17T18:17:59.063 INFO:teuthology.orchestra.run.smithi134.stdout:+hv03.front.sepi 74.6.168.72 3 u 44 64 77 0.098 -1.980 1.661 2024-09-17T18:17:59.063 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:17:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T18:17:59.064 INFO:teuthology.orchestra.run.smithi146.stdout:============================================================================== 2024-09-17T18:17:59.064 INFO:teuthology.orchestra.run.smithi146.stdout:+hv01.front.sepi 67.205.162.81 3 u 52 64 77 0.178 -0.583 0.918 2024-09-17T18:17:59.065 INFO:teuthology.orchestra.run.smithi146.stdout:*hv02.front.sepi 63.231.80.2 3 u 54 64 77 0.157 -0.798 0.929 2024-09-17T18:17:59.065 INFO:teuthology.orchestra.run.smithi146.stdout:+hv03.front.sepi 74.6.168.72 3 u 53 64 77 0.117 +0.164 0.925 2024-09-17T18:17:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:17:59.066 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T18:17:59.066 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-09-17T18:17:59.066 INFO:teuthology.orchestra.run.smithi154.stdout:+hv01.front.sepi 67.205.162.81 3 u 45 64 77 0.086 -0.759 0.233 2024-09-17T18:17:59.066 INFO:teuthology.orchestra.run.smithi154.stdout:+hv02.front.sepi 63.231.80.2 3 u 49 64 77 0.094 -1.299 0.188 2024-09-17T18:17:59.067 INFO:teuthology.orchestra.run.smithi154.stdout:*hv03.front.sepi 74.6.168.72 3 u 54 64 77 0.067 -0.348 0.304 2024-09-17T18:17:59.067 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T18:17:59.067 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T18:17:59.075 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T18:17:59.076 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T18:17:59.120 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T18:17:59.170 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T18:17:59.220 INFO:teuthology.task.internal:Duration was 848.573367 seconds 2024-09-17T18:17:59.220 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T18:17:59.270 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T18:17:59.270 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T18:17:59.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T18:17:59.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T18:17:59.277 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T18:17:59.315 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T18:17:59.315 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T18:17:59.316 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T18:17:59.364 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-09-17T18:17:59.365 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T18:17:59.375 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T18:17:59.375 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T18:17:59.384 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T18:17:59.385 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T18:17:59.396 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T18:17:59.396 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T18:17:59.408 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T18:17:59.417 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T18:17:59.429 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T18:17:59.465 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T18:17:59.466 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T18:17:59.481 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T18:17:59.484 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T18:17:59.497 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T18:17:59.563 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T18:17:59.572 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T18:17:59.573 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T18:17:59.585 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T18:17:59.596 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T18:17:59.609 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T18:17:59.620 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T18:17:59.630 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T18:17:59.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T18:17:59.640 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-09-17T18:17:59.641 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T18:17:59.649 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-09-17T18:17:59.653 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T18:17:59.660 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2024-09-17T18:17:59.673 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-09-17T18:17:59.753 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T18:17:59.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:17:59.758 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T18:17:59.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:17:59.800 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T18:17:59.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:17:59.805 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T18:17:59.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T18:17:59.810 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T18:17:59.820 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T18:17:59.821 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228/remote/smithi087 2024-09-17T18:17:59.821 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T18:17:59.844 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228/remote/smithi134 2024-09-17T18:17:59.845 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T18:17:59.868 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228/remote/smithi146 2024-09-17T18:17:59.868 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T18:17:59.890 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909228/remote/smithi154 2024-09-17T18:17:59.890 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T18:17:59.912 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T18:17:59.912 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T18:17:59.915 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T18:17:59.917 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T18:17:59.933 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T18:17:59.957 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T18:17:59.967 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T18:17:59.967 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T18:17:59.995 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T18:17:59.996 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T18:17:59.998 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T18:18:00.001 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T18:18:00.002 INFO:teuthology.orchestra.run.smithi087.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 18:17 /home/ubuntu/cephtest 2024-09-17T18:18:00.003 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T18:18:00.004 INFO:teuthology.orchestra.run.smithi134.stdout: 658614 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 18:17 /home/ubuntu/cephtest 2024-09-17T18:18:00.007 INFO:teuthology.orchestra.run.smithi146.stdout: 658465 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 18:17 /home/ubuntu/cephtest 2024-09-17T18:18:00.010 INFO:teuthology.orchestra.run.smithi154.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 18:17 /home/ubuntu/cephtest 2024-09-17T18:18:00.013 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T18:18:00.046 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T18:18:00.149 INFO:teuthology.run:Summary data: description: rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-stupid} rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} duration: 848.5733668804169 flavor: default owner: scheduled_skanta@teuthology success: true 2024-09-17T18:18:00.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T18:18:00.241 INFO:teuthology.run:pass